We report a strong geometry-dependence of compressive plasticity in a Zr-based bulk metallic glass (BMG). With a standard orthogonal geometry, the Zr-based BMG typically fractured at a plastic strain less than 2%. However, by modifying the sample geometry while maintaining the sample aspect ratio, a large apparent compressive plastic strain over 10% was achieved consistently. These results present a new method on arresting the catastrophic failure of the glassy alloys and offer ways for BMGs in engineering applications.