First, hold down the Shift key when adjusting the volume via the keyboard. Your other option is to have at it in System Preferences. Launch and click Sound, and then Sound Effects. Next, de-select "Play feedback when volume is changed." No more pip!
Pro tip: once you've made that change in System Preferences, the Shift key trick works differently. Hold Shift while adjusting volume to hear the pip.