[B A B U]

I just bought the RIZONE mp3 Player 32gb. When you don't have your headset in you can hear your music by the speakers on the outside. But when you put the headset back in, the music just plays from your head phones. Well mine does both . How do I make it stop?