MP3 isn't loaded when I change battery
 

Hello,

my MP3 player (not MP4) without video, it is supplied with AAA battery. When the old battery dies and I insert new battery the player writes ...starting... then ...PRESS ANY KEY... and after I press any key it is turned off, and it repeats again...again and again, until I insert the player in USB slot in the computer. After I pull off the player from the computer it works normally and it turns on normally too. Help how to avoid this situation.