buts101, You should expect 2 to 3 years from your battery depending on usage when it comes time to replace it there are a few sellers on ebay.
http://cgi.ebay.com/Lithium-Battery-...QQcmdZViewItem
Depending on what style player you have and the amount of battery space you can also use iPod replacement batteries.