Yes, the rechargeable battery can be replaced with a regular AAA battery. Although in this case it will no longer be rechargeable and would need to be replaced.
Mini USB Keyboard C3 - Glam Gold
USD 89.99
Mini USB Keyboard C3 - Pretty Pink
Mini wireless keyboard KB3 - Pretty Pink
USD 99.99