How do I reclaim memory from sprites after removing them?

If possible, I would probably pick a sane number of sprites for the entire game and manage a pool of them by myself. Note that system like the GBA have hardware support for sprites, but the number is limited.