There are better compression formats than MP3, if your priority is small size and low CPU. You'll get lower audio quality, but I know it's a lot more feasible on the PSX. I don't know what these formats are, but hell even the SNES processor was able to manage compressed voice without a coprocessor (Virtual Bart, a sh*tty game, but technically kind of impressive).