The UI is a bit janky, but the Hiby R1 (what I have) is a decent audio player for not much money. It has a plastic casing though and it's not easy to remove the battery. I don't think it fits enough of your criteria unfortunately, but wanted to mention it just in case.