If you don’t need the GPIO then buy a small form factor office PC like a Dell Optiplex Micro or a Lenovo/HP equivalent. They cost about the same on the used market, are more performant without the ARM headache and use only marginally more power (maybe 5-10w more at idle).
I quite like Fastmail. It’s a bit expensive but the service is very reliable and they have a well established reputation. You can create masked emails using their domain or your own from the web interface.