I never had the S5. I had a 4, then an 8 (yes I go a while between "upgrades"), but I remember both of them being a ton of fun to use and very fast for their times.
You're right about both were being better. But one big difference between the two Notes and s5 was that the s5 had water 💦 resistance, once the battery cover and charging port were properly closed.