To be fair, their software/security support is longer than any others that I'm aware of. They beat out even Samsung in that regard.
Only one that's close/better is Fairphone and they still have a looong way to go before they can compete in terms of quality and audience.
But I agree that their physical durability and repairability could seriously improve.
Never really had an issue with iPhone outside of the glass screen, but more recent Gorilla Glass offerings have mostly fixed that issue for me. I do love what Fairphone is doing.
Most Motorola and Samsung batteries are completely removable but there's something in the way to prevent it - glue, a sticker, a couple of screws. I doubt removing those measures will reduce the durability of the phones.