Euh, no. Used to have a renault clio, which was a lot safer than a car from the 80's like, lets say, a vw beetle. Lighter too, as back then cars were mostly made of steel, while its a combination of steel, aluminium and plastic now.
Same size of car too, so size doesnt matter either.
We make a 2 ton metal box, cruising at 70mph, and driven by basically anyone. The only way to do this while having a reasonable level of safety is to cram it full of features that make it heavy and expensive. This is fundamentally terrible.
People's needs for transportation will never cease to exist and there will always be some people that will need individual transportation so even in a world where only those who need a vehicle have one, I think it's only fair that they should be as safe as possible in it.