When I first started collecting I thought that I really needed a 100. Then I got a TKL, then a hhkb, then a 40....
I'm lucky that I don't have to type fast at my job because the constant changing keyboards and having to remember how I programmed the layers definitely slows things down.
I got an ortho keyboard (Planck EZ) a couple of months ago, and at first typing on it was really awkward, but after only a couple of days my typing speeds got almost as good as before. Layers are a bit confusing, but it's not super hard to memorize them