How small do you need to be to ride a cat?

I mean they're not like horses I don't think they could carry a proportional tiny house amount of weight.