I have one for mildly hot temperature. If it gets cold I put something below it that covers my ears, like a thin beanie or a type of Balaclava made for biking for really cold temperatures. If its too hot, I just suffer.
You could, I just personally don't see the point. I ride in somewhat extreme temps (-15F to 100F), and honestly, the helmet isn't even a consideration. Then again, I'm just a commuter, so maybe there's a reason to bother for competitions or something.