If they’re assuming you’re asleep when you’re not moving, that’s a big assumption. People sit still to watch TV, and move in their sleep. Setting a sleep schedule for the watch should improve accuracy.
I’m not a wearable engineer so I wouldn’t know, but I assume it uses a combination of movement, heart rate, and other sensors. Fitbits for example can detect sleep down to the sleep stage you’re in.