What keeps dimming my monitors?

I'm not sure if this is related to Night Light (which I don't have enabled) or even just the monitors dimming in power settings, but I constantly have to go and bring my brightness back up from 20% when I sit down at my computer in the AM.

I have disabled Sleep as well, and the only thing left is the regular Energy Saving features of dimming after X minutes and Turn Off Monitors after X minutes, but I've set both of those to short timeouts and when it comes back, it's at 100%.

Edit: For some reason I was on X11. I've switched to Wayland and will see if that changes anything.

Any ideas what's causing this?