The second easiest thing would be to get one of the two “smart switch covers” and put it over the existing switch. You could then simply schedule that for the times when it would work. And you would have a instant manual override in your phone app. You will find these and other button and remote options in the following thread. Most of these can be scheduled.
But to be honest, the easiest thing is just to put a $2 child safety lock on the existing switch. That way an adult can still use it without your having to make any changes. These come in many different styles and colors, and any baby store or hardware store will have a selection. Or Amazon carries them.
We use these at our house to keep people from turning off the switch that controls The front porch camera.
