An option to consider. Change the bulb to smart bulb and install an aeon micro at the light/fan fixture to control the fan. Using the app control individual device and the dumb switch to kill both. Money is not an issue then change the dumb switch to a smart switch. Now you will have all the control at all time.