Power Allowance only triggers when device turns OFF, not when it turns ON

I’ve configured PowerAllowance to turn a ZWave Switch off 60 minutes after it turns on.
However, it seems it ONLY tries to turn off the switch after I manually turn it off.
Any idea what is wrong here?