I ended up having to put together my own app to do this until ST can do it within there own app. The one I use the most that replicates being notified for something being left open, on, or unlocked too long is a parent/child smartapp: (you’ll want all of these)
Parent: (Save and Publish)
https://raw.githubusercontent.com/jsconstantelos/SmartThings/master/smartapps/jsconstantelos/alerts-left-it-on-open-or-unlocked-parent.src/alerts-left-it-on-open-or-unlocked-parent.groovy
Left it On Child: (just Save)
https://raw.githubusercontent.com/jsconstantelos/SmartThings/master/smartapps/jsconstantelos/alerts-left-it-on-child.src/alerts-left-it-on-child.groovy
Left it Open Child: (just Save)
https://raw.githubusercontent.com/jsconstantelos/SmartThings/master/smartapps/jsconstantelos/alerts-left-it-open-child.src/alerts-left-it-open-child.groovy
Left it Unlocked Child: (just Save)
https://raw.githubusercontent.com/jsconstantelos/SmartThings/master/smartapps/jsconstantelos/alerts-left-it-unlocked-child.src/alerts-left-it-unlocked-child.groovy
Left it Running Child: (just Save)
https://raw.githubusercontent.com/jsconstantelos/SmartThings/master/smartapps/jsconstantelos/alerts-left-it-running-child.src/alerts-left-it-running-child.groovy
Thermostat Mode Monitor Child (this one is designed to work with my thermo DTH, so I can’t ensure this child app will work for you): (just Save)
https://raw.githubusercontent.com/jsconstantelos/SmartThings/master/smartapps/jsconstantelos/alerts-thermostat-mode-monitor-child.src/alerts-thermostat-mode-monitor-child.groovy