there is a dashboard option that says alert me if the door is open for more than X minutes which you can make only for away mode.
however there is an “bug/feature” that doesn’t count if the door was already open when the mode changed to away. For that you can use @gbronzer 's app.