Are you using the security features in the Classic mobile app (SHM) or the new V3 mobile app (STHM)? They are similar but different features.
FAQ: SHM and STHM are different
FAQ: how to tell which version of the SmartThings mobile app that you have