SmartThings Multi-Sensor no Alerts

I’ve purchased a few multi sensors and I’ve stuck them on my doors in the house and one on my garden shed.
All of the sensors report back fine in my mobile app. Opening/Closing works, as well as the vibration/orientation and temp too!
Thing is when I set my mobile app to “Arm (Away)” and I open the door, I don’t get any notifications or alerts.
Is this normal? Or is it because it knows that there is an active presence sensor at home so it stays in “Arm (Stay)” mode?
Or am I suppose to configure a SmartApp or something to alert me?

Thanks for your help!

Have you checked the Smart Home Monitor settings?

If not, this is how you would check or set the settings in Android, I’m assuming the process is similar for iPhone:

  1. Go to the Dashboard screen of the mobile app
  2. Press the menu button and choose “Setup”.
  3. Press the “Security” option.
  4. Specify the settings for “Arm (Away)” and press Next.
  5. Specify the settings for “Arm (Stay)” and press Next
  6. Specify what types of notifications you want to receive and press Done.