App that will turn off switch after a short period?

If you are using the LFM-20 relays, just change the device type in the web ide for your device to " Z-Wave Virtual Momentary Contact Switch".

The relay will then behave like a momentary switch. You can then try this app: New smart app to link the virtual/simulated garage door device with two actual devices

Works very nicely for me.