You were right! I copied my other activities, but there is an option not to set the input. Using that it works really well! Latency was barely there.
Still a tedious workaround, and you’ll need a SmartApp for every command and a virtual switch or something to trigger the SmartApp; but I can find a few good uses.