Any way to directly connect to the hub?

I don’t have go control switches, but since the commands do go to the cloud and back there could be varying factors like data connection etc. Fwiw my GE switches are almost instant, so you might have some other issue going on.