That driver only works for bulbs that are connected to a hue hub. It is essentially an LAN edge Driver between a Smartthings/Aeotec hub and a hue hub. It is not for Hue devices connected directly to a smartthings via Zigbee.
But to be honest, that’s just not a good method for most people anyway, because the hue bulbs are not good repeaters for other Zigbee devices on a smartthings network, and messages can get lost. Plus you lose a lot of cool features.
FAQ: Do I need the Hue Bridge/Hub to Use a Hue Bulb with SmartThings?
The connection between the hue hub and a SmartThings hub is local using LAN, so it shouldn’t be any slower than working without a hue hub. And if you want to directly connect a Zigbee button or controller to a hue bulb, you still can as long as that controller also connects to the hue hub.
So, as always, the first rule of Home automation applies: “the model number matters.“ What Zigbee devices were you hoping to connect together?