Some people do exactly that. It’s covered in the “best switches for Hues” FAQ.
There are two main problems. Whether or not they’re problem for you just depends on your specific use case.
One) if your home automation system isn’t working, you won’t be able to turn the lights on and off.
- in a few places in the US, although not many, it’s not to code to do this. You have to have a switch that controls the fixture. So you need to check your local codes to see if it’s OK. It probably will be, but you will want to know.