Dumb on/off switches with smart bulbs are fine as long as you hardly ever use the switches.
You probably already know this, but for those just exploring the options, Smart bulbs are intended to be on power all the time. If you regularly cut the power to them completely, the inrush current when you turn the power back on can shorten the life of the radio in the bulb significantly.
For those who expect to be using the switch often, there are a number of alternative ways to handle providing a wall switch for smart bulbs that will protect your investment: