Then the Bulbs are likely bound to The remote. Try turning off the hub (take it off power and take out the batteries). If the remote can still control the bulbs, then they are independently bound and the remote is not actually being used as a SmartThings button controller.
I don’t think you’ll be able to use the following device handler, but if you read through the thread, I think you’ll see that they are having the same issues with that device that you are having with yours, and it might give you some ideas.