Lights turning themselves back on

I am having a problem that I THINK I have narrowed down to a consistency issue between my Inovelli dimmer switches and Hue smart bulbs. Quick synopsis… I am using Inovelli dimmer switches in dimmer mode and smart bulb mode. They are all connected to Hue white ambiance bulbs.

All the switches and bulbs are connected to Home Assistant through a SkyConnect USB dongle. I have no other hubs running. I also have the Adaptive lighting integration installed on my Home Assistant and am trying to use it to control the lights. All of the switches are also passed to Apple Homekit for Siri control. Just the switches, not the bulbs.

The Inovelli switches are all connected to neutral. I have 4 switches in a single box. There are 3 dimmer switches and 1 fan switch. The fan switch is connected to the box neutral and the dimmer switches are then daisy chain connected from the fan switch neutral.

Two of the switches have a single Hue bulb connected to it and the third has two lights. I bound them all to their respective switches, but there is not a way for me to look at what devices are bound together. All switches also have smart bulb mode turned on using the UI.

OK, so with all of that background, here is the issue I am facing. I can turn the lights on and off from my switches obviously. The problem I am seeing is that while the switch shows it is off, the bulbs still show as being on. So when it comes time for the adaptive lighting to transition the color temperature, it turns the lights back on. How can I ensure that the switch state and bulb state always match? Is there something I am doing wrong or missing here?

Use Zigbee groups. For each switch that has smart bulbs, put the bulbs and endpoint 1 of the switch in the group. Then bind the switch to the group rather than the bulb. As long as you only send commands to the group entity directly, everything should stay in sync.

So when I created a mixed group with the lights and the switch, there were two different groups created. A light and a switch group. Which group should I be binding to the switch?