Hue Lights Flicking with White 2-1

I have a non-neutral setup with with Hue.
Something weird is going on

  1. When switching to Smart Enable in Home Assistant, some of my hue bulbs randomly flicker. moving to Smart Disable stops the flicker
  2. Some of my Hue bulbs flicker when Smart Disabled

Can anyone think of a reason for this?