Super Slow to respond with Home Assistant with White On/Off Switch

I have replaced all switches in my house (35 of them) with Inovelli White On/Off switches. Trying to use these with Home Assistant, and I got them all to pair, was able to set-up some automations, etc.

However, the response time of the switches is quite poor. Never seen the “I pressed the switch” to “Light Turns On/Off” occur in less than 2 seconds. Sometimes it doesn’t happen at all. In Home Assistant, if I am on the Device Config page (where I can see Events), it is slow to register the event. So I’m pretty sure the issue is Switch-to-HomeAssistant lag, and not the automations themselves within HA.

I do notice as well, in Home Assistant, very often much of the Diagnostic Entiries are showing as Unavailable, or I’m seeing events that they are going Unavailable, then back.

Things I’ve tried:

  1. Setting the Switch to “Instant” instead of the 300 ms delay. No difference for me that I noticed at all.
  2. Upgrading the Firmware to 1.0.3 (@EricM_Inovelli sent me instructions). Might be more reliable, but not faster.
  3. Upgraded from the Home Assistant Connect ZBT-1 to ZBT-2 (they claim it’s 4x faster). No difference at all.
  4. In Home Assistant, I went into Settings→Thread→Changed Channel from 15 to 20. Waited the 5 minutes it said to, then restarted the HA Box. Don’t think that helped either.
  5. Changed my WiFi Router’s power setting from “High” to “Medium”

Hopefully someone can have some good idea? For other people with Home Assistant and these White On/Off Switches, if you go into HA’s Settings→Device→Matter→Pick-a-Switch, and monitor the events, are they showing up nearly instant after you press a button, or are they pretty lagged (a few seconds).