I have the same issue in my house, I use SmartThings as my main hub and Google Home for voice control. I have 7 of the Fan/Light switches. My solution was in Google Home, create a new “home” and put all of the Fan/Light switches in that home and only leave the Fan control and the Light control in the real home. So in your illustration, move the device called Kaylies Switch Master to the “fake” home in Google. I’ve found no good reason to leave these in the real home. Just use the child devices that are created in SmartThings and everything should work correctly with either the Google home hubs or Google Assistant. I created the same rooms in my fake home as my real home so that it’s easy to keep track of which fan/light is which. Hope that helps.