The two items named “Fan” and “Light” are non removable. I’ve removed the switch entirely and added again only to get the same behavior (4 child devices). If I remove the other two they eventually automatically show up again.
All 4 child devices correctly control the switch, but then the physical switch un-syncs and requires the air gap be pulled. I’m monitoring the forums for that other problem.
*Edit: appears there are others with the same issue here: LZW36 Creates fan & light automatically