Regular 2-1 switches are not rated for inductive loads (which fans are). You’ll want to use a Fan Switch and put it into Smart Fan Mode (which is the equivalent to Smart Bulb Mode but for fans).
The only caveat with this setup is that you won’t have any fan control if Home Assistant is down.