I was able to get the switch set up correctly in HA and am now able receive scene events and trigger automations.
I wanted to shut off the internal relay now (because the bulbs I’m controlling are tradfri) but I don’t know how. Using OZW and connecting to the QT UI, I was able to see the setting for SmartBulb mode and I set it to enabled, but it seems like that isn’t the setting that controls the internal relay.