Can't turn fan off with Blue Series 2-1 and Canopy module

I got my Blue Series 2-1 switch installed along with the Blue Canopy module. I set up the dual Zigbee bindings as well. Light control works great. Fan control works to turn the fan on and cycle through Low, Medium and High. But I can’t get the fan to turn off.

In cycle mode it just stays on high after the fourth press. In multi tap mode nothing seems to happen if I hold the button down. I’m not sure how long you’re supposed to hold it down for to turn off (that’s not specified in the instructions). Eventually it starts doing the green/yellow/red pattern that I think means factory reset, so I’m guessing that’s too long to hold it.

Any suggestions on what I might be doing wrong? Thanks!