Config button not triggering scenes?

I have two red series dimmers which I have installed the newest beta firmware update on and disabled the 700ms relay. So double and triple tap scenes don’t work which is expected, but I also can’t get the config buttons to trigger any scenes. That should still work right?

My SmartThings setup is an automation:
switch > config button > pressed
Run scene

I use smart lighting app in ST to trigger a scene on the config button. Config button is button number 7.

I’m surprised you’re even seeing a config button choice in Automations. Mine give a choice of on, off or on/off.

Do it with Smart Lighting or a Button Controller. As @stu1811 said, you’re trapping a push on Button 7.