Further info, it works if Geany is started with Addons enabled, but doesn't work if Addons is enabled after Geany starts, and stops working when Addons is disabled and re-enabled.
Disabling and re-enabling the preference seems to work ok if it was working, but won't start it working if it wasn't.