Don't know on Windows, on Linux would tell you to run `geany -c /tmp/non_existant` to make Geany run with a default configuration, but don't know if you can do that on Windows.
Are you sure _all_ plugins are disabled, not ticked in the plugin manager?