Well, you are looking n the right place, those things are set by your theme.
But are you sure you are using a GTK-3 version of Geany, IIUC most distros still provide a GTK2 one, check `menu->help->debug messages` near the top.
If its gtk2 you need to check gtkrc files IIUC.