PS: Geany don't save new files, so you can always restart Geany to remove unwanted opened files. :)
Correct, Geany does not create new __files__ until the document is saved, so just close unwanted ones. There are 10 trillion* more ways to close documents being added in other PRs.
* rough estimate, YMMV