No, files only exist if saved, and the only way to keep content when Geany is closed is to save it in a file.
Note that `Preferences->Various->interface.new_document_after_close` controls if new `untitled`s get made or only one as @codebrainz noted.