Non-philosophers I meet sometimes ask: do I think mathematical facts are invented or discovered? IMO, this is a weird question - and not one that comes up much in the phil math literature- because the contrast between invention and discovery is not very well defined. For example, did Alexander Gram Bell *invent* the telephone, or did he *discover* that putting components together in a certain way would build a telephone? Intuitively, one might say both.
Maybe what people mean to be asking by this question is just this: do mathematicians bring new mathematical objects into existence, or do they discover already existing objects? For, paradigmatic cases of invention typically do involve creating a new physical object, while paradigmatic cases of discovery involves visiting an already existing physical object. So e.g. Columbus discovered America (because it already existed and he went to visit it) whereas Bell invented the telephone, by physically creating the first prototype.
However, the contrast between invention and discovery can't really just track the distinction between cases where a new object is made vs. not. This is because making a new thing isn't required for invention *or* discovery. Consider an imaginary scenario where Bell just thought up a plan for a telephone, and told someone else who physically constructed the first one years later. Bell would still have invented at telephone, if he though up the plan and then worked out from known principles that the plan would work, but never made one.
While we are talking about invention and discovery, I think there's a third notion -artistic creation (e.g. what happens when someone composes a story or a poem)- which bears an interesting relationship to mathematical discovery. When a writer writes a story, they are putting down a sequences of sentences which already exists as an abstract object.
I mean, suppose that the story teller composes a story today. If a linguist said yesterday 'no intelligible sequence of English sentences has property P', the and the sequence or sentence which the story teller writes down today has property P, then then the linguist's claim yesterday was false. The domain of potential counterexamples to linguistics claims today, already contains all sequences of English sentences which literary ingenuity could ever devise. Note also that to compose a story or poem doesn't require writing it down anywhere, (the person in the Borges story who has time stop so he can finish writing a poem before he gets shot still counts as creating the poem). For this reason the task of literary "creation" doesn't really seem to involve creating anything, (neither a physical artifact, nor an abstract string of sentences), but rather directing your attention to an abstract object that already exists - carefully sorting out which string of sentences will combine certain varied and subtle properties in the right way.
Now, if I'm right about this- the creativity of a poet or novelist doesn't need to involve creating any new object, but rather amounts to discovering a pre-existing string of sentences which has a certain property - this suggests a potential confusion about the relationship between mathematical creativity and ontology. Arguably, mathematical creativity is much like literary creativity. But, if mathematical creativity is like literary creativity, it does not follow from this that the mathematician creates the mathematical objects he describes, or that he creates anything else. For (if the above is right) literary creativity isn't a matter of bringing new objects into being, but rather a matter of discovering, amid the combinatorial explosion of possible sequences of English sentences, one that has a certain special features.