In the OOP’s example, that is solved by magecraft (which is distinct from “true” magic btw) losing potency by becoming general knowledge, thus forcing mages into working their magecraft in secrecy.

Both the mages and the Church work hard at keeping it a secret, albeit with different motives and methods.