Yes, you can ‘unpublish’ the page after sharing a publicly accessible link.
How to deactivate a link to published page?
Click on three dots ‘…’ next to the Start/Finish Editing button on the intended page and open Share tab or hit Share button at the top of the window
Change the Settings from ‘Anyone with the link’ to ‘Teams Only’, so the page is no longer publicly shared
