And there's no magic in talking about religious miracles or about a divine person existing forever with no parents who created the universe from nothing?

Atheists typically defer to scientists who explain things as far back as they can by positing the opposite of magic, namely natural causes. There are still mysteries left over because our knowledge and rational methods are bound to be limited.

The question at that point is whether we should admit we don't know what lies beyond our rational knowledge or take a leap of faith in some archaic religious absurdity.