Not so. I was brought up as a Jew in a secularized household. I went to Hebrew school and celebrated the high holidays. I've been an atheist, though, as soon as I started to really think philosophically, since I was a teenager.
Christianity has always annoyed me most because of the ugly, grotesque hypocrisies in that religion's history. You can contrast Christianity with Judaism in that respect since Jews came to greater humility right in their scriptures, with the books of Job and Ecclesiastes.
Possibly, though, Christianity annoys me most because that's the religion I studied the most due to its centrality in the Western world where I live. Maybe the more you study any religion, the worse it seems regarding the split between its esoteric and exoteric contents.