Well, VAUXY, there is Weak Atheism, and Strong Atheism. Weak Atheism poses that G-d could logically exist, but doesn't. Strong Atheism poses that G-d could not even logically exist, that to even discuss the existence of G-d is like discussing the existence of a married bachelor.
Frankly, I am inclined to agree with you. I think it takes far more faith to be an atheist than it does to be a religious person, and you are right that being agnostic is the easiest of the three choices by far. "I do not know, and thus I shall not worship," is a pretty simple philosophy to follow. It is not one with which I am in agreement, but I understand it.
I think, although I have never had it put this way, that you might find the same categories of theists. Weak theists might be inclined to believe that G-d exists, but acknowledge that in another world, he might logically not exist. Strong theists would deny even the possibility that G-d could not exist, and regard discussing it as the utmost blasphemy, and consider it to make as much sense as talking about a married bachelor.
Personally, I would put myself in between the two. I can conceive of world WITHOUT a being a greater than which cannot possibly be conceived. HOWEVER, and this is the key word, there would still, in my mind, have to be very powerful beings that could create us, ie, gods and goddesses along the lines of the Greek or the Norse or the Celtic type pagan pantheons. "Stuff" just does not happen from nothing. Something has to be around to create "stuff".
Now, you know my views, as often as we've debated them with each other. But that might expand on my thought patterns a bit for you.