There was an interesting quiz in an issue of Psychology Today back in the mid-80s I remember taking. It had a number of unlabeled figures, which you were asked to label. For example, one of them was a circle, cut into four parts by a horizontal and vertical lines. You were asked to number them, 1-4. Naturally, I labeled them 2, 1, 3, 4, from left-to-right, top-to-bottom. I laughed when I read the "answers," which noted that something like 78% of people asked to do this would label them 1, 2, 3, 4, from left-to-right, top-to-bottom, because that's how people read. The next most common answers were, if I remember correctly, 1, 2, 4, 3, and 4, 1, 3, 2, given by people who just labeled them in clockwise order--the first by people who started with top-left, where you start when you read, and the second by people who started where the clock starts. After that was an answer some women gave, that apparently mapped up with the arrangement of the controls on a stove. Mine was the rarest answer, which, the article noted unenlighteningly (I thought), was "related to a kind of analytic calculus."
The amusing origin of the article was the fact that scientists were then planning control arrangements for the international space station, and discovering that arrangements that were intuitive to some people made no sense at all to others. To Westerners, for example, red buttons say "emergency," but, for obvious reasons, to Chinese Communists red said "safe and effective."
Anyway, my point is the same as before: these are conventions. I don't think one is right--I just think it's very helpful if we stick with the most commonly held convention--even if does mean I have to remember that the quadrants of a circle do not correspond to the unit-circle, and that I have to order my dates month-day-year.