Huh? I don't follow this.
Consider three equidistant points in one dimension: a, b, and c. What is the middle point? b
Consider four points, same principles: a, b, c, d. What is
the middle point? There isn't one. What are the middle
points? b and c
For one dimension, the amount of points has to be odd for there to be a center point.
Now, let's go 2d:
a1, b1, c1,
a2, b2, c2,
a3, b3, c3;
What is the middle point? b2
a1, b1, c1,
a2, b2, c2;
No single middle points. Arguably, b1 and b2 could be multiple middle points.
a1, b1,
a2, b2;
Again, no middle points. You will find that this will happen to any multiple of 4 in two dimensions (not just that, but this is the relevant example).
Whether or not the square is an infinite amount of points is irrelevant. It can still either be or not be divisible by four. In this case, each of the little squares is of exactly the same dimensions. Therefore, each of them has the area of A. The large square therefore has the area of 4A. We know that the large square consists of four times some amount of points (an infinite amount of points within each square's boundaries, of course). This is also why your original coordinate suggestions were wrong. Assuming that the squares do not have common points, plotting it from (0,0) to (1,1) would give us squares of areas (0.5+ε)^2 for two of them and 0.5^2 for the other two due to the inclusion of x=0 and y=0 (or, if you prefer x=1 and y=1)
If you disagree with this, well, you're wrong (I remind you of our boundaries! What's the middle item of (0;1]? No, it's not 0.5, that would be valid for [0;1], and I refer you to the above for why that can't be correctly split in four). However, even if you stubbornly cling to it, it doesn't help your case in the slightest. If we hold to your hypothesis, the "colour" of the middle "point" is this:

Now, ask yourself your own question: Is the middle "point" red or black?