A round manhole cover cannot fall through its circular opening, whereas a square manhole cover may fall in if it were inserted diagonally in the hole.
A round manhole cover has a smaller surface than a square one, thus less material is needed to cast the manhole cover, meaning lower cost.