Along the side; by the side; side by side; abreast.
Together with or at the same time.
Side by side with.
Synonym of cater-corner: diagonally across from.
Synonym of cater-corner: diagonally across from one another.