The Capitol stands in its own square.  Michigan Avenue runs into it from the East.  Capital passes it on the east side, while Ottawa and Allegan are on its north and south side respectively, and Walnut is on its west.

When you're walking through Lansing, be sure to look for the details!