Calvert Cliffs State Park

Nice cliffs with plenty of fossils. The beach next to the cliffs is accessible by a 2-mile (each way) hiking trail through forest and marshland, but the access to the cliffs themselves is no longer permitted due to erosion. There's an entrance fee of $5 per car.

www.dnr.state.md.us/publiclands/southern/calvertcliffs....

There's a historical marker at the entrance to the park that says "First described in 1608 by Captain John Smith and marked on his map. One of the most unusual natural curiosities in the state."
www.hmdb.org/marker.asp?marker=3439