All state parks really are beautiful and have beautiful natural spots but what makes this park special is also its Historic areas. But I'll let the photos do the talking.
Pros: Variety of natural spots and also bridges and stone buildings, bathroom available while park is open, lots of available parking, doesn't require a hike to get to the many available areas, not crowded.
Cons: Since there is a creek there is a potential for little kids getting wet or getting in to mud. Something to think about if your little one heads right to the dirt in their best clothes.