Sen. Lindsey Graham, R-South Carolina, was having some trouble during the 2011 Pro-Am, repeatedly veering to the right off of the tee.
His ball whistled by a baby carriage on the 10th hole. Luckily, the baby wasn't in it at the time, and the mother laughed it off.
And he banged a shot from the pine straw into a large pine on the 12th.
But his favorite Heritage memory involves a CEO who found Harbour Town Golf Links even more challenging than he.
It was a few years ago and Graham, a CEO that Graham prefers not to name and two others had just started out on the course.
"On one of our first holes, the spectators crowded around the tee box and lined down the fairway, creating a tunnel of sorts," Graham recalled. "The CEO got settled, teed off and shanked a horrible drive that hit a nearby onlooker -- Bam!"
Luckily, the spectator was not injured.
"But you could've landed a 747 between us and the crowd the rest of the day," Graham said. "The spectators moved so far back from our foursome that some of them watched with binoculars!"
It remains to be seen if Graham's 2016 presidential bid goes any better.