In a candid interview in the Billboard magazine's Sept. 27 issue, Aldean states emphatically that he would like people to move on from his affair with Kerr.

"It has been two years of this s---," Aldean said of his cheating scandal, according to Yahoo! Celebrity. "Get over it, already! And then when I finally do get enough of it and say something, every newspaper grabs it. And I'm not trying to get in the headlines -- I'm just trying to get people to stop running their mouths."

Aldean was caught kissing then-"American Idol" contestant Kerr in a Hollywood bar back in September 2012, while he was still married to his high school sweetheart, Jessica Ussery. Aldean later apologized for his behavior on Facebook, saying he "screwed up" and "had too much to drink" that night. He attempted to repair his marriage, but he and Ussery split the next year. The ex-spouses of 12 years share two little girls, Keeley, 11, and Kendyl, 6.

This past June, Aldean and now-girlfriend Kerr made their red carpet debut at the 2014 CMT Awards in Nashville. One month after the star-studded event, the "Burnin' It Down" singer took to his Instagram to defend his relationship with Kerr. "So sick of people judging me and @brittanylkerr over things they know nothing about," he wrote. "I have made mistakes but i am a better person because of it, and wouldnt change a thing. Im happier than i have ever been, so thank u to all the people who support us. We are happy and life goes on. Its time to move on people."

His public plea didn't have much impact.

Aldean confessed to Billboard that the negative feedback gets to him. "I'm pretty private, but over the last couple of years I've gotten that taken away from me, which kind of pissed me off," he said. "You know, my kids get on there and read all that. I'm not blaming anybody. Obviously, a lot of that stuff is my own deal. But I could go post something on my page right now that says, 'Hey, we just donated $5 million to a children's cancer research center,' and somebody would get on there and go, 'You're an a**hole cheater.'"

Aldean stated that he was not going to let the negativity of others stop him and Kerr from moving on with their lives.

"If I want to take my daughters to the mall, that's what we're going to do. If me and Brit want to go on a date, I'm not going to say, 'We need to eat dinner at the house, and sneak in the back door of the movie theater.' That's ridiculous."