Ben Carson doesn't think gay rights and civil rights should be compared to one another. 

The American author and 2016 Republican hopeful said that comparing gay and civil rights "irritates" him, despite his vow in March to stop talking about gay rights. 

Carson appeared on Fox News' "Special Report" Wednesday night speaking with Brett Baier. He made the following statement in reaction to CNN host Chris Cuomo:

"I was a little bit irritated that he was equating the whole [gay marriage] issue with the Civil Rights movement. Because, quite frankly, I didn't remember any times when there were signs up that says, you know, 'everybody else here and gay people have to drink at this fountain.'" 

Carson originally said he was going to stop speaking about the issue entirely because critics were using his stance against gay rights to hurt him politically. 

Despite the negative press against Carson, he is still near the top of many 2016 primary polls.