A Kentucky clerk's office led by an Apostolic Christian defied a federal judge's order and turned away a gay couple seeking a marriage license Thursday, citing religious objections.

Wednesday, U.S. District Court Judge David Bunning ruled that Rowan County Clerk Kim Davis, who is at the center of a federal lawsuit over her refusal to marry same-sex couples, must uphold the now-fundamental right to marry and issue marriage licenses to same-sex couples or risk setting a "dangerous precedent," reported USA Today.

Bunning wrote that Davis' "religious convictions cannot excuse her from performing the duties that she took an oath to perform as Rowan County Clerk." Refusing to uphold the law "likely violated the constitutional rights of her constituents," he wrote.

But hours later, Thursday morning, Davis wasn't at work, having taken a scheduled vacation, and her office refused to issue a marriage license to David Moore and David Ermold. A second couple was denied hours later, according to WKYT.

Davis says her Christian faith prevents her from issuing marriage licenses to gay couples. Following the June 26 U.S. Supreme Court decision that ruled same-sex marriage bans unconstitutional, Davis stopped issuing marriage licenses to all couples, gay or straight, according to the Associated Press.

Deputy Clerk Nathan Davis, Kim's son, said attorneys from the Christian law practice Liberty Counsel advised his office to continue refusing same-sex couples while it appeals the ruling to the Sixth Circuit Court of Appeals, according to AP.

"We came here, as anyone should be able to do, because there is an injunction," Moore told USA Today. "Anyone should be able to come in, walk in there and get a marriage license."

Moore said they also attempted to get the paperwork from the county judge executive's office, but were turned away after he informed them he didn't have the required paperwork and the issue would be settled by the courts.

Five couples sued Davis with the help of the American Civil Liberties Union, who will now decide if they want to pursue contempt of court charges, reported the Courier-Journal.

Ermold issued a tearful plea Thursday, calling the clerk's office "cruel."

"These people are cruel and this is wrong. And that's how it is," said Ermold. "That's the bottom line. She's wrong and these people are cruel to do this to us and that's how I feel."

It's the second time Ermold and his partner were denied a marriage license since the Supreme Court ruling. A video of their first attempt was posted online and can be viewed below.