A gun fight between loyalists of former president Francois Bozize and ex-rebels who ousted him killed nearly 55 people in Central African Republic (CAR), Reuters reported.

The battle between the two groups took place on Saturday and Sunday near Bossangoa, close to Bozize's home and 185 miles north of the capital.

"The defence forces lost five men, and there have been more than 50 killed among the assailants and civilians," said Guy Simplice Kodegue, spokesman for the government the Seleka rebels set up following the ouster. 

A commander in the Multinational Force of Central Africa (FOMAC) said at least 60 people had been killed. 

After rebels took control of the capital in March, the former French colony has erupted into chaos that new leader Michel Djotodia has barely been able to control. According to BBC, Djotodia has promised to give up his position after elections in 2016. 

"Houses were burnt, people were burnt alive including children, women, and old people who had nothing to do with the fighting. It is really disgusting," Kodegue said. 

Kodegue, a peacekeeper for FOMAC, confirmed that Bozize loyalists are to blame for the battle. 

After Bozize was removed from the presidency, he fled to Cameroon and told media outlets in Paris that he would like to return to power. 

The United Nations has expressed concern over the dismantled government structure and continues to support peace building efforts in CAR. 

"Four of the country's five presidents since independence in 1960 have been removed from power through unconstitutional means, and state authority is weak in many parts of the country. Ethnic tensions in the north and the presence of the Lord's Resistance Army (LRA), an armed group known for its brutal tactics, have added to instability, which has crippled the country for decades and driven people away from their homes," the U.N. website says.