Simon Cowell's Holland Park home was ransacked - jewelry and cash stolen - after a burglar broke into the West London house as the "X Factor" judge was asleep with his girlfriend and baby boy, according to The Telegraph.

The robber is believed to have made off with the loot from Cowell's safe after coming across it's key while searching for valuables. "Apart from the fact someone broke into my house and stole my stuff, which is scary, it could have been worse," Cowell said, according to Entertainment Tonight.

Cowell's bodyguard was alerted by a burglar alarm that was triggered at approximately 2:30 a.m. on Friday. Cowell's girlfriend, Lauren Silverman, 38, and his baby boy, Eric, were sleeping at the time of the burglary.

"Police were called to an address in W14 on Friday, Dec. 4 at approximately 2:20 a.m. to reports of a burglary in progress," London's Metropolitan police said, according to BBC News. "Officers attended the scene but the suspects had left the area. Enquiries continue. No arrests."

This isn't the first time Cowell's Holland Park mansion has been burgled. In 2012, a woman was issued a community order after she broke into the house by smashing a window with a brick and hiding inside the 56-year-old pop mogul's walk-in closet.