The newly single Spears, who mentored the young contestants, has quit the reality show, the People magazine reported.
"I've made the very difficult decision not to return for another season," Spears said in a statement.
"I had an incredible time doing the show and I love the other judges and I am so proud of my teens but it's time for me to get back in the studio," Spears added.
The 31-year-old star, who also called off her engagement to Jason Trawick, has hinted that she may get back to touring in 2013.
"Watching all do their thing up on that stage every week made me miss performing so much! I can't wait to get back out there and do what I love most."
Spears joined the show last April, signing a record-breaking USD 15 million deal.
Another X Factor judge, music mogul LA Reid, has already said he will not return for the 2013 series. This leaves only two judges on the panel- Cowell and teen star Demi Lovato.