The judge of "The X Factor (US)" revealed the plan in an interview with Ryan Seacrest, reported Aceshowbiz.
"Are you out of your mind? I know this sounds awful, but it's like you don't want to go in to the restaurant while they're making your dinner. I think there are certain things you shouldn't see and that is one of them. I'll be very close by, but no I won't watch," Cowell said when asked if he will witness the birth of his first child.
The music mogul also hinted at his plan to marry Silverman.
"Let's put it this way, I wouldn't expect her to be a single mother," he said.
