Simon Cowell: 'I Was Born to Be A Dad'

03/06/2014 at 02:50 PM EST

Lauren Silverman, Eric and Simon Cowell

Courtesy of Simon Cowell

Simon Cowell is one doting papa. The music mogul welcomed his first child, Eric, with girlfriend Lauren Silverman last month and he's already looking to expand his family.

"I wouldn't rule out [more children]," he told Extra 's Terri Seymour (who he dated for six years). "I had a brother when I was younger, so I kind of think it's cool to have two or three … two."

Cowell says fatherhood initially made him nervous, but once Eric was born, he immediately became a natural.

"I actually said to Lauren beforehand, 'What if I like the dogs more than him?' and she said, 'You're gonna be absolutely fine,' and then literally within seconds of him being born, I got it! I was born to be a dad," he said.

And as for why he named him after his father?

"We were gonna call him Simon and then we said, you know what it's not a good idea, so we decided on Eric. And I look at him and I think of my dad all the time, so it's a really good thing," he said.

RELATED: Why Simon Cowell Named His Son After His Dad