Uh oh! It sounds like Jennifer Garner and new boyfriend, John Miller, might be on different frequencies when it comes to how fast their relationship should be progressing. The pair secretly began dating six months ago, which John seems to think is plenty of time to consider moving in together. Jen, on the other hand, got a little freaked out by the idea… which lead to their very first fight, a source told Life & Style magazine exclusively!

Jen, 46, was spotted house hunting on Nov. 1, leading fans to believe the couple was taking a big step together. Unfortunately for John, 40, that wasn’t the case, according to a source. When he brought up cohabitating, Jen allegedly shut him down! “Jen really cares about John. She’s even told him that she loves him,” explained the insider. “But at the end of the day, Jen’s kids [Violet, 12, Seraphina, 9, and Samuel, 6] are her number one priority, and she thought they might be moving too fast — for them.”

Jennifer Garner Holding Kids
ROBYN BECK/AFP/Getty Images

So, Jen might be open to it if it weren’t for her kiddos, and “John understands Jen’s reasoning, but they still had their very first fight about it.” It might be a good idea for Jen to take some more time getting to know John before making any major moves like that, especially because he has a bit of a questionable past when it comes to relationships.

During their tumultuous, six-year divorce, John’s ex-wife accused him of being angry and controlling, according to legal docs obtained by Radar, and said that she would often back down to avoid raucous confrontations in front of their own kids. Still, Jen is really into him, and they both finalized their divorces in the past few weeks, so they can give this relationship a fair shot. Just don’t rush it, guys!

Life And Style Magazine Cover with Jennifer Garner

For more on this story, pick up the latest issue of Life & Style Magazine, on newsstands now!