TLC's hit show Sister Wives could lose a few key cast members!

Life & Style has exclusively learned that three of the women are threatening to quit the show after husband Kody Brown, 48, discussed the possibility of taking on two new wives.

MORE: For More Exclusive Content, Sign Up For Life & Style's Newsletter!

“Kody is really, really sweating losing the show and he’s doing everything he can to keep it,” family friend Kendra Pollard shares.

ls cover 1638

But even if he does bring on more women, "TLC knows he's not well-liked by viewers," a source says. "Kody's done so many messed-up things that it serves him right to be pushed aside."

Kody's only legal wife is Robyn, 37, but he also has relationships and kids with Meri, 45, Christine, 44, and Janelle, 47.

For more info on the Sister Wives, including who wants to leave, pick up the latest issue of Life & Style, on newsstands now!