8 phrases passive-aggressive people use to undermine your confidence without you realizing it

by Lachlan Brown | November 7, 2025, 8:55 pm

Passive-aggressive people are experts in subtle manipulation. They don’t attack you directly — they chip away at your confidence quietly, one comment at a time.

They make you question yourself without ever seeming openly rude. You walk away from the conversation uneasy, wondering why you suddenly feel small or uncertain.

Here are eight common phrases passive-aggressive people use to undermine your confidence — and how to recognize them before they do real damage.

1. “Wow, you’re really sensitive.”

This phrase is designed to make you doubt your emotional intelligence. When someone hurts you and you call it out, they flip the script and label your reaction as the problem.

By saying “you’re too sensitive,” they invalidate your feelings and create a dynamic where you hesitate to speak up next time. It’s a way of keeping you quiet — while they get to keep crossing boundaries unchecked.

The healthy response? Stand firm. You’re not “too sensitive” for having boundaries; they’re just uncomfortable with being held accountable.

2. “I was only joking.”

On the surface, it sounds innocent — but this is one of the most common ways passive-aggressive people disguise cruelty as humor. They use jokes as weapons, then retreat behind the shield of “I didn’t mean it.”

When you call them out, they accuse you of lacking a sense of humor. It’s a perfect trap: you’re either the butt of the joke or the “uptight” one who can’t take it.

Real jokes make everyone laugh. Passive-aggressive “jokes” only make one person feel small.

3. “Good for you.”

On paper, it sounds supportive. But tone is everything. When said with sarcasm, eye rolls, or tight smiles, “good for you” becomes a cutting remark disguised as politeness.

It’s often used when you share something positive — a promotion, a new relationship, a personal goal — and instead of genuine happiness, you get a backhanded dismissal.

It’s their way of saying, “I’m pretending to support you, but deep down, I’m resentful.”

Listen carefully to how it’s said. Real support feels warm. Passive-aggressive approval feels cold and performative.

4. “I guess some people have all the luck.”

This phrase sounds self-deprecating, but it’s actually envy wrapped in self-pity. It minimizes your effort by implying your success wasn’t earned — it was just luck.

Instead of acknowledging your hard work, they subtly plant the idea that you didn’t deserve what you achieved. Over time, this kind of remark can make you second-guess your accomplishments.

Remember: people who are secure in themselves don’t need to reduce others’ success to “luck.” They celebrate it because they know there’s enough to go around.

5. “Must be nice.”

Few phrases drip with more resentment than this one. “Must be nice” sounds casual, but it’s meant to inject guilt or shame into your happiness.

It’s their way of saying, “I wish I had what you have, but I’ll act like your life is unfairly easy.” It turns your joy into something to apologize for.

Don’t take the bait. You don’t have to shrink your wins to make insecure people comfortable. Confidence isn’t arrogance — it’s peace with your progress.

6. “I thought you already knew that.”

This phrase often shows up in workplaces or social circles where subtle hierarchies exist. It’s a way of implying that you’re out of the loop, behind, or less competent — all without directly saying it.

It’s meant to embarrass you and reinforce their superiority. The worst part? It’s delivered as if they’re surprised or concerned, so it sounds innocent.

Don’t internalize it. Everyone learns at different speeds, and genuine people share information to help — not to shame.

7. “I didn’t think it would bother you.”

This is the classic gaslighting line. They cross a boundary — make a comment, take an action, or withhold something important — and when you confront them, they claim ignorance.

It shifts the focus away from their behavior and onto your reaction. You start wondering if you’re overreacting. You’re not.

When someone repeatedly “doesn’t realize” what bothers you, it’s not an accident. It’s a tactic to keep doing what they want while avoiding responsibility.

8. “You’re reading too much into it.”

This one is designed to shut down your intuition. It tells you that your interpretation — your instincts — can’t be trusted.

Passive-aggressive people love this phrase because it erodes your confidence in your own perceptions. Over time, you start second-guessing your gut feelings, even when something feels clearly off.

But your intuition is one of your greatest tools for protection. When someone consistently tells you you’re “reading too much into it,” they’re often trying to stop you from seeing the truth.

Final thoughts: Subtle words, deep impact

Passive-aggressive people thrive in the gray areas of conversation — where tone, timing, and subtext do the real damage. They rarely say something openly cruel. Instead, they plant seeds of doubt that grow slowly inside you.

The key is awareness. When you recognize these phrases for what they are — control tactics — you take their power away. You stop personalizing the sting and start seeing the pattern.

And once you do that, their comments stop being confusing. They just become transparent.

Because true confidence doesn’t come from everyone liking you — it comes from finally realizing whose approval was never worth chasing in the first place.

Lachlan Brown

Lachlan Brown is an entrepreneur and co-founder of Brown Brothers Media, a digital publishing network reaching tens of millions of readers monthly. He holds a Graduate Diploma of Psychological Studies from Deakin University, though his real education came afterward: a warehouse job shifting TVs, a stretch of anxiety in his mid-twenties, and the slow discovery that studying the mind is not the same as learning how to live well. He started experimenting with Buddhist principles during breaks at the warehouse and eventually began writing about what he was learning. That writing became Hack Spirit, a widely read personal development site, and his book Hidden Secrets of Buddhism became a bestseller. His work breaks down complex ideas into frameworks people can apply immediately, whether they are navigating a career change, a difficult relationship, or the gap between knowing what to do and actually doing it. Lachlan splits his time between Singapore and Saigon. He writes about high-performance routines, decision-making under pressure, digital innovation, and the intersection of Eastern philosophy with modern life. His perspective comes from having built things from scratch, failed at some of them, and learned that clarity comes from practice, not theory.