I look at it this way (since I was in this situation with my middle class parents):
Growing up, I never worried the lights or the water would be shut off, never worried that the house was gonna be foreclosed on. My parents were Exceedingly Bad With Money (and tbqh financially terroized each other a lot), but there was always some kind of food in the house, even if it was the cheapest food you could buy.
That’s a step removed from poverty, and is distinctly different from how my grandparents grew up, or many of the people I went to public school with. I don’t claim a struggle that wasn’t mine.
My parents absolutely held that over my and my siblings’ heads at every opportunity. When we were old enough to work, they’d pull out money from our accounts to pay bills (not because they weren’t making firmly middle class money by the late 2010s, but because they were Bad With Money and ruined each other financially and then had to pay the electric bill with my money). When we couldn’t work, my mom would have us help renovate our house, and I stayed home from school frequently to strip and restain our deck, paint the fence or house, re-caulk the tub, etc. We were expected to work to earn our keep, and when we got ready for college, we were expected to pick an acceptable major or else my parents wouldn’t fill out their portion of the FAFSA application or cosign private loans.
On top of all that, when my parents outed me as trans, if my best friend and their parents hadn’t been able to help me, I would’ve swiftly fallen to “in danger of being homeless.” And even with their help, we’re fucking poor. We’re not middle class. If we had kids, we’d be in danger of not making rent and bills and food every month, and one or two bad weeks would be devestating.
Actually rich parents have the ability to abuse you in ways you can’t escape from until they decide to give up. They have influence and sway over people who you need help from to escape. My dad wasn’t even rich, just a cop, and I had to leave the fucking state to ensure I wasn’t being monitored (and still couldn’t guarantee it). They know so many people that even 2 hrs away from my hometown, people saw my last name and went “Oh you’re their kid!” I had to change it, have the record made confidential, and avoid situations that could draw the wrong people’s attention. I’m positive rich parents can swing similar amounts of control if they choose to. They don’t have to physically stalk you or do anything that would be prosecutable. They can do it all from a distance. The cops likely won’t believe you.
The general rule is not to consider people as analogous to demographics. If you do, you will eventually look like an ass. Judge people on their actions, period.