A significant part of America's success is our vast access to natural resources. Oil, timber, rock, wind, sun, we have it all. That's not going to change even if people from other countries move here.
It has more to do with having a population of high average intelligence and productivity. Resources are useless if the population is incapable of utilizing them - See Africa.
Are there tangible ways immigration impacts your life in a negative way? I'm reminded of the South Park episode where they mockingly repeat "They took our jobs!"
I wish they didn't, but we both know what will happen.
Be a 130+ IQ guy who succeeds in life through talent and barely expends any effort. Become a millionaire before 30 through high disposable income (Achieved through above-average competence), hours upon hours of researching companies, and taking a large risk by investing in said companies. You became successful through your own merits.
But what if you're a 90 IQ guy who can't even do high school algebra? You blame 130+ IQ guy for your failings and vote for politicians who will tax 130+ IQ guy more.
I'd say guy #2 does have an impact on guy #1 even if they don't know each other.
Under the current rate, people like guy #2 will outnumber guy #1, and then we may as well elect Sanders as Dictator, who will direct Comrade AOC to steal guy #1's wealth.