Warning to Rich Oppressors (Americans?)

From James 5: 

Now listen, you rich people, weep and wail because of the misery that is coming on you. Your wealth has rotted, and moths have eaten your clothes. Your gold and silver are corroded. Their corrosion will testify against you and eat your flesh like fire. You have hoarded wealth in the last days. Look! The wages you failed to pay the workers who mowed your fields are crying out against you. The cries of the harvesters have reached the ears of the Lord Almighty. You have lived on earth in luxury and self-indulgence. You have fattened yourselves in the day of slaughter. You have condemned and murdered the innocent one, who was not opposing you.

I can't read these verses without seeing myself and my culture in them. Luxury and self-indulgence. Failing to pay workers their wages. The food I eat, the clothes I wear, the things I buy--are the workers who make and grow those things paid fairly? If not, I am guilty of withholding wages from those who deserve them. What can I do about this? I am not sure yet.