No one is blaming ANYONE for having privilege. What people are asking is that you realize you have, and benefit from, privilege regularly and that judging other people from a position of privilege is gross and ignorant.
I have NO patience for people who hate on those who experience luck and opportunity or benefit from privilege, or variance. I also have NO patience for people who believe everything they have achieved is solely because of hard work and nothing to do with luck, privilege, or variance.