Is it racist to be critical of affirmative action?

I mean isn't affirmative action just reverse discrimination? Somebody is going to get a job even if they are not the most qualified applicant, simply because of skin color.