No. It is prejudiced to assume that. Racism = prejudice + power. You cannot be racist against us! You could be prejudiced, which would be unlikely because we are featured more strongly in all media and power structures so it's harder to make generalities like "all white people are ____".
Racism doesn't stem from birth, it is created from influences and beliefs of narrow minded, terrible modelling influences such as parents, who are spreading their own hate instead of love and compassion onto their children.