There's that stereotype about quebecers being rude, which, from what I saw from a bunch of people, may look true, but often when I see people visiting Quebec city and asking info to people living there, people are nice to visitors and stuff in general. I don't know about the rest of Canada, though.
Also yeah it wouldn't be racism, but rather stereotypical or to a lesser extent bigot, I guess.