Depends how you define the term. Some people seem to think any sane restrictions on mass immigration, and the defense of and celebration of one's own culture are "xenophobia." They are not.
"Xenophobia" is one of those words, like "homophobia," “transphobia,”"Islamophobia," "fascism," etc., that gets thrown at people for polemical reasons without regard to the actual facts or meaning of the words. They are words designed to shutdown debate and discussion of fundamental principles. If someone criticizes Islamic terrorism, ISIS, female genital mutilation, burkas, halal buthery, etc. certain people will denounce that as "Islamophobia" (or claim, with no evidence, that it will help fan the flames of "Islamophobia"). "Fascism" these days basically just means anything someone on the Left doesn't like.
Is Morrissey xenophobic? Hardly likely considering the personnel in his band, to name just one reason. But frankly, I wouldn't care if he were. It wouldn't change my assessment of him as an artist. Louis-Ferdinand Céline was a racist and anti-semite. He was also one of the greatest writers of the 20th century, and "Journey to the End of the Night" one of the best 4 or 5 novels of the last 100 years. I'm trying to think of a left-wing equivalent as well...a Stalinist, Castroite, Maoist, or something who nevertheless produced literature of the highest rank...can't think of any actually!