You are the major hypocrite here who labels him as gay when he doesn't want to labeled at all, by the reasons he may have, which belong to him and he doesn't have the obligation to explain to you or to other people. It's his right and his privilege to label himself as he desires or not to be labeled at all.
Taking in consideration the hypersensitivity of a divided society that t-shirt was a mistake, but a non intentional one, because he admires Baldwin and it's crystal clear for people with faith in human nature that it was intended to be a tribute. Maybe by his mancurian origin and his american life, like other british and americans, he is constantly bombarded in the streets and the media with phrases like "white man", "latino woman", "black kid", etc. I noticed that seemingly good people who expresses in that way are completly unaware of how discriminating and out of place is referring to someone by a color, be it white, yellow or black, just by the tone of the skin. They are the victims, not the the haters who promotes the supremacy of a race to make business, like slavery or expopiation of other people's fortunes by the way of inventing things like arian race, jew land, black supremacy or any other fraud they could invent in the future and stupids could buy, all of them at the level of ingenuity and malignity of the infamous Ponzi scheme.
Human greed can produce big atrocities and absurdities in the shape of ideologies, "scientific truths" or other demoniacal things to make business. Like some manipulations in music business, for example, a topic Morrissey talked about in other times related to reverse discrimination, a kind of discrimintion that people who fees the monster of discrimination, and make a good living of it, say that it doesn't exist. Personally, that's the kind of Morrissey I like, the non-obvious one. The one who doesn't buy pre-packed ideas. I don't know if it still is the Morrissey he currently is or the one he wants to be from now on. It's his privilege and he already won more than our respect about his personal choices, the battles he wans to fight and his changes of opinion.