Libertarian lawyer and college professor Jonathan Rowe agrees with Andrew Sullivan that Jews are a better analogy to gays than blacks. He argues that "although there certainly are similarities between blacks and gays, comparing the two in the context of a pro-gay argument often can be rhetorically ineffective."
And, quite interestingly, he notes:
Ironically, this notion that religious right posits - that gays aren't real minorities because they aren't economically impoverished - has strong leftist overtones. It was Mary Francis Berry who once infamously said, "Civil rights laws were not passed to protect the rights of white men and do not apply to them." ...
The conservative/libertarian view on the other hand thinks discrimination should be forbidden regardless of the economic status of the "group" in which a discriminated-against person is a member. . . . And that's because the conservative-libertarian view on this matter tends to be more individualistic as opposed to collectivistic. Sure whites and Asians as groups may be better off. But such discrimination occurs on an individual basis. And many whites and Asians who may be discriminated against are anything but economically privileged. The same thing can be said of gays.
Social conservatives are willing to veer left, it seems, if it serves to help inflame blacks against gays.
Update: Jonathan Rowe clarifies that
libertarians are likely to be opposed to public (governmental)
rather than private discrimination, but if there are going to be
such laws, they should be interpreted to apply equally to
all.