Our basic civil rights pre-date the constitution and are not dependent on what anyone, majority or vocal minority, deems a necessity.
By this standard, no one needs to be, say, a Wiccan when we have all these other religions to choose from, so the religion should be banned.
No one needs to burn a flag or display an image of crucifix in a jar of urine, so these should be banned.
You can still eat lunch at a segregated lunch counter. You can still drink water from a segregated water fountain. You can still learn at a segregated school. No problem with these – unban them.
And on, and on, and on.