Why are some people such huge bigots, that they don't want to let Muslims practice their freedom of religion?

How can anyone seriously oppose the building of the Mosque near Ground Zero? It is a peaceful institution, and they have every right to build it under the protection of the first amendment.