The neighborhood is going to be against my zoning variance. Is it even worth it?

That depends. Generally speaking, there are several ways to deal with a community group who will be against your proposal and STILL secure your variance.