"Whether or not a massive ballroom should be constructed is for Congress to decide," the appeals panel's majority said.