A new study has found that demand for jobs could be just as important as skill level in how people feel about immigration.