The attack came at a time of heightened tensions following a spate of Israeli settler attacks and the deadly shooting of a Palestinian baby over the weekend in the nearby West Bank