Tehran has rejected request for Rafael Grossi to visit nuclear facilities bombed by Israel and US during conflict.