Ernie Accorsi, the former general manager of the New York Giants, passed away at the age of 84 on Saturday.