“It was a pretty brief conversation. We all expressed our disappointment” says show’s star Titus Welliver.