"I held him as he took his last breath and we will hold him forever in our hearts," she wrote via Instagram Friday.