When you realize that Frigga was one of the last people that Loki actually cared for. Her death broke his heart. A part of him blames himself for it as well. There's no going back for Loki. I predict that he will slowly go into madness in the next movie...heartbreaking. Tom did an amazing job capturing all of Loki's complexity on screen.