The New England Patriots quarterback has given his verdict on the injury that hindered his performance in Santa Clara