Schwartz was born just outside Baltimore, Maryland and attended Mount Saint Joseph High School, an all-male Catholic school, where he played football. He then played for Georgetown University where he was the team captain.
In 2011, Schwartz led the Detroit Lions to the playoffs for the first time since 1999.