Stephen Colbert will succeed David Letterman as the host of "The Late Show," CBS announced on Thursday, one week after Letterman told his audience that he would retire sometime in 2015.