The title of this episode, 'Because,' comes from a popular 1902 song composed by Edward Teschemacher (lyrics) and Guy d'Hardelot (music). It was popular to be sung at weddings.
Humanity-less Stefan would have not cared if Caroline wanted to burn her mother's letters and read it anyway.