Lipofuscin is indigestible garbage that accumulates in the autophagic vesicles and cytosol of post-mitotic cells with age. Drs. Brunk and Terman postulated that lipofuscin accumulation is the main or at least a major driving factor in aging. They even posited that the evolution of memory is the reason why we get lipofuscin at all, as stable synaptic connections must be maintained over time, meaning that the somas of neurons must also remain in the same locale. In other words, they cannot dilute out their garbage over time through cell division. Mechanistically, their position certainly makes sense given that rendering a large percentage of a post-mitotic cell’s lysosomes useless must almost certainly negatively affect that cell and the surrounding microenvironment. Here, I explore the possibility that the accumulation of lipofuscin to some extent underlies all other categories of age-related damage as defined by Dr. Aubrey de Grey. I do not think that lipofuscin removal will reverse/prevent all forms of aging, just the major component facing us currently. In this piece, I will review what is known about lipofuscin accumulation from evolutionary and mechanistic standpoints and discuss ways of removing it from non-dividing (or slowly-dividing) cells.