The Self-Memory System (SMS) is a conceptual framework that emphasizes the interconnectedness of self and memory. Within this framework memory is viewed as the data base of the self. The self is conceived as a complex set of active goals and associated self-images, collectively referred to as the working self. The relationship between the working self and long-term memory is a reciprocal one in which autobiographical knowledge constrains what the self is, has been, and can be, whereas the working self-modulates access to long-term knowledge. Specific proposals concerning the role of episodic memories and autobiographical knowledge in the SMS, their function in defining the self, the neuroanatomical basis of the system, its development, relation to consciousness, and possible evolutionary history are considered with reference to current and new findings as well as to findings from the study of impaired autobiographical remembering.