This is interesting. I never really thought about the psychological or philosophical self so I've done a little research and found this is a very complicated topic. "The self has many facets that help make up integral parts of it, such as self-awareness, self-esteem, self-knowledge, and self-perception."
So, I guess the "self" could be broken down into many categories. William James said "the self is composed of our thoughts & beliefs about ourself. " I guess it also includes our memories and how we interpret these memories. Our experiences certainly shape our sense of self. Our self-esteem which is "our overall emotional evaluation of our own worth." "Self-esteem encompasses beliefs (for example, "I am competent," "I am worthy") and emotions such as triumph, despair, pride and shame."
Our sense of self can and will change over time. You could be extremely depressed and view the world and view your experiences in an unrealistically negative way. You could meet a beautiful lover or get a promotion, and get an elevation in mood and a boost in self-esteem. Your sense of self could be unrealistic: You may think of yourself as smarter or dumber than you actually are. Our memories & perceptions are often unreliable. I think the biggest component of self is how you perceive and interpret your memories, & the happenings in the physical world around you.
Your experiences through-out life could subconsciously be dramatically effecting your sense of self. e.g. Were you abused as a child, or did you grow up in a nurturing environment.
“Probably the best account of the origins of selfhood is that the self comes into being at the interface between the inner biological processes of the human body and the sociocultural network to which the person belongs.”