What are in your opinion the biggest social obstacles during a Time travel?

I’m not having in mind just the travel as such. I’m thinking of a long-termed stay in a distant past or future time.
Do you think you could live without all your relatives, friends, music, food, drinks and all other stuff that you’ve been used to? You could sure do so for a short period of time, but what if you had to stay there for very long? Maybe even to the end of your life?
This is a hypothetical question, just for fun. I’m asking it because I want to read some interesting approaches to it.
Thanks to every one who will answer it. :)