It gets worse – he isn't playing the day and night songs, he's playing the song of time. By the time he finishes they will be centuries into the future.

My head cannon has always been that Link is depressed cause he's left out of things. It always seemed like Link had to leave whenever people were celebrating or something (unless it was the end of the game)