He was also originally supposed to stay in the film longer, but apparently he hated it so much that he got them to shorten his stay.

I think it was more that he disliked being exclusively associated with Obi-Wan instead of the other characters that he played than actually hating Star Wars. But I do believe that he wanted to distance himself from the film afterward.