As if you had to ask whether or not he was worthy to lift the hammer.

I once read a short fic where every Avenger actually could lift Thor's hammer, but they decided not to do it to avoid hurting Thor's confidence.
And then they forgot to tell Vision about it.