He didn't recognize him, because his yaday (hands) were shaiyar (hairy), like his ach (brother/kinsman), Ishaw (Esau's) yaday (hands). So he barak (blessed) him.