wow, pokemon amie is a lot more in depth than i thought

Espurr gets mad if you touch its ears, presumably because said ears shield potentially earth-crunching psychic power.

Also, quote from the Bulbapedia article on Amie:

"In addition, touching some Pokémon in certain spots may cause a special effect to the cursor. Negative effects usually freeze the cursor's position and make Pokémon less happy, while others are only aesthetic and are treated like normal rubbing. For some Pokémon, such as Slugma, the effect applies to their whole body and makes them impossible to successfully pet.

Freezing: The cursor becomes blue with a freezing sound, and freezes in place briefly. (Example: Touching the spike of a Bergmite.)

Burning: The cursor becomes red, with a sizzling sound effect, and freezes in place briefly. (Example: Touching a Slugma.)

Paralyzing: The cursor turns yellow with an electric sound, and freezes in place briefly. (Example: Touching the cheeks of a Pikachu.)

Cutting: The cursor becomes covered in bandages with a steel slicing sound effect, and freezes in place briefly. (Example: Touching the blade on a Pawniard's head.)

Gooey: The cursor turns slightly blue, slows down, and has a higher pitch than normal rubbing. (Example: Rubbing a Ditto.)

Haunted: Purely aesthetic, it turns the cursor more transparent. (Example: Touching the hair of a Gourgeist.)

Slimy: The cursor becomes significantly slower and looks like it's covered in sludge, making a wet sort of noise. (Example: Touching a Garbodor.)"