I've noticed that if you have more than 1 character, and log in one after the other after handling adventures and business that the next character logged in does not attempt to loot the hermit. Has anyone else noticed this?