Adventure window, Custom Combat tab at the bottom. Change the Action field to anything besides "attack with weapon". You must be using a KoL macro to handle combat. I suggest selecting "custom combat script" in that dropdown, and having your CCS be "abort" to make sure it never actually does anything (unless you want it to do more than that).