For those who need a clearer answer: you fix this by setting Action to Custom Combat Script, rather than attack (or dictionary or whatever).
I use autoattack set to a macro, and some of those macros NEVER use "attack with weapon", eg as Boris or Jarls.