Mmm, I think I see what's happening now.  A familiar only appears in one place no matter what — in the favorite/recent list or in the full hierarchy or currently active.  Appearing in any of those places removes it from all the others, which was confusing me; I was expecting the hierarchy to be...