Mmm, I think I see what's happening now. A familiar only appears in one place no matter what — in the favorite/recent list or in the full hierarchy or currently active. Appearing in any of those places removes it from all the others, which was confusing me; I was expecting the hierarchy to be...