Infinite Scroll "Load More" will not go away on taxonomy view when pager is selected.

I hade one page view in the taxonomy view that was showing the Infinite scroll "load more" text when I had the mini pager enable.

Turn out there was a block that displayed nodes with the same vocabulary that was using infinite scroll.

I changed that to a pager and the "load more" went away and my pager on the page view displayed.  

The infinite scroll block was in a completely different view too! 

Weird but I'll take it.