On Work Views and other pages, when I use the Group By function, the item count on the upper right hand corner changes.
That is correct, the item count indicates how many work items are on the current page (not total work items on all pages). This is working as designed.