When the pager does not show up on your Drupal 9 View or doesn't appear on any page other than the first page. (Page 1)

Ran into this issue and the simple answer wasn't too easy to find.

GO into you view

Go to the "PAGER" section (in the middle)

 

Click the pager settings (Paged, 10 Items)

Change the "Pager ID' to a higher number. I had to keep going until I found a pager ID that worked. 27 was the lucky number for me.

 
That should fix your pager. :)  It has to do with the caching or something.
 
This is an image and not a real pager LOL