I recently started messing with tags in git and I found to my surprise that when I pushed from my laptop to github.com that they didn't automatically get pushed with my changes.

You need to take the additional step of pushing your tags using the following command.

git push --tags <remote>

If you're pushing to your origin you can ignore the <remote> part.