About the comment:
If you're using a regulator to decrease output voltage to voltage usable for charging 6 V battery, then you're already doing a significant part of design for the charger. Research a bit more and you'll be able to make your own charger and we want to avoid that because by the time you're able to do that you'll have to learn much more than a little bit
about electricity.
Also this solution suffers from the 6 V battery problems. I understand that the such solution may look nice because it works for your friend but actually its not. First read the datasheet for the battery. It's available on the link you posted. The fully charged battery has voltage of about 6.7 V and (using power levels we'll be using) has discharge voltage of around 5.3 V (which is above the USB specification). You can hope that it won't damage the GPS receiver but in my opinion you're making false savings fallacy. You'd be risking expensive piece of equipment for minor savings if you directly connect the battery.
If you don't directly connect the battery, you'll have to experiment with electronics.
Here again we have the problem with battery voltage. While the 6 V may look close to 5 V, it's actually pretty far away and I'll explain why: Voltage regulation circuity needs som voltage for itself to work. Here we have two ways of getting the 5 V: Using a switching regulator which can have a very low voltage drop and using a linear regulator which would have higher voltage drop.
If we go for the switching regulator we have two options: To make a switching regulator using classical components and that will be complicated because they in general require a bit more components than linear regulators or to get one of "drop-in replacement" switching regulators which already have all those components included but are more expensive and more rare.
The other option would be to use a linear regulator. It's pretty simple to use (you only need two capacitors and the regulator itself for the simplest option) but here we have problem with the dropout voltage. The most common regulators need around 2 V voltage above the voltage they're providing in order to work. We have just one (or in best case 1.5 V) so we won't be able to get the 5 V we need. The other option are low drop-out regulators which may be a simple solution if you can find a right one. Problem with them is that most of them can provide very low currents (lower than 500 mA we need) but there are some which may fit the needs. For example Microchip's TC1263 has dropout voltage of only 0.65 V at 500 mA and may work for you.
In order to get avoid this while mess I recommended use of a 12 V battery and a cigarette lighter to USB adapter which has all needed electronics included.