I'm looking for a GPS device that will track my hikes. There is a lot of federal land around where I live and I would like to go on day trips out into the woods to take photos, but I'm terrified of getting lost as there aren't any signage or really any marked trails. But after doing some googling, I can't seem to figure out what the feature would be called or what to look for.

I'd like to have the GPS remember my path and record my position at intervals, so if I get turned around I can retrace my steps. Can anyone tell me what I'm looking for or even better give me some device recommendations.