I think they might be referring to what some call the candybar form factor.

https://en.m.wikipedia.org/wiki/Form_factor_(mobile_phones)#...

Are you able to buy a reasonably modern version of these that comes with GPS?

Literally the only things I use my phone for is calls, SMS, GPS, and eeeeeeevery great once in a while I'll google something at the store.

I'd love something like this, but it would really have to have GPS on it.

No GPS, wifi or usable camera, but older phones have techniques for map location using the cell phone signal.

A candlestick telephone that you can connect with your smartphone:

http://iseedeadpixels.nl/?soho_portfolio=bluetooth-candlesti...

I'm guessing he's using a feature phone, aka non-smart phone.