Does it serve cache hits via a CDN, or do you provide all the bandwidth?
I hadn't thought of this before reading this thread, but a great service would be something like Varnish that's backed by some CDN instead of a big block of memory. That way, we can get great performance out of sites that are low on memory and bandwidth, like your low-end Linode or Slicehost.
That's a good description: Varnish + CDN (+ security). CloudFlare ends up making sites twice as fast and saving sites about 65% of their bandwidth. We run our own CDN with nodes scattered around the world.