Latency

I’m going to tell you a sad story in 4 sentences.

This story is as old as a startup world.

  1. You write a little app with one redis as kv store, and everything works fine.
  2. You blink
  3. … and you now have 10.
  4. …. And you access them all sequentially, one-by-one on every request.

So let’s talk about how do we measure latency, why sequential calls are not great, and what we can do about it.