What Leaves Must Promise

A search root fans out to 100 leaf servers and waits for all of them. Leaf latencies are independent and identically distributed.

You want 99 percent of root requests to finish within 10 ms.

What must the leaf's own latency distribution guarantee?

A

The leaf's p99.9p_{99.9} must be 10 ms, which puts about 9 percent of root requests over budget.

B

The leaf's p99.99p_{99.99} must be 10 ms: solving p100≥0.99p^{100} \ge 0.99 gives p≥0.991/100≈0.99990p \ge 0.99^{1/100} \approx 0.99990. A leaf whose p99p_{99} is 10 ms leaves 1−0.99100≈63%1 - 0.99^{100} \approx 63% of root requests over budget.

C

The leaf's p99p_{99} must be 10 ms, because with independent identically distributed leaves the root inherits the leaf's percentile unchanged.

D

The leaf's p99p_{99} must be 0.1 ms, because the 10 ms budget is divided across the 100 leaves.