Basically A Good Idea
Use parallelism to cover latency
J.T. Schwartz example:
- Find maximum of P numbers
- O(log P) using Ladner/Fischer algorithm
- With nothing else to do ... wait for answer
- Find P maxima of P sets of P numbers
- O(log P) for each, but interleaved O(log P) for all
- Time to perform each maximum is a constant