Choi’s Optimizations

Schematic of Optimizations (using send/recv)

U*,* := ...

...

send(U)

recv(U)

send(V)

recv(V)

aux2*,* := ...

aux4*,* := ...

Remove Re-

dundant Comm

U*,* := ...

...

send(U)

recv(U)

send(V)

recv(V)

aux2*,* := ...

send(V)

recv(V)

aux4*,* := ...

Naive

U*,* := ...

...

send(U,V)

recv(U,V)

aux2*,* := ...

send(V)

recv(V)

aux4*,* := ...

Combine

U*,* := ...

...

send(U,V)

recv(U,V)

aux2*,* := ...

aux4*,* := ...

Pipeline

Previous slide

Next slide

Back to first slide

View graphic version