Forms of Parallel Processing
Distributed computing: coarse-grained parallelism with relatively high communication cost (“cluster computing”)
Fine-grained parallel processing: massive parallelism, single-instruction-stream multiple-data-stream processing. (e.g., for in-camera image processing).
MIMD Multiprocessors with separate memories.
Parallel Random Access Machines (shared memory)
Multithreaded architectures (shared memory)