Parallel Granularity

• Ration of computation to communication
• Coarse : Large computation between communication
• Fine : Small computation between communication