README.md

Parallel Computing

Wikipedia

Applications

• Big data
• Machine learning
• Extended reality
• Mathematics
• Physics
  • Molecular dynamics
  • Computational fluid dynamics
  • Structural mechanics
• Chemistry
  • Quantum chemistry
• Bioinformatics
• Weather modeling

Machine learning

Weight matrix product

• Data parallelism (split up the dataset)
• Model parallelism (split up the model parameters)

Pipelining

Instructions can be executed in other orderings than in the naive model.