Lecture 2: Parallel Computing and Parallel Programming

• Parallel Computational Models
  • SIMD Computation
  • MIMD Computation
  • SPMD Computation
• Behaviour of Parallel Computation
  • Concurrency
  • Synchronisation
  • Process Nets
  • Data Distribution
  • Process Placement
  • Load Balance
• Implicit Parallelism vs Explicit Parallelism
• Parallel Programming Models:
  • Shared Memory Parallel Programming Model
  • Message Passing Based Parallel Programming Model
  • Data Parallel Programming
  • Process Parallel Programming
  • SPMD Parallel Programming