Nowadays, parallel architectures are not only used for high performance computing. The advent of multicore processors, which can be found in all modern laptops and desktops, has turned parallel architectures into the mainstream architecture for commodity computing. Correspondingly, parallel programming paradigm is becoming the predominant one in the main stream programming practice. The module introduces into parallel programming. It covers the following main topics: -Vector and superscalar processors: architecture and programming model, optimizing compilers (dependency analysis and code generation), array libraries (BLAS), parallel languages (Fortran 90, C[]). - Shared-memory multi-processors and multicores: architecture and programming models, optimizing compilers, thread libraries (Pthreads), parallel languages (OpenMP). - Distributed-memory multi-processors: architecture and programming model, performance models, message-passing libraries (MPI), parallel languages (HPF).
