11th Programming and Tuning Massively Parallel Systems + Artificial Intelligence Summer School (PUMPS+AI 2021)
Some of the topics that will be covered during the course:
Deep Learning
High-level programming models (OpenACC, Python, and Mathematica on GPUs)
CUDA Algorithmic Optimization Strategies
Dealing with Sparse and Dynamic data
Efficiency in Large Data Traversal
Reducing Output Interference
Controlling Load Imbalance and Divergence
Acceleration of Collective Operations
Dynamic Parallelism and HyperQ
Debugging and Profiling CUDA Code
Multi-GPU Execution
Architecture Trends and Implications
Introduction to OmpSs and to the Paraver analysis tool
OmpSs: Leveraging GPU/CUDA Programming
Hands-on Labs: CUDA Optimizations on Scientific Codes; OmpSs Programming and Tuning
Organisers:
Barcelona Supercomputing Center (BSC)
University of Illinois at Urbana-Champaign (University of Illinois)
Universitat Politècnica de Catalunya (UPC)
HiPEAC Network of Excellence (HiPEAC)
PUMPS is part of this year’s PRACE Advanced Training Centre program
Keywords
CUDA, Parallel computing, GPU accelerators, Deep Learning, Programming models, OpenACC, Python, Mathematica, OmpSs