What are merits and demerits of shared-memory vs distributed-memory parallelization models in HPC

Discussion Zone
1

What are the merits and demerits of shared-memory parallelization models vs distributed-memory parallelization models

2

Shared-memory are HPC systems that have both the data and instructions held in a unified location and can be retrieved by any processor. Hence, making programming and debugging easier. For distributed memory, multiple processors are present and each processor holds its own set of data and instructions. To access stored data in other processors, communication between the processors is required.

Here is a link to a great resource: Shared vs Distributed Memory Systems for HPC

3

I found a document that really helped me grasp the concept better and shed light on the pros and cons of shared-memory versus distributed-memory parallelization models. I thought it was insightful and informative, so I wanted to share it with you in case you or someone you know might find it beneficial too.

URL

1 Like
4

Thank you for sharing, it was really helpful.