From the course: Parallel and Concurrent Programming with Java 1

Unlock the full course today

Join today to access over 22,500 courses taught by industry experts or purchase this course individually.

Shared vs. distributed memory

Shared vs. distributed memory - Java Tutorial

From the course: Parallel and Concurrent Programming with Java 1

Start my 1-month free trial

Shared vs. distributed memory

- In addition to a parallel computer's architecture which can be categorized using Flynn's taxonomy, another aspect to consider is, ugh. (snapping finger) - Memory. It's important to understand how the memory is organized, and how the computer accesses data. - Right, you could put a billion processors in a computer but if they can access memory fast enough to get the instructions and data they need, then you won't gain anything from having all those processors. Computer memory usually operates at a much slower speed than processors do and when one processor is reading or writing to memory, that often prevents any other processors from accessing that same memory element. There are two main memory architectures that exist for parallel computing, shared memory and distributed memory. In a shared memory system, all processors have access to the same memory as part of a global address space. Although each processor operates independently, if one processor changes a memory location, all of…

Contents