Editing Distributed memory (section)

{{short description |Multiprocessing memory architecture}}
{{Use British English |date=February 2024}}
{{Use dmy dates |date=February 2024}}
{{More citations needed |date=February 2024}}
[[Image:Distributed Memory.jpeg|right|300px|thumb|An illustration of a distributed memory system of three computers.]]
In [[computer science]], '''distributed memory''' refers to a [[Multiprocessing|multiprocessor computer system]] in which each [[Central processing unit|processor]] has its own private [[Computer memory|memory]].<ref name="pama21" /> Computational tasks can only operate on local data, and if remote data are required, the computational task must communicate with one or more remote processors. In contrast, a [[Shared memory architecture|shared memory]] multiprocessor offers a single memory space used by all processors. Processors do not have to be aware where data resides, except that there may be performance penalties, and that race conditions are to be avoided.

In a distributed memory system there is typically a processor, a memory, and some form of interconnection that allows programs on each processor to interact with each other. The interconnect can be organised with [[Network_topology#Point-to-point|point to point links]] or separate hardware can provide a switching network. The [[network topology]] is a key factor in determining how the multiprocessor machine [[Scalability|scales]]. The links between nodes can be implemented using some standard network protocol (for example [[Ethernet]]), using bespoke network links (used in for example the [[transputer]]), or using [[Dual-ported RAM|dual-ported memories]].