Each PE is a full computer connected through a network. This architecture is also known as loosely coupled because the PEs are not tightly integrated as in shared memory architecture. As a PE can not directly access the memory of other PEs, it is called No Remote Memory Access (NORMA). PEs can communicate with the others through the communication network by message passing