MPP system is the collection of hundred or thousand of commodity processors interconnected by high speed and low latency communication network. The memory of the processors in MPP is distributed but the processors are synchronized by the blocking message passing operations. Each process has its own physical address space and communicates with the others through message passing primitives.