For example, the schematic below shows a typical LLNL parallel computer cluster:
Each compute node is a multi-processor parallel computer in itself
Multiple compute nodes are networked together with an Infiniband network
Special purpose nodes, also multi-processor, are used for other purposes