In order to support the execution of a programming
paradigm as MapReduce, that needs large amounts of data
to process, new distribution techniques need to be employed.
freeCycles is a VC platform, compatible with BOINC,
that enables the deployment of MapReduce applications.
It is based on the SCOLARS system that, besides supporting
MapReduce jobs, also enables inter-client transfers.
freeCycles goes one step further by allowing clients to help
distributing the input, intermediate output, and final output
data (through the BitTorrent1 protocol and not pointto-
point). Since task replication is always needed to prevent
stragglers from delaying the whole computation and to detect
false results, multiple clients will need the same input
and will produce the same output. Thereby, multiple clients
can send in parallel multiple parts of the same file to other
clients or to the central server. freeCycles will, therefore,
benefit from clients’ network bandwidth to distribute data to
other clients or even to the central server.
In order to support the execution of a programming
paradigm as MapReduce, that needs large amounts of data
to process, new distribution techniques need to be employed.
freeCycles is a VC platform, compatible with BOINC,
that enables the deployment of MapReduce applications.
It is based on the SCOLARS system that, besides supporting
MapReduce jobs, also enables inter-client transfers.
freeCycles goes one step further by allowing clients to help
distributing the input, intermediate output, and final output
data (through the BitTorrent1 protocol and not pointto-
point). Since task replication is always needed to prevent
stragglers from delaying the whole computation and to detect
false results, multiple clients will need the same input
and will produce the same output. Thereby, multiple clients
can send in parallel multiple parts of the same file to other
clients or to the central server. freeCycles will, therefore,
benefit from clients’ network bandwidth to distribute data to
other clients or even to the central server.
การแปล กรุณารอสักครู่..
