The locality-aware scheduler focuses on the “rare resources” assignment.
The data nodes called rare resources contain some data, which
is relatively scarce; because the most part of data nodes, which own
required data, is occupied by some high priority tasks. In order to distinguish
the rare resources, the parameter Wðnj; Tdo
Þ is the major factor
to measure the rarity of a data node in the locality-aware scheduler.
A data node has aminimumvalue of Wðnj; Tdo
Þ which means that the
data node is not a rare resource, hence the scheduler can dispatch the
task to the data nodes for computing. The weight equation is described
as Eq. (1).