Indeed, many poor people are not employed or are employed in the informal sector where minimum wages are not binding.
Also, poor people often have limited skills and low productivity and thus tend to be among the first to be laid off when wages increase in line with the legislation.