Since than, around 4500 of them have returned to shore, but the UN estimates around 2000 others are still on the water.
Nearly 1000 have been taken to Myanmar's western Rakhine state, which borders Bangladesh, after being found by Myanmar's navy in two boats in the bay of Bengal.
Neither nation initially showed a willingness to accept them and rights groups are concerned some could be pushed to the wrong side of the border.