Cosby, the oldest of four boys, grew up in Philadelphia's Germantown neighborhood. At first, the Cosbys were able to get by, financially, but the family's money began to slip when Cosby's father, William Cosby Sr., began drinking heavily. After his father enlisted in the U.S. Navy, Cosby became like a parent to his brothers. Cosby's mother, Anna, worked cleaning houses. He and his family ended up living in the Richard Allen Homes, a low-income housing project in his neighborhood. At the age of 8, Cosby suffered a great loss when his brother James, the second oldest of the boys, died.