Our overall research thrust has been to develop robust and real-time vision algorithms for motion estimation, control and coordination of unmanned vehicles. We have developed algorithms, implemented real-time vision systems, and integrated them into the control loops of our fleet of UAVs and UGVs. By demonstrating vision-based control systems in challenging outdoor environments, we have taken a step toward the future of vision-based intelligent unmanned vehicles.