Unmanned vehicle consists of navigation system, obstacle detecting system, vision system, vehicle control system and arbiter system. In previous research, these systems are constituted individually and the arbiter system communicated with other system by TCP/IP and UDP. The development environment of all system is windows XP professional. However, the systems are constituted in real time environment in this research. In real time environment, the unmanned vehicle consists of Host, RT target and Obstacle detecting system. The RT target includes arbiter system, navigation system and vehicle control system. The obstacle detecting system uses both laser scanners and cameras and its data were integrated. The system's object has more swift and accurate response about time than a system developed in windows base. We used 3 PXIs which are an industrial computer as the Host, the RT target and the Obstacle detecting system. And we used Electronic vehicle as vehicle system and AC servo motors and some sensors for motion control of vehicle. In this paper, we propose the design of the real time controls system for lateral & longitudinal control of unmanned vehicle. In regard of this, chapter 2 explains comparison between a previous and new system and explains about system configuration. Chapter 3 explains a method of the vehicle control. Chapter 4 explains experiments and results. Finally, chapter 5 explains a conclusion