Segmentation is the process of identifying components of the image which involves operations such as boundary detection, connected component labeling, thresholding [6]. Boundary detection finds out edges in the image. Thresholding reduces the gray levels in the image. Various objects in the scene are classified through boundary formation whereas interested object can be diagnosed. This leads to differentiate foreground & background objects present in the same scene which is known as the process of foreground/background extraction. The foreground contains the objects of interest and background is all other objects present other than interested object of the same image. Feature Extraction is next key task in tracking video data is the detection and tracking of moving objects such as people and vehicles through the video frames. Features to be extracted depends upon specific applications, it can be shape of object, distance of object from a specified point etc. Analyzing the features extracted of object indicates its behavior which would help in the process of tracking.