In this paper, a novel object contour tracking framework integrating independent multi-feature fusion object rough location and region-based temporal differencing model is proposed. In our model, the object rough location tracking is realized by color histogram and Harris corner features fusion method in particle filter framework. Thus it can achieve more robust tracking performance in many challenge scenes. And this particle filter framework is based on our previous CamShift guided particle filter [7]. With the rough object location, efficient region-based temporal differencing model is adopted for object contour detection, then this method is faster and more effective compared to active contour models or conventional global temporal differencing models. Moreover, exact contour tracking result can be used to guide the particle propagation of next frame, to enable more efficient particle redistributions and reducing particle degeneration. Experimental results demonstrate that this proposed method is simple but effective in object location and contour tracking.