In this paper, we propose a temporal dependent bit allocation scheme for rate control in state-of-the-art High Efficiency Video Coding (HEVC) standard, to improve its coding performance by utilizing the temporal correlation information. In typical rate control scheme, the bit is allocated to different Coding Tree Units (CTUs) according to their complexity, which reflect their texture and motion information in some degree. However, this scheme ignores the temporal correlation between different frames, which leads to the bit allocation is not the optimal for the whole sequence. Therefore, we refine the bit allocation by taking into account temporal information, especially different coding units’ distortion influence on the future frames. The result shows that under the same rate control performance, proposed scheme can effectively improve the coding quality performance, especially the Structure Similarity (SSIM) quality performance, the subjective assesment also shows very well.