Video is becoming the "biggest big data" as the most important and valuable source for insights and information.

Researches in our lab cover a broad range of topics on video signal. Inspired by state-of-the-art representation model like deep learning, and driven by modern biologically computational model for visual experience, we are working on better solution for video analysis, video processing and video compression. Specifically we are exploring each research topic from three aspects: algorithm, computation and data.


@sjtu-medialab   @media_tech

Follow our Github for academic open source projects.
Follow our Wechat Official Account for the latest media technology progress.

Recent Posts

Chinese HD Talking Face Database
2024.03 We are regret to announce that the collected talking videos will be withdrawed and cannot be used for model training anymore. The applicant and researchers who have already accessed to the dataset shall follow the agreement and avoid using, publishing, retransmiting, copying, reproducing or redistributing the dataset for both non-commercial research and educational purposes under any condition.
2024-01-29 5 min read
Chinese HD Talking Face Database
People-Ojbect Interaction Dataset
Introduction The people-object interaction dataset comprises 38 series of 30-view multi-person or single-person RGB-D video sequences, complemented by corresponding camera parameters, foreground masks, SMPL models and some point clouds, mesh files.
2024-01-28 2 min read
People-Ojbect Interaction Dataset
Free Viewpoint RGB-D Video Dataset
Introduction Our free viewpoint RGB-D video dataset is a dynamic, synchronous and close to practical RGB-D HD free viewpoint synthesis dataset. Our dataset consists of 14 groups of video sequences, including 13 groups of human motion video sequences such as dancing, playing basketball and playing football, and 1 group of empty scene video sequences, as shown below.
2022-02-16 2 min read
Free Viewpoint RGB-D Video Dataset
See all posts
"Adaptation models" "Bit rate" "CNN" "Computational modeling" "Deep learning" "Distortion" "Encoding" "Estimation" "feature extraction" "HEVC" "Interpolation" "Measurement" "Quality assessment" "Standards" "Streaming media" "Training" "Video coding" "Video recording" "Visualization" dataset

Recent Publications

January 2022 Computer Vision - ECCV 2022 - 17th European Conference, Tel Aviv, Israel, October 23-27, 2022, Proceedings, Part XVII
A Codec Information Assisted Framework for Efficient Compressed Video Super-Resolution
Cite DOI
January 2022 IEEE International Conference on Multimedia and Expo, ICME 2022, Taipei, Taiwan, July 18-22, 2022
Complexity-Oriented Per-Shot Video Coding Optimization
Cite DOI
January 2022 IEEE Trans. Circuits Syst. Video Technol.
Edge-Based Video Compression Texture Synthesis Using Generative Adversarial Network
Cite DOI
January 2022 IEEE International Conference on Multimedia and Expo, ICME 2022, Taipei, Taiwan, July 18-22, 2022
Generative Compression for Face Video: A Hybrid Scheme
Cite DOI
January 2022 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2022, Bilbao, Spain, June 15-17, 2022
Hiding Among Your Neighbors: Face Image Privacy Protection with Differential Private k-Anonymity
Cite DOI
January 2022 Neurocomputing
IdentityDP: Differential Private Identification Protection for Face Images
Cite DOI
January 2022 Neurocomputing
L0 Structure-Prior Assisted Blur-Intensity Aware Efficient Video Deblurring
Cite DOI
January 2022 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2022, Virtual and Singapore, 23-27 May 2022
Low-Complexity Multi-Model CNN in-Loop Filter for AVS3
Cite DOI
January 2022 MM ‘22: The 30th ACM International Conference on Multimedia, Lisboa, Portugal, October 10 - 14, 2022
Multi-Scale Coarse-to-Fine Transformer for Frame Interpolation
Cite DOI
January 2022 CoRR
PTSEFormer: Progressive Temporal-Spatial Enhanced TransFormer Towards Video Object Detection
Cite DOI
January 2022 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2022, Bilbao, Spain, June 15-17, 2022
Reinforcement Learning Based Cross-Layer Congestion Control for Real-Time Communication
Cite DOI
January 2022 IEEE Trans. Broadcast.
Ultra-Low Latency, Stable, and Scalable Video Transmission for Free-Viewpoint Video Services
Cite DOI
See all publications