Media is the heartbeat of our digital age, shaping the way we connect, learn, and experience the world.

Leveraging cutting-edge deep learning and the vast prowess of Large Language Models, we’re at the forefront of innovation in video processing, video compression, video generation, 3D reconstruction, and multimodal media interactive.

Join our lab to revolutionize media tech, crafting a more connected, immersive, and interactive world.

@sjtu-medialab   @media_tech

Follow our Github for academic open source projects.
Follow our Wechat Official Account for the latest media technology progress.

Recent Posts

Chinese HD Talking Face Database
2024.03 We are regret to announce that the collected talking videos will be withdrawed and cannot be used for model training anymore. The applicant and researchers who have already accessed to the dataset shall follow the agreement and avoid using, publishing, retransmiting, copying, reproducing or redistributing the dataset for both non-commercial research and educational purposes under any condition.
2024-01-29 5 min read
Chinese HD Talking Face Database
People-Ojbect Interaction Dataset
Introduction The people-object interaction dataset comprises 38 series of 30-view multi-person or single-person RGB-D video sequences, complemented by corresponding camera parameters, foreground masks, SMPL models and some point clouds, mesh files.
2024-01-28 2 min read
People-Ojbect Interaction Dataset
Job Wanted: Fundamental Model Design and Realization of 3D Digital Figures of Metaverse
Location: Electronic Department, Shanghai Jiao Tong University, 800 DongChuan Road, MinHang District, Shanghai, China Department: Institute of Image Communication and Network Engineering Forms of Work: Offline for candidates who are available and applicable to attend the job in Shanghai however also can be inline if the candidates cannot get to Institute under specified time or from overseas.
2022-12-08 2 min read
See all posts
"Adaptation models" "Bit rate" "CNN" "Computational modeling" "Deep learning" "Distortion" "Encoding" "Estimation" "feature extraction" "HEVC" "Interpolation" "Measurement" "Quality assessment" "Standards" "Streaming media" "Training" "Video coding" "Video recording" "Visualization" dataset

Recent Publications

January 2022 Computer Vision - ECCV 2022 - 17th European Conference, Tel Aviv, Israel, October 23-27, 2022, Proceedings, Part XVII
A Codec Information Assisted Framework for Efficient Compressed Video Super-Resolution
Cite DOI
January 2022 IEEE International Conference on Multimedia and Expo, ICME 2022, Taipei, Taiwan, July 18-22, 2022
Complexity-Oriented Per-Shot Video Coding Optimization
Cite DOI
January 2022 IEEE Trans. Circuits Syst. Video Technol.
Edge-Based Video Compression Texture Synthesis Using Generative Adversarial Network
Cite DOI
January 2022 IEEE International Conference on Multimedia and Expo, ICME 2022, Taipei, Taiwan, July 18-22, 2022
Generative Compression for Face Video: A Hybrid Scheme
Cite DOI
January 2022 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2022, Bilbao, Spain, June 15-17, 2022
Hiding Among Your Neighbors: Face Image Privacy Protection with Differential Private k-Anonymity
Cite DOI
January 2022 Neurocomputing
IdentityDP: Differential Private Identification Protection for Face Images
Cite DOI
January 2022 Neurocomputing
L0 Structure-Prior Assisted Blur-Intensity Aware Efficient Video Deblurring
Cite DOI
January 2022 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2022, Virtual and Singapore, 23-27 May 2022
Low-Complexity Multi-Model CNN in-Loop Filter for AVS3
Cite DOI
January 2022 MM ‘22: The 30th ACM International Conference on Multimedia, Lisboa, Portugal, October 10 - 14, 2022
Multi-Scale Coarse-to-Fine Transformer for Frame Interpolation
Cite DOI
January 2022 CoRR
PTSEFormer: Progressive Temporal-Spatial Enhanced TransFormer Towards Video Object Detection
Cite DOI
January 2022 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2022, Bilbao, Spain, June 15-17, 2022
Reinforcement Learning Based Cross-Layer Congestion Control for Real-Time Communication
Cite DOI
January 2022 IEEE Trans. Broadcast.
Ultra-Low Latency, Stable, and Scalable Video Transmission for Free-Viewpoint Video Services
Cite DOI
See all publications