Media is the heartbeat of our digital age, shaping the way we connect, learn, and experience the world.

Leveraging cutting-edge deep learning and the vast prowess of Large Language Models, we’re at the forefront of innovation in video processing, video compression, video generation, 3D reconstruction, and multimodal media interactive.

Join our lab to revolutionize media tech, crafting a more connected, immersive, and interactive world.

@sjtu-medialab   @media_tech

Follow our Github for academic open source projects.
Follow our Wechat Official Account for the latest media technology progress.

Recent Posts

People-Ojbect Interaction Dataset
Introduction The people-object interaction dataset comprises 38 series of 30-view multi-person or single-person RGB-D video sequences, complemented by corresponding camera parameters, foreground masks, SMPL models and some point clouds, mesh files.
2024-01-28 2 min read
People-Ojbect Interaction Dataset
Job Wanted: Fundamental Model Design and Realization of 3D Digital Figures of Metaverse
Location: Electronic Department, Shanghai Jiao Tong University, 800 DongChuan Road, MinHang District, Shanghai, China Department: Institute of Image Communication and Network Engineering Forms of Work: Offline for candidates who are available and applicable to attend the job in Shanghai however also can be inline if the candidates cannot get to Institute under specified time or from overseas.
2022-12-08 2 min read
Free Viewpoint RGB-D Video Dataset
Introduction Our free viewpoint RGB-D video dataset is a dynamic, synchronous and close to practical RGB-D HD free viewpoint synthesis dataset. Our dataset consists of 14 groups of video sequences, including 13 groups of human motion video sequences such as dancing, playing basketball and playing football, and 1 group of empty scene video sequences, as shown below.
2022-02-16 2 min read
Free Viewpoint RGB-D Video Dataset
See all posts
"Adaptation Models" "Bit Rate" "CNN" "Computational Modeling" "Deep Learning" "Distortion" "Encoding" "Estimation" "Feature Extraction" "HEVC" "Interpolation" "Measurement" "Quality Assessment" "Standards" "Streaming Media" "Training" "Video Coding" "Video Recording" "Visualization" /Unread

Recent Publications

June 2024 IEEE Transactions on Broadcasting
EffiHDR: An Efficient Framework for HDRTV Reconstruction and Enhancement in UHD Systems
Cite DOI
January 2024 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2024, Toronto, on, Canada, June 19-21, 2024
A Priority Aware Free Viewpoint Video Transmit Scheme Based on QUIC
Cite DOI
January 2024 Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada
Depth-Guided Robust and Fast Point Cloud Fusion NeRF for Sparse Input Views
Cite DOI
January 2024 CoRR
Diff-Restorer: Unleashing Visual Prompts for Diffusion-Based Universal Image Restoration
Cite DOI
January 2024 CoRR
Efficient Dynamic-NeRF Based Volumetric Video Coding with Rate Distortion Optimization
Cite DOI
January 2024 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2024, Seoul, Republic of Korea, April 14-19, 2024
Hdrtvformer: Efficient Sdrtv-to-Hdrtv via Affine Transformation and Spatial-Aware Transformer
Cite DOI
January 2024 CoRR
HPC: Hierarchical Progressive Coding Framework for Volumetric Video
Cite DOI
January 2024 CoRR
JointRF: End-to-end Joint Optimization for Dynamic Neural Radiance Field Representation and Compression
Cite DOI
January 2024 CoRR
MRIR: Integrating Multimodal Insights for Diffusion-Based Realistic Image Restoration
Cite DOI
January 2024 CoRR
Multimodal Semantic-Aware Automatic Colorization with Diffusion Prior
Cite DOI
January 2024 The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024
Neural Rate Control for Learned Video Compression
Cite
January 2024 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2024, Toronto, on, Canada, June 19-21, 2024
No-Reference Quality Assessment of Text-to-Image Generation
Cite DOI
See all publications