Multimedia Video Coding and Architectures
5LSE0 (2022)
Groups
Automotive, Healthcare, Surveillance, Animal care
Teachers
Peter H. N. de With, Yue Sun
Introduction
This course teaches the techniques for well-known video compression standards (Digital TV, MPEG, JPEG) and video analysis. Digital TV, MPEG-based DVD and BluRay disk players, and JPEG cameras are part of daily life. It is not only interesting and important to learn how the embedded video processing works, but these techniques and metrics are also re-applied in video analysis. This will be illustrated with analysis examples. Therefore, this course teaches techniques that the student can re-use in various forms of image processing, compression, and video analysis. The generic techniques learned are also applied in combination with Deep Learning and thus future-oriented as well.
This course will be delivered by oral teaching with slides, and about 40% of the hours are dedicated to computer exercises. A final grade is determined during an oral examination.
Goal
Learn the power of signal transformations
- For video compression, like as in transform coding
- For video analysis, like as in the Gabor wavelet transform
- For combining them with Deep Learning
Exploit the concept of “condensing information”
- This is useful for coding and compression
- But also applicable to video analysis: what is the key informative feature
- Use specific transformation for that, like the PCA
This course is divided in two parts
- Video compression using Discrete Cosine Transformation:
Learn the concept of entropy as information measure both for compression and video analysis - Analysis techniques, e.g. wavelet transform, for finding feature:
Expand the tool set of computer vision and for Deep Learning
Preknowledge
- 5XSA0 Introduction to medical image processing
- Basic theory knowledge of digital signal processing, filtering and stochastics is clearly recommended
- Basic programming skills with MATLAB
Slides
- Module 01A - Introduction
- Module 01B - Measure information
- Module 02A - Scalar Quantization
- Module 02B - Transformation Theory
- Module 03A - Adaptive Quantization and JPEG
- Module 03B - MPEG 1 & 2 standards
- Module 03C - MPEG 4 & AVC standards
- Module 04 - Wavelets and JPEG2000
- Module 06 - Hidden Markov models