MPEG (Moving Picture Experts Group) is a joint working group of ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission), which deals with the standardization of video compression and related fields, such as audio data compression, container formats and metadata of multimedia content.
DI (FH) Werner Bailer from DIGITAL - the Institute for Information and Communication Technologies - co-chairs the group on compressing neural networks for the description and analysis of multimedia content.
In this standardization activity, proposed technologies for the efficient storage, transmission and use of trained neural networks are currently evaluated to enable energy-efficient applications on low power devices. The working group completed a first working draft of the standard and a first test model at this meeting.
Applications such as the audiovisual content analysis tools based on neural networks developed by DIGITAL, for example, to detect objects, faces and actions, will benefit from the resulting standard.
DIGITAL has also contributed their expertise to the standardization process of MPEG-I.
MPEG-I is a set of standards for immersive media (e.g., 360° videos). As a partner in the Horizon 2020 project "Hyper360", DIGITAL works on developing tools for the production of live 360° videos.
At the meeting, a workshop related to the MPEG-I activities took place. MPEG-I covers among others the following areas.
- video coding for "3DoF + (extension of 3 Degrees of Freedom)", allowing viewers to move around the center position in 360 ° video, with a proper representation of depth information and parallax
- technologies for coding dense and sparse point clouds
- interactive spatial audio
- new version of the omnidirectional media format (OMAF)
- framework for network-based media processing (NBMP)