Skip to content

MPEG 147

MPEG 147 took place in Sapporo from 2024-07-15 until 2024-07-19.

Press Release

MPEG ratifies Eight Edition of ISO Base Media File Format

At the 147th MPEG meeting, MPEG Systems (WG 3) promoted the 8th edition of ISO/IEC 14496-12 ISO base media file format (ISOBMFF) to Final Draft International Standard (FDIS), the final stage of standard development.

The ever-growing expansion of the ISO/IEC 14496-12 ISO base media file format (ISOBMFF) application area has continuously brought new technologies to the standards. During the last couple of years, MPEG Systems (WG 3) has received new technologies on ISOBMFF for more seamless support of ISO/IEC 23009 Dynamic Adaptive Streaming over HTTP (DASH) and ISO/IEC 23000-19 Common Media Application Format (CMAF) leading to the development of the 8th edition of ISO/IEC14496-12.

The new edition of the standard includes new technologies to explicitly indicate the set of tracks representing various versions of the media presentation of a single media for seamless switching and continuous presentation. Such technologies will enable more efficient processing of the ISOBMFF formatted files for DASH manifest or CMAF Fragments.

MPEG ratifies Syntactic Description Language

At the 147th MPEG meeting, MPEG Systems (WG 4) promoted ISO/IEC 14496-34 syntactic description language to Final Draft International Standard (FDIS), the final stage of standard development.

The Syntax Description Language (SDL) has been developed as part of ISO/IEC 14496-1 MPEG-4 Systems to define the syntax of various standards within MPEG-4 and beyond. To enable independent development of and the ability to reference SDL by other standards, MPEG started the development of ISO/IEC 14496-34 syntactic description language, which reached its final milestone at said meeting.

The new standard comes with various improvements, such as clarifications of parsable and non-parsable variable definitions and value coercion, among others. Finally, it includes various examples for a better understanding of the standard.

MPEG reaches First Milestone for Low-Overhead Image File Format

At the 147th MPEG meeting, MPEG Systems (WG 3) promoted Amendment 3 of ISO/IEC 23008-12 low-overhead image file format to Committee Draft Amendment (CDAM), marking the initial stage of standard development.

ISO/IEC 23008-12 image format specification defines generic structures for storing image items and sequences based on ISO/IEC 14496-12 ISO base media file format (ISOBMFF). As it allows the use of various high-performance video compression standards for a single image or a series of images, it has been adopted by the market quickly. However, it was challenging to use it for very small-sized images such as icons or emojis. While the initial design of the standard was versatile and useful for a wide range of applications, the size of headers becomes an overhead for applications with tiny images. Thus, Amendment 3 of ISO/IEC 23008-12 low-overhead image file format aims to address this use case by adding a new compact box for storing metadata instead of the ‘Meta’ box to lower the size of the overhead.

The standard is planned to be completed, i.e., to reach the status of Final Draft Amendment (FDAM), by the end of 2025.

MPEG ratifies Second Edition of Conformance and Reference Software for Compression of Neural Networks

At the 147th MPEG meeting, MPEG Video Coding (WG 4) promoted the 2nd edition of ISO/IEC 15938‑18 conformance and reference software for compression of neural networks to Final Draft International Standard (FDIS), the final stage of standard development.

An increasing number of artificial intelligence applications based on artificial neural networks, such as edge-based multimedia content processing, content-adaptive video post-processing filters, or federated training, need to exchange updates of neural networks (e.g., after training on additional data or fine-tuning to specific content). For this purpose, MPEG developed a second edition of the standard for coding of neural networks for multimedia content description and analysis (NNC, ISO/IEC 15938-17, published in 2024), adding syntax for differential coding of neural network parameters as well as new coding tools. Trained models can be compressed to at least 10-20% for several architectures, even below 3%, of their original size without performance loss. Higher compression rates are possible at moderate performance degradation. In a distributed training scenario, a model update after a training iteration can be represented at 1% or less of the base model size on average without sacrificing the classification performance of the neural network.

In order to facilitate the implementation of the standard, the accompanying standard ISO/IEC 15938-18 has been updated to cover the second edition of ISO/IEC 15938-17. This standard provides a reference software for encoding and decoding NNC bitstreams, as well as a set of conformance guidelines and reference bitstreams for testing of decoder implementations. The software covers the functionalities of both editions of the standard, and can be configured to test different combinations of coding tools specified by the standard.

MPEG reaches First Milestone for Third Edition of Reference Software and Conformance for the Internet of Media Things

At the 147th MPEG meeting, MPEG Coding of 3D Graphics and Haptics (WG 7) reached the Committee Draft (CD) stage of reference software and conformance for the Internet of Media Things (IoMT), the first stage of standard development.

This new edition comprises a comprehensive reference implementation of IoMT functionalities as specified in the MPEG series of Media Things-related standards, outlined across various parts of ISO/IEC 23093. These standards define data formats and APIs for Media Things, enabling robust integration into diverse applications and services. The software implementation features an extensive suite of Media Things, designed to facilitate the collaborative execution of complex artificial intelligence tasks within distributed environments. This standard targets a wide range of applications, such as crowd monitoring with distributed camera networks and forest fire prevention and surveillance. The advanced capabilities of IoMT will significantly enhance the efficiency and effectiveness of such operations, demonstrating the potential of Media Things in real-world scenarios.

Output documents published in MPEG 147

MPEG-I

#PartTitle
2Omnidirectional Media FormatTechnologies under Consideration for OMAF
3Versatile Video CodingUpdated text of ISO/IEC 23090-3:202x/CDAM1 Additions and corrections for VVC
4Immersive AudioText of ISO/IEC DIS 23090-4 MPEG-I immersive audio
6Immersive Media MetricsTechnologies under Consideration for ISO/IEC 23090-6 Immersive media metrics
7Immersive Media MetadataTechnologies under Consideration for Immersive Media Metadata
9Geometry-based Point Cloud CompressionG-PCC 2nd edition codec description
9Geometry-based Point Cloud CompressionPreliminary WD 8.0 of G-PCC 2nd Edition
10Carriage of Visual Volumetric Video-based Coding DataWD of ISO/IEC 23090-10 2nd edition Carriage of visual volumetric video-based coding data
10Carriage of Visual Volumetric Video-based Coding DataTechnologies under consideration for ISO/IEC 23090-10
12Immersive VideoSoftware manual of QMIV
12Immersive VideoCommon test conditions for MPEG immersive video
13Video Decoding Interface for Immersive MediaWD of ISO/IEC 23090-13 2nd edition Video Decoding Interface for Immersive Media
14Scene Description for MPEG MediaTechnologies under Considerations on Scene Descriptions
14Scene Description for MPEG MediaProcedures for standard development for ISO/IEC 23090-14 (MPEG-I Scene Description)
14Scene Description for MPEG MediaProcedures and Test Formats for Avatar Representation Formats as part of MPEG-I
17Reference Software and Conformance for OMAFWD of Reference software and conformance for omnidirectional media format (OMAF) 2nd edition
18Carriage of Geometry-based Point Cloud Compression DataWD of ISO/IEC 23090-18 AMD 2 Point reliability indication and other improvements
18Carriage of Geometry-based Point Cloud Compression DataTechnologies under Considerations on Carriage of geometry-based point cloud compression data
24Conformance and Reference Software for Scene Description for MPEG MediaWorking Draft of ISO/IEC 23090-24 AMD 1 Conformance and reference software for scene description on haptics, augmented reality, avatars, interactivity, MPEG-I audio and lighting
24Conformance and Reference Software for Scene Description for MPEG MediaProcedures for test scenarios and reference software development for MPEG-I Scene Description
29Video-based dynamic mesh codingV-DMC codec description
32Carriage of haptics dataPotential improvement of ISO/IEC DIS 23090-32 Carriage of haptics data
34Immersive audio reference softwareText of ISO/IEC DIS 23090-34 Immersive audio reference software
37Conformance and reference software for carriage of haptics dataWD of ISO/IEC 23090-37 Conformance and reference software for carriage of haptics data

MPEG-DASH

#PartTitle
1Media Presentation Description and Segment FormatsTechnologies under Consideration for DASH
7Delivery of CMAF content with DASHExploration on alignment of ISOBMFF/DASH/CMAF terminology, concepts and solutions

MPEG-H

#PartTitle
33D AudioText of ISO/IEC DIS 23008-3 3D audio, 4th edition
63D Audio Reference SoftwareText of ISO/IEC DIS 23008-6 3D audio reference software, 4th edition
12Image File FormatText of ISO/IEC 23008-12 3rd edition CDAM 3 Low-overhead image file format
12Image File FormatTechnology under Consideration on ISO/IEC 23008-12

MPEG-G

#PartTitle
MPEG-G Genomic Information Database

MPEG-4

#PartTitle
12ISO base Media File FormatWD of ISO/IEC 14496-12 8th edition AMD 2 Tools for enhanced CMAF and DASH integration
12ISO base Media File FormatTechnologies under Consideration for ISO/IEC 14496-12 (ISOBMFF)
14MP4 File FormatTechnologies under Consideration for ISO/IEC 14496-14
15Carriage of Network Abstraction Layer (NAL) Unit Structured Video in the ISO base Media File FormatWD of ISO/IEC 14496-15 7th edition AMD 2 Improvement of carriage of L-HEVC
15Carriage of Network Abstraction Layer (NAL) Unit Structured Video in the ISO base Media File FormatTechnologies under Consideration for ISO/IEC 14496-15
24Audio and Systems InteractionText of ISO/IEC DTR 14496-24 Audio and systems interaction, 2nd edition
32File Format ReferenceTechnologies under Consideration for ISO/IEC 14496-32
32File Format ReferenceDraft text of ISO/IEC FDIS 14496-32 2nd edition File format reference software and conformance
34Syntactic description languageTechnology under Consideration on ISO/IEC 14496-34 Syntactic Description Language
34Syntactic description languageExploration on alternative representation of syntax

MPEG-C

#PartTitle
7Versatile Supplemental Enhancement Information Messages for Coded Video BitstreamsUpdated Text of ISO/IEC 23002-7:202x/CDAM1 Additional SEI messages for VSEI
7Versatile Supplemental Enhancement Information Messages for Coded Video BitstreamsTechnologies under consideration for future extensions of VSEI (version 5)

MPEG-B

#PartTitle
7Common Encryption in ISO Base Media File Format FilesWD of ISO/IEC 23001-7:2023 AMD 1 AES-256 Support
7Common Encryption in ISO Base Media File Format FilesTechnologies under Consideration for ISO/IEC 23001-7
10Carriage of Timed Metadata Metrics of Media in ISO Base Media File FormatTechnologies under Consideration for ISO/IEC 23001-10 Carriage of timed metadata metrics of media in ISOBMFF
11Energy-Efficient Media Consumption (green metadata)Potential improvement of ISO/IEC 23001-11 DAM 2 Energy-efficient media consumption for new display power reduction metadata
16Derived Visual Tracks in the ISO Base Media File FormatTechnologies under Consideration for ISO/IEC 23001-16 derived visual tracks including further visual derivations
19Carriage of green metadataWD of ISO/IEC 23001-19 Carriage of green metadata

MPEG-A

#PartTitle
19Common Media Application Format (CMAF) for Segmented MediaWD of ISO/IEC 23000-19 3rd edition AMD 2 New Structural CMAF Brand Profile
22Multi-Image Application Format (MIAF)WD of ISO/IEC 23000-22 AMD 1 Implementation based technologies for MIAF
23Decentralized media rights application formatWorking Draft of ISO/IEC 23000-23 Decentralized media rights application format
24Messaging media application formatWorking Draft of ISO/IEC 23000-24 Messaging media application format

Explorations

#PartTitle
7Immersive VideoOverview of lenslet video coding activities
7Immersive VideoCommon test conditions of lenslet video coding
36Neural Network-based Video CompressionExploration experiment on neural network-based video coding (EE1)
36Neural Network-based Video CompressionDescription of algorithms version 8 and software version 10 in neural network-based video coding (NNVC)
41Enhanced compression beyond VVC capabilityExploration experiment on enhanced compression beyond VVC capability (EE2)
41Enhanced compression beyond VVC capabilityAlgorithm description of enhanced compression model 14 (ECM 14)
41Enhanced compression beyond VVC capabilityCall for new HDR test sequence materials for future video coding development
50Interactive testing for volumetric visual mediaReport on interactive subjective quality assessment test investigations for volumetric video

All

#PartTitle
Updated Call for Proposals for AI-based Point Cloud Coding

MPEG-AI

#PartTitle
2Video coding for machinesCommon test conditions for video coding for machines
3Optimization of encoders and receiving systems for machine analysis of coded video contentUpdated text of ISO/IEC CDTR 23888-3 Optimization of encoders and receiving systems for machine analysis of coded video content
4Feature coding for machinesCommon test and training conditions for FCM

Other documents published in MPEG 147

TypeTitle
AhGList of the AHGs established at the 16th SC 29/WG 03 Meeting (MPEG 147
AhGWG2 AHGs established at the 16th WG2 meeting (MPEG 147)
Work planMPEG Roadmap after the MPEG 147 meeting
Work planMPEG Roadmap after the MPEG 147 meeting (extended PPT)
Administrative MattersRequest for offers to host a MPEG meeting (MPEG 155 - MPEG 158)
Administrative MattersMeeting Notice of the 148th MPEG meeting including the 17th meeting of SC29/AG2,3,5, WG2,3,4,5,6,7,8