Real-time Metadata Extraction from UGC Video

Publication from Digital

Thaler M., Horti A., Hofmann A., Bailer W., Hofmeister W., Steiner J., Grandl R.

Chicago, IL, USA Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video (TVX), 6/2016


User generated content (UGC) is a valuable source for improving the coverage of events, such as concerts, festivals or sports events. When using UGC in live productions, content needs to be checked for quality, and metadata captured by the mobile device and extracted from the content are relevant for filtering the UGC streams. We demonstrate a system for capturing live audio and video streams on a mobile device, performing automatic metadata extraction in real-time and indexing the metadata for access by a production system. The system receives an audio, video and metadata stream from the mobile device, and creates additional metadata from the audiovisual content. All metadata are provided as a stream, indexed in a metadata store, and visualised
 in an HTML5-based user interface.