Automatic Selection of Live User Generated Content

Publication from Digital

Wechtitsch S., Thaler M., Hofmann A., Horti A., Bailer W., HofmeisterW., Steiner J., Grandl R.

Proceedings of the 4th Workshop on Interactive Content Consumption (WSICC), 2016


User generated content (UGC) is a valuable source for improving the coverage of events such as concerts, festivals or sports events. Integrating UGC in existing professional production workflows is particularly challenging in live productions. UGC needs to be checked for quality in this case, and metadata captured by the mobile device and extracted from the content are relevant for filtering the UGC streams that go into a live production system. We propose a system for capturing live audio and video streams on a mobile device, performing automatic metadata extraction in real-time and indexing the metadata for access by a production system. The system receives an audio, video and metadata stream from the mobile device, and creates additional metadata from the ingested audiovisual content. The metadata (e.g., location, quality) are then used to automatically select and rank streams, either selecting a stream to show to a viewer or a list of streams from which a human operator can select.