ºÝºÝߣ

ºÝºÝߣShare a Scribd company logo

InVID at the IPTC Autumn Meeting 2016

•
•
InVID Project
InVID Project

Rolf Fricke from Condat AG, a member of the InVID consortium, presented the InVID applications and standards for UGC verification at the Video Day of the IPTC Autumn Meeting 2016 that was held at the DPA Headquarters in Berlin, on 25 October 2016.

1 of 18
Download to read offline
www.invid-project.eu In Video Veritas – Verification of Social Media Video Content for the News Industry Rolf Fricke, Condat AG IPTC Workshop 24. Oct 2016
2 Rolf Fricke Head of R&D Alt-Moabit 91 d 10559 Berlin www.condat.de Mobility Portals Condat AG Business Lines TV / Media © Condat AG
3 Laufzeit: 1/2016 - 12/2018 9 Partner: Funding: R&D Project InVID - In Video Veritas, Verification of Social Media Video Content for the News Industry Funded by EU H2020 under project nr ICT-2015-687786
4 Using UGC for Media Production PublishingCatastrophy, Accident … Social Networks TV / Media Editor Eyewitness Upload  Verification of  Source  Validate Author  Forensic  Near Duplicate  Location  Time  Rights / Cost Retrieval
5 System Structure
6 Domain Standards Platform HTTP REST JSon with Java/JavaScript Ajax Binding URI, URN HbbTV TV Program Data DVB metadata model EBU metadata model ARD BMF BBC Programmes ontology TV anytime EU Screen IPTC W3C ontology for Media Resources Metadata Working Group's Guidelines COMM Meta Data RDF OWL Media Fragments URI 1.0 WebSRT DC (Dublin Core) CIDOC/CRM EDM (Europeana Data Model) FOAF (Friend of a Friend) SIOC Mpeg7, Mpeg47 Schema.org UI HTML, HTML5, CE-HTML, XHTML Ajax, YAML SMIL Content XML, XSLT, XACML UTF8 Sparql Endpoint Joseki, Open Search AV-Format Mpeg4, Mpeg2 Standards used in InVid Standards and Meta data are very relevant, because we • extract meta data from news items or videos • for retrieval in (youtube …) or • comparison with other videos Question: What meta data are • defined • provided • what is the semantics ?
7 Annova Openmedia Octopus Dalet ENPS Avid iNEWS Ross Video Inception AQ broadcast … Newsroom, Programm Planning Systems topics, keywords … playlist (permanent update) InVid Application MOS Protocol InVid Verification Service • Retrieve UGV • Invoke InVid & Standard Tools • UGC • Validation State …. InVid Application Standards  Newsroom and Programm Planning Integration  Standards: NewsML, EventsML, TV-Anytime, Mpeg7, MOS–Protocol  Extract: Author, Title, Time, Location ….
8 Verify Original – Get youtube metadata Videos: Place: Homs, Time: 12.11.2011 – 14.11.2011 Verified: Assess results Verify Original Start Result Values Accept Youtube metadata Date: 1.07.2011 Time: 12.23 Place: 34.502°N 36.402°E √ Near Duplicate Search show potential duplicates √ Validate Tampering show suspicous frames √ Validate Cloning State Original Remark Author Place Homs, Syria 34.520° N, 36.405° E Time Environment Reason Verification Values Comments https: //youtube/watch?v=ZZQlD0X4Jbw1 J.K. Miller, Spain, Barcelona 01.07.2011 InVID Verification Application Youtube - Metadata Standards  Video Meta Data from: Youtube, Twitter, Periscope …  Task: extracting Time, Location, Title, Author ….  Standards: URL, EXIF, Mpeg7, TV-Anytime, Dublin Core / EBU Core, EBU P/Meta, W3C Ontology for Media Resources, Media Anotations, Timed Text
9 Verification Source / Author Demonstration Damaskus, Syria Source: Freedom House, 18. April 2012, CC BY 2.0 • Recherche via Search Engines, in Social Networks, Amnesty ... • Other activities of author • Contact via eMail, phone … • Recherche via Search Engines, in Social Networks, Amnesty ... • Other activities of author • Contact via eMail, phone … Standards  Author / Owner: Dublin Core, EBU Core, W3C Internationalization …  Challenge: different spelling caused by translation of names and locations from arabic into English, German …  Need: improved tools to validate identity of persons
10 Verification of Location Analysis • Street Names • Licence Plates • Clothes • Speech in Videos • … Analysis • Street Names • Licence Plates • Clothes • Speech in Videos • … Place indicated by AuthorsPlace indicated by Authors
11 Identification via Google/Bing Maps / Street Maps Identification via Google/Bing Maps / Street Maps Verification of Location Standards  Location Standard: Geo Location Coordinates  Challenge: Mapping of Cities, Regions, and other terms onto Coordinates  Need: better tool support for mappings
12 Verification of Time Tools • Picture / Video Meta Data in Exif, IPTC, XMP Format • Analysis of Shadows • Weather data history Tools • Picture / Video Meta Data in Exif, IPTC, XMP Format • Analysis of Shadows • Weather data history ….. Standards  Time / Interval Standard: UTZ interval  Challenge: Mapping of textual indications onto times or intervals: begin of march, new years day, early summer …  Need: better tool support for mappings
13 Show UGC around focussed event Twitter Reports / Wires: Demonstration, Damaskus Facebook, Blogs … Pictures, Videos: Youtube, Flickr, Instagram, … Topic: Demonstration Place: Damascus, Abdullah Ibn Rawahna Time: 1.7.2011 – 31.07.2011 Zoom in / out for Place and Time
14 Forensic Tools Fake Original
15 Fake ? Detection of Clones by statistical Methods Detection of Clones by statistical Methods Quelle: Exo Makina, 2015, France Forensic Tools
16 Videos / Picture Fragments of former Events Videos / Picture Fragments of former Events Near Duplicate Search Standards  Near Duplicate / Forensic: Video Coding and Compression standards: MP4, AVI, H261 …  Challenges: Fragments, re-size, polishing by tools  Standards from W3C: Media Fragments URI 1.0
17  informed consent of author  telefone / eMail agreement  Acknoledge source and agree on financial issues  protect authors in crises regions  Respect data regulations regarding personal data  in sozial Networks and  sensible personal data (Religion, Sex, diseases ...) Rights / Costs Standards  RightsML, RightsOntology (http://dmag.ac.upc.edu/ontologies/ipronto/)  Challenge:  source unknown  rights for publication undefined  many individually defined written rights Measure: contact source
18  European Journalism Centre - Verification Handbook http://verificationhandbook.com  Amnesty – Step by Step Guide to Assess Citizen Video http://citizenevidence.org  http://lab.witness.org/  www.investigativ.ch  http://researchclinic.net  http://www.investigativerecherche.de References

More Related Content

InVID at the IPTC Autumn Meeting 2016

  • 1. www.invid-project.eu In Video Veritas – Verification of Social Media Video Content for the News Industry Rolf Fricke, Condat AG IPTC Workshop 24. Oct 2016
  • 2. 2 Rolf Fricke Head of R&D Alt-Moabit 91 d 10559 Berlin www.condat.de Mobility Portals Condat AG Business Lines TV / Media © Condat AG
  • 3. 3 Laufzeit: 1/2016 - 12/2018 9 Partner: Funding: R&D Project InVID - In Video Veritas, Verification of Social Media Video Content for the News Industry Funded by EU H2020 under project nr ICT-2015-687786
  • 4. 4 Using UGC for Media Production PublishingCatastrophy, Accident … Social Networks TV / Media Editor Eyewitness Upload  Verification of  Source  Validate Author  Forensic  Near Duplicate  Location  Time  Rights / Cost Retrieval
  • 6. 6 Domain Standards Platform HTTP REST JSon with Java/JavaScript Ajax Binding URI, URN HbbTV TV Program Data DVB metadata model EBU metadata model ARD BMF BBC Programmes ontology TV anytime EU Screen IPTC W3C ontology for Media Resources Metadata Working Group's Guidelines COMM Meta Data RDF OWL Media Fragments URI 1.0 WebSRT DC (Dublin Core) CIDOC/CRM EDM (Europeana Data Model) FOAF (Friend of a Friend) SIOC Mpeg7, Mpeg47 Schema.org UI HTML, HTML5, CE-HTML, XHTML Ajax, YAML SMIL Content XML, XSLT, XACML UTF8 Sparql Endpoint Joseki, Open Search AV-Format Mpeg4, Mpeg2 Standards used in InVid Standards and Meta data are very relevant, because we • extract meta data from news items or videos • for retrieval in (youtube …) or • comparison with other videos Question: What meta data are • defined • provided • what is the semantics ?
  • 7. 7 Annova Openmedia Octopus Dalet ENPS Avid iNEWS Ross Video Inception AQ broadcast … Newsroom, Programm Planning Systems topics, keywords … playlist (permanent update) InVid Application MOS Protocol InVid Verification Service • Retrieve UGV • Invoke InVid & Standard Tools • UGC • Validation State …. InVid Application Standards  Newsroom and Programm Planning Integration  Standards: NewsML, EventsML, TV-Anytime, Mpeg7, MOS–Protocol  Extract: Author, Title, Time, Location ….
  • 8. 8 Verify Original – Get youtube metadata Videos: Place: Homs, Time: 12.11.2011 – 14.11.2011 Verified: Assess results Verify Original Start Result Values Accept Youtube metadata Date: 1.07.2011 Time: 12.23 Place: 34.502°N 36.402°E √ Near Duplicate Search show potential duplicates √ Validate Tampering show suspicous frames √ Validate Cloning State Original Remark Author Place Homs, Syria 34.520° N, 36.405° E Time Environment Reason Verification Values Comments https: //youtube/watch?v=ZZQlD0X4Jbw1 J.K. Miller, Spain, Barcelona 01.07.2011 InVID Verification Application Youtube - Metadata Standards  Video Meta Data from: Youtube, Twitter, Periscope …  Task: extracting Time, Location, Title, Author ….  Standards: URL, EXIF, Mpeg7, TV-Anytime, Dublin Core / EBU Core, EBU P/Meta, W3C Ontology for Media Resources, Media Anotations, Timed Text
  • 9. 9 Verification Source / Author Demonstration Damaskus, Syria Source: Freedom House, 18. April 2012, CC BY 2.0 • Recherche via Search Engines, in Social Networks, Amnesty ... • Other activities of author • Contact via eMail, phone … • Recherche via Search Engines, in Social Networks, Amnesty ... • Other activities of author • Contact via eMail, phone … Standards  Author / Owner: Dublin Core, EBU Core, W3C Internationalization …  Challenge: different spelling caused by translation of names and locations from arabic into English, German …  Need: improved tools to validate identity of persons
  • 10. 10 Verification of Location Analysis • Street Names • Licence Plates • Clothes • Speech in Videos • … Analysis • Street Names • Licence Plates • Clothes • Speech in Videos • … Place indicated by AuthorsPlace indicated by Authors
  • 11. 11 Identification via Google/Bing Maps / Street Maps Identification via Google/Bing Maps / Street Maps Verification of Location Standards  Location Standard: Geo Location Coordinates  Challenge: Mapping of Cities, Regions, and other terms onto Coordinates  Need: better tool support for mappings
  • 12. 12 Verification of Time Tools • Picture / Video Meta Data in Exif, IPTC, XMP Format • Analysis of Shadows • Weather data history Tools • Picture / Video Meta Data in Exif, IPTC, XMP Format • Analysis of Shadows • Weather data history ….. Standards  Time / Interval Standard: UTZ interval  Challenge: Mapping of textual indications onto times or intervals: begin of march, new years day, early summer …  Need: better tool support for mappings
  • 13. 13 Show UGC around focussed event Twitter Reports / Wires: Demonstration, Damaskus Facebook, Blogs … Pictures, Videos: Youtube, Flickr, Instagram, … Topic: Demonstration Place: Damascus, Abdullah Ibn Rawahna Time: 1.7.2011 – 31.07.2011 Zoom in / out for Place and Time
  • 15. 15 Fake ? Detection of Clones by statistical Methods Detection of Clones by statistical Methods Quelle: Exo Makina, 2015, France Forensic Tools
  • 16. 16 Videos / Picture Fragments of former Events Videos / Picture Fragments of former Events Near Duplicate Search Standards  Near Duplicate / Forensic: Video Coding and Compression standards: MP4, AVI, H261 …  Challenges: Fragments, re-size, polishing by tools  Standards from W3C: Media Fragments URI 1.0
  • 17. 17  informed consent of author  telefone / eMail agreement  Acknoledge source and agree on financial issues  protect authors in crises regions  Respect data regulations regarding personal data  in sozial Networks and  sensible personal data (Religion, Sex, diseases ...) Rights / Costs Standards  RightsML, RightsOntology (http://dmag.ac.upc.edu/ontologies/ipronto/)  Challenge:  source unknown  rights for publication undefined  many individually defined written rights Measure: contact source
  • 18. 18  European Journalism Centre - Verification Handbook http://verificationhandbook.com  Amnesty – Step by Step Guide to Assess Citizen Video http://citizenevidence.org  http://lab.witness.org/  www.investigativ.ch  http://researchclinic.net  http://www.investigativerecherche.de References