狠狠撸

狠狠撸Share a Scribd company logo

HyperTED

?
?
Mariella Sabatino
Mariella Sabatino

HyperTED is a web application able to browse through media fragments of TED Talks and recommend them thanks to Semantic Entities extracted from their subtitles. HyperTED was a teamwork project that I developed during my Erasmus Internship in Eurecom (Sophia Antipolis, France) in order to write my Master Thesis.

1 of 25
Download to read offline
MARIELLA SABATINO GO! insert a candidate Master Degree course in Cinema and Media Enginereeng Fulvio Corno Rapha?l Troncy Josè Luis Redondo García
2 1984 2006 2014 .com Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
3 Users overwhelmed with audio-visual content Which are the relevant fragments for the user? How can users easily find related documents which complement the video? Can the video be divided into meaningful fragments? How can those fragments be properly described? Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
Hyperlinking Hyperlinking Hyperlinking 4 Media Fragment support Media Fragment annotation Hyperlinking Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
5 how to recommend related media fragments within the same video collection 1 2 3 detecting segments of interest within a video recommending related media fragments within the same video collection design a web application that provides a rich environment for exploring a video collection Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
Hyperlinking 6 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31 Sections along the time dimension of the media resource with a start and an end point. A specific part of a multimedia object. http://www.w3.org/TR/media-frags/
7 TED Talks provide paragraphs: a human-made subdivision of subtitles. Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31
8 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks locating and classifying elements of textual documents into pre-defined categories 2 31 assigning a specific linguistic meaning between many possibilities
9 “This is Nikita, a security guard from one of the bars in St. Petersburg.” NER PERSON FUNCTION LOCATION Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31
10 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31 St. Petersburg, Russia St. Petersburg, Florida St. Petersburg, Pennsylvania St. Petersburg, Missouri (fictional) NLP
Hyperlinking Web Tools that expose NER algorithms. 11 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31 Combines different NER tools available on Web Unifies NER extractors in a common output http://nerd.eurecom.fr/
2 31 10 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 30 TED Talks fraction of retrieved documents that are relevant 10 Selection of the meaningful concepts on the subtitles; Run of each extractor; Comparison of the results. fraction of relevant documents that are retrieved level of accuracy considering both
13 AlchemyAPI 0,20 0,08 0,113 DataTXT 0,19 0,34 0,241 DBpedia Spotlight 0,14 0,33 0,192 OpenCalais 0,32 0,11 0,169 Saplo 0,00 0,00 - TextRazor 0,17 0,36 0,228 THD 0,15 0,08 0,106 Yahoo! Content Analysis 0,31 0,05 0,086 Zemanta 0,41 0,10 0,155 Combined 0,12 0,45 0,195 2 31 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks Relevance score Disambiguation URL Abstract Topics
14 “I'm wearing a camera, just a simple webcam, a portable, battery-powered projection system with a little mirror. These components communicate to my cell phone in my pocket which acts as the communication and computation device. And in the video here we see my student Pranav Mistry, who's really the genius who's been implementing and designing this whole system...” Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31
15 2 31 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks Clustering of consecutive Chapters with similar annotations Ordering based on relevance Filtering the 1st quarter of relevance score
16 how to recommend related media fragments within the same video collection 1 2 3 detecting segments of interest within a video recommending related media fragments within the same video collection design a web application that provides a rich environment for exploring a video collection Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
17 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31 Open-source search engine Document oriented Comparable to a Relational DB Query DSL based on JSON
18 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31 Topics and Entities timing references UUID of the resource Relevance Meaning of the Talk Chapter
17 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31 Topics Courses about the same thematic Entities Too specific Open Courseware Open University
20 Interlinking through chapters and topic Interlinking to openCourseware and openUniversity Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31
21 how to recommend related media fragments within the same video collection 1 2 3 detecting segments of interest within a video recommending related media fragments within the same video collection design a web application that provides a rich environment for exploring a video collection Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
22 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31
23 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31
24 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks Detection of chapters working with TED APIs Evaluation of some of the main NER Extractors Hyperlinking between chapters and topics using elasticsearch Building of a Responsive and Web compliant UI LinkedUp Vici Competition top ten of the submissions. Redondo García, Sabatino, Lisena and Troncy, Detecting Hot Spots in Web Videos. In ISWC’14, Demo Track, Riva del Garda, Italy, 2014. http://ceur-ws.org/Vol-1272/paper_111.pdf
25 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks

More Related Content

HyperTED

  • 1. MARIELLA SABATINO GO! insert a candidate Master Degree course in Cinema and Media Enginereeng Fulvio Corno Rapha?l Troncy Josè Luis Redondo García
  • 2. 2 1984 2006 2014 .com Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
  • 3. 3 Users overwhelmed with audio-visual content Which are the relevant fragments for the user? How can users easily find related documents which complement the video? Can the video be divided into meaningful fragments? How can those fragments be properly described? Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
  • 4. Hyperlinking Hyperlinking Hyperlinking 4 Media Fragment support Media Fragment annotation Hyperlinking Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
  • 5. 5 how to recommend related media fragments within the same video collection 1 2 3 detecting segments of interest within a video recommending related media fragments within the same video collection design a web application that provides a rich environment for exploring a video collection Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
  • 6. Hyperlinking 6 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31 Sections along the time dimension of the media resource with a start and an end point. A specific part of a multimedia object. http://www.w3.org/TR/media-frags/
  • 7. 7 TED Talks provide paragraphs: a human-made subdivision of subtitles. Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31
  • 8. 8 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks locating and classifying elements of textual documents into pre-defined categories 2 31 assigning a specific linguistic meaning between many possibilities
  • 9. 9 “This is Nikita, a security guard from one of the bars in St. Petersburg.” NER PERSON FUNCTION LOCATION Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31
  • 10. 10 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31 St. Petersburg, Russia St. Petersburg, Florida St. Petersburg, Pennsylvania St. Petersburg, Missouri (fictional) NLP
  • 11. Hyperlinking Web Tools that expose NER algorithms. 11 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31 Combines different NER tools available on Web Unifies NER extractors in a common output http://nerd.eurecom.fr/
  • 12. 2 31 10 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 30 TED Talks fraction of retrieved documents that are relevant 10 Selection of the meaningful concepts on the subtitles; Run of each extractor; Comparison of the results. fraction of relevant documents that are retrieved level of accuracy considering both
  • 13. 13 AlchemyAPI 0,20 0,08 0,113 DataTXT 0,19 0,34 0,241 DBpedia Spotlight 0,14 0,33 0,192 OpenCalais 0,32 0,11 0,169 Saplo 0,00 0,00 - TextRazor 0,17 0,36 0,228 THD 0,15 0,08 0,106 Yahoo! Content Analysis 0,31 0,05 0,086 Zemanta 0,41 0,10 0,155 Combined 0,12 0,45 0,195 2 31 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks Relevance score Disambiguation URL Abstract Topics
  • 14. 14 “I'm wearing a camera, just a simple webcam, a portable, battery-powered projection system with a little mirror. These components communicate to my cell phone in my pocket which acts as the communication and computation device. And in the video here we see my student Pranav Mistry, who's really the genius who's been implementing and designing this whole system...” Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31
  • 15. 15 2 31 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks Clustering of consecutive Chapters with similar annotations Ordering based on relevance Filtering the 1st quarter of relevance score
  • 16. 16 how to recommend related media fragments within the same video collection 1 2 3 detecting segments of interest within a video recommending related media fragments within the same video collection design a web application that provides a rich environment for exploring a video collection Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
  • 17. 17 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31 Open-source search engine Document oriented Comparable to a Relational DB Query DSL based on JSON
  • 18. 18 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31 Topics and Entities timing references UUID of the resource Relevance Meaning of the Talk Chapter
  • 19. 17 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31 Topics Courses about the same thematic Entities Too specific Open Courseware Open University
  • 20. 20 Interlinking through chapters and topic Interlinking to openCourseware and openUniversity Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31
  • 21. 21 how to recommend related media fragments within the same video collection 1 2 3 detecting segments of interest within a video recommending related media fragments within the same video collection design a web application that provides a rich environment for exploring a video collection Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks
  • 22. 22 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31
  • 23. 23 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks 2 31
  • 24. 24 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks Detection of chapters working with TED APIs Evaluation of some of the main NER Extractors Hyperlinking between chapters and topics using elasticsearch Building of a Responsive and Web compliant UI LinkedUp Vici Competition top ten of the submissions. Redondo García, Sabatino, Lisena and Troncy, Detecting Hot Spots in Web Videos. In ISWC’14, Demo Track, Riva del Garda, Italy, 2014. http://ceur-ws.org/Vol-1272/paper_111.pdf
  • 25. 25 Mariella Sabatino - HyperTED, searching and browsing through fragments of TED Talks