Digital Humanities Benelux Conference 2017

Audio-visual media annotation

Time & Room

Time 13:00 – 15:30
Room to be announced
Signing up Send an e-mail to DHBenelux (attn. Liliana Melgar)
Participants are requested to fill in this form before the workshop, in order to know their familiarity with the topic and adapt the workshop to their level.

Goal and target audience

This workshop is targeted at scholars who use video or audio sources as primary materials in their research (e.g., oral historians, film, television and/or media scholars, literary scholars, linguists). These audio-visual sources can be created by themselves, or be part of cultural heritage collections. The objective of the workshop is to offer an overview of existing audio and video manual annotation tools and their typologies, analyzing their advantages and limitations. Various types of tools will be demonstrated, and the workshop participants gain “hands-on-experience” with three of these tools, including the CLARIAH Media Suite annotation tool.


  • 13.00-13.20: Introduction to the workshop & participants.
    We introduce the aims and method of the workshop, and participants introduce themselves and their projects. If participants have worked with audio-visual analysis before, they are requested to explain how they did it (manually or using existing tools)
  • 13.20-13.40: Introduction to audio-visual annotation and overview of existing tools
    We will introduce the concept of manual and semi-automatic annotation, and present an analysis of existing audio-visual annotation tools, grouping them in categories and showing short demos exemplifying each category.
  • 13.40-14.10: Hands-on experience with ELAN
    Participants will be briefly introduced to ELAN video and audio annotation tool and the tier approach to annotation. They will analyse a video (there will be a video file provided for the workshop, but participants can also bring their own. Those who attended the morning workshop on oral history and speech technology can continue their work by annotating the interview they were working with). As preparation for this part of the workshop, participants are requested to install ELAN previously in their own computers.
  • 14.10-14.30: Introduction to the CLARIAH Media Suite annotation component
    The CLARIAH Media Studies focus team has been working on implementing annotation functionality for audio-visual sources as part of the CLARIAH infrastructure. In this part, participants will be introduced to the CLARIAH Media Suite and the approach to implementing annotation taken by CLARIAH. Examples will be shown of the use of the annotation component (ArtTube, LinkedTV, MoTu).
  • 14.30-15.00: Hands-on experience with the CLARIAH Media Suite and its annotation component
    Participants will be given tasks for using the CLARIAH Media Suite and its annotation functionality for video and audio sources (segment, add classifications, comments and links, and create customized templates) while registering their observations.
  • 15.00-15.30: Discussion
    • Opinions and questions
    • Other topics:
      • Comparing the different approaches to annotation (OHMS, ELAN, CLARIAH MS)
      • The tier approach for audio/video annotation: advantages and disadvantages
      • Stand-alone tools vs infrastructural approach (are scholars’ needs met?)
      • Mixed media annotation (how to work with different tools for different media and combine these annotations?)
      • Linking scholarly annotations to the web (using open/controlled vocabularies?)

Number of participants

We aim at a group of 8 – 10 participants.



For more information, please e-mail: Liliana Melgar