Caption-Occlusion Severity Judgments across Live-Television Genres from Deaf and Hard-of-Hearing Viewers

This webpage contains supplemental online information for a W4A article under review.

Dataset

Demographics Data from the Importance-Judgements Study

Sample Stimuli Displayed during Importance-Judgement Collection Study

In the table below, we have shared 8 screenshots from our questionnaire used in this importance-judgement collection study described in section 5 of our paper. These images depict how stimuli were displayed to participants before they responded to the scalar questions. Screenshots with some obscured elements are provided here, as the authors do not possess copyright permission to directly redistribute the original video materials.

File Name Genre Visual Description
1.png News A News video stimulus in which a reporter is reporting from remote place.
2.png Interview/Talk Show A hybrid remote and in-studio interview/talk show video in which some participants are in the studio and some are connected over the video-conferencing site.
3.png Emergency Announcement A COVID-19 related emergency announcement consisting of one official announcing an emergency declaration, in the presence of an ASL interpreter.
4.png Political Debate A political debate video stimulus, in which multiple politicians participated.
5.png Weather News A Weather news report video stimulus, in which a presenter was explaining the weather report.
6.png Sports(MLB) A Major League Baseball video stimulus, in which a pitcher is pitching the baseball towards the batter.
7.png Sports(NBA) A video stimulus from an NBA basketball game, in which one team is attempting to score and another team is defending.
8.png Sports(NFL) A National Football League video stimulus, in which the quarterback has thrown the ball.

Supporting Diagrams

In this table below, we have shared a total of 14 diagrams spanning 6 genres, which we used during our importance-judgement collection study (section 5 of the paper) to collect DHH users’ responses about various onscreen content regions. The purpose of each diagram was to simply serve as a key or legend, to explain what region of the screen was being referred to when phrases such as "name of presenter/host" was used in a scalar question. Each diagram represents a specific layout, except for the sports genre, in which a composite is shown with 2 sub-layouts each, in which we represent a camera-view displaying commentators and the players separately. The table enumerates all the diagrams sequentially, along with information about which genre is associated with each.

File Name Layout Genre
1.png Only the presenter/host is onscreen News
2.png Discussion between news presenters and reporter News
3.png Reporter is reporting live from the place of incident News
4.png In-studio interview Interviews or Talk Shows
5.png Remote interview Interviews or Talk Shows
6.png ASL interpreter present onscreen Emergency Announcement
7.png ASL interpreter not present onscreen Emergency Announcement
8.png Several candidates visible onscreen Political Debate
9.png Hourly weather forecast chart Weather News
10.png Map view weather forecast Weather News
11.png Weekly weather forecast chart Weather News
12.png Commentators and game play of Major League Baseball (MLB) Sports
13.png Commentators and game play of National Basketball Association (NBA) Sports
14.png Commentators and game play of National Football League (NFL) Sports

Demographics Data from the Metric-Evaluation Study