Predicting the Usability of Imperfect Captions for People who are Deaf or Hard of Hearing

This webpage contains supplemental online information for a TACCESS article under review.

README File

The PDF file below serves as the descriptive overview document that describes the content of this folder, which will be uploaded to the ACM digital library.

• README.pdf

PREFERENCE-2018 STUDY: For comparing the ACE and the ACE2 metric

The following files contains the stimuli used in the study along with the user response data collected from the participants in the study.

Stimuli

The file in contains a total of seven columns:

• reference_text: contains the clean, formatted reference text that was shown to the participants
• hypothesis_one: contains one version of the hypothesis shown as the caption
• hypothesis_two: contains second version of the hypothesis shown as the caption
• ace_one: contains the ACE score for first hypothesis (hypothesis_one)
• ace_two: contains the ACE score for the second hypothesis (hypothesis_two)
• ace2_one: contains the ACE2 score for the first hypothesis (hypothesis_one)
• ace2_two: contains the ACE2 score for the second hypothesis (hypothesis_two).

• stimuli.csv

User Preferences

The file contains the subjective rating score (from 1-to-10) recieved from each of our 12 participants (referenced as columns: p01, p02, .., p12 in the file) on each of our stimuli text. Besides the individual response from the participants, the following columns are also shared:

• Average: contains the average score of the participants for the stimuli
• ACE: contains the ACE score of the stimuli
• ACE2: contains the ACE2 score of the stimuli
• WER: contains the WER score of the stimuli

• responses.csv