Similarity checking of sign languages

This repository checks for similarity between

  1. British sign language and Peruvian sign language
  2. British sign language and American sign language

with the “Temporal segmentation of sign language videos” model that is pre-trained in British sign language (BSL).

Contents

picture

Setups

Data & Models/algorithms

Data: 

Models

Results

  • British sign language and Peruvian sign language: We processed two datasets namely ira_alegria and proteinas_porcentajes. We identified in how many files/lines, there is at-least one match. The input files are the srt files we processed from ira_alegria and proteinas_porcentajes datasets and the output files are the vtt files that we collected by running corresponding video files of these srt files in the “Temporal segmentation of sign language videos” model. These input srt files and output vtt files has a number of words for signs in that line/sentence/video file. Than we identified for how many input files, there is at-least one word match in the output file. For ira_alegria and proteinas_porcentajes, we found approximately 30% and 16%.

ira_alegria result proteinas result

  • British sign language and American sign language: We processed one dataset namely how2sign. We identified in how many files/lines, there is at-least one matched word. The input files are the srt files we processed from the csv translation file in the dataset and the output files are the vtt files that we collected by running corresponding video files of these srt files in the “Temporal segmentation of sign language videos” model. These input srt files and output vtt files has a number of words for signs in that line/sentence/video file. Than we identified for how many input files, there is at-least one word match in the output file. For how2sign, we found approximately 46%.

how2sign result

GitHub

View Github