Stable Signer:
Hierarchical Sign Language Generative Model

Sen Fang1, Dimitris N. Metaxas1
1Rutgers, The State University of New Jersey
Paper arXiv Video Code Data

Abstract

We present some preliminary results of our newly developed Pose2Video model. Our proposal aims to combine the most stable and fastest Text2Pose sign language model with state-of-the-art Pose2Video model to help more disadvantaged groups.

We are the team with the fastest progress and best results in the field of multilingual generation. While the United Nations recognizes sign language as one of its official languages, the deaf community still faces significant communication challenges. Currently, mainstream academia can only generate German Sign Language and American Sign Language, overlooking a broader population worldwide. We plan to target more than eight sign languages for our generation system, which would cover over fifty countries.

Demo Overview


ASL
Input: Here's a little example here I'm going to give you some insight on though.
Translation: Here's a little example here I'm going to give you some insight on though.
DGS
Input: Im Südostraum ist es vorteilhaft, ein Hochdruckgebiet kommt von Belgien.
Translation: In the southeastern region it is advantageous, a high-pressure system is coming from Belgium.
KSL
Input: 염려하다.
Translation: worried about.
DSGS
Input: Bei dieser Firma bestelle ich immer die Plastikbecher.
Translation: I always order plastic cups from this company.
LSF-CH
Input: Le leader du parti socialiste.
Translation: The leader of the Socialist Party.
LIS-CH
Input: Io voglio comprare una nuova borsa.
Translation: I want to buy a new bag.
LSA
Input: desayuno.
Translation: breakfast.
TSL
Input: Animasyon atölyesinde 9-12 yaş arası işitme engelli çocuklar animasyon sanatını öğrenecekler.
Translation: Children who are deaf or hard of hearing (aged 9-12) will learn about animation art at the animation workshop.
QP: Synthetic sign language video obtained after processing using style transfer model for reference.

Eight Languages


ASL Sign
Reference Image
ASL
Input: Here's a little example here I'm going to give you some insight on though.
Translation: Here's a little example here I'm going to give you some insight on though.
ASL
Input: Alright our next pose for reviving and waking up in the morning is a seated side stretch.
Translation: Alright our next pose for reviving and waking up in the morning is a seated side stretch.
ASL
Input: People are training you to give you the tools mentally to do the job that you're going to do.
Translation: People are training you to give you the tools mentally to do the job that you're going to do.
ASL
Input: So from here, once I get this out, I rotate the hand just like this.
Translation: So from here, once I get this out, I rotate the hand just like this.
GSL Sign
Reference Image
GSL
Input: Im Südostraum ist es vorteilhaft, ein Hochdruckgebiet kommt von Belgien.
Translation: In the southeastern region it is advantageous, a high-pressure system is coming from Belgium.
GSL
Input: GUTEN ABEND LIEBE ZUSCHAUER, am Anfang Dezember regnet es heute, die Leute gehen nach Hause, das ist es.
Translation: Good evening dear viewers, it started raining in early December and today people are heading home, that's all.
GSL
Input: Im Nordwestraum und später im Südwestraum sowie im Osten wird es etwas trockener.
Translation: The northwest, and later the Southwest, and the east will become drier.
GSL
Input: In der Nacht regnet es besonders im Nordraum und Nordwestraum, im südlichen Teil ist es teilweise klar mit Wolken und Nebel.
Translation: Overnight rain, especially in northern and northwestern areas, partly sunny with clouds and fog in southern areas.
ASL Sign
Reference Image
KSL
Input: 염려하다.
Translation: worried about.
KSL
Input: 한 시간.
Translation: one hour.
KSL
Input: 휴대폰.
Translation: cell phone.
KSL
Input: 좋아, 좋은.
Translation: good, nice.
ASL Sign
Reference Image
DSGS
Input: Bei dieser Firma bestelle ich immer die Plastikbecher.
Translation: I always order plastic cups from this company.
DSGS
Input: Eine Trauung muss vom Zivilstandsamt vollzogen werden.
Translation: The wedding must be performed by a civil registry office.
DSGS
Input: Die Indianer leben in einer anderen Kultur.
Translation: The Indians lived in a different culture.
DSGS
Input: Letztes Jahr erhielt ich als Rendite 500 Franken.
Translation: I made a profit of 500 francs last year.
ASL Sign
Reference Image
LSF-CH
Input: Le leader du parti socialiste.
Translation: Leader of the Socialist party.
LSF-CH
Input: On parle quatre langues en Suisse: français, suisse allemand, italien et romanche.
Translation: Four languages are spoken in Switzerland: French, Swiss German, Italian and Romansh.
LSF-CH
Input: Le chat a des canines très pointues.
Translation: Cats have very sharp canine teeth.
LSF-CH
Input: La fille aime jouer à habiller la poupée.
Translation: The girl likes to play the game of dressing dolls.
ASL Sign
Reference Image
LIS-CH
Input: Io voglio comprare una nuova borsa.
Translation: I want to buy a new bag.
LIS-CH
Input: Ho chiesto a quel sordo che fa il pittore, se puo' farmi in quadro dai toni arancioni.
Translation: I asked the deaf painter if he could paint me a picture in an orange tone.
LIS-CH
Input: Partecipo ad un corso d'inglese di livello avanzato.
Translation: I took an advanced English course.
LIS-CH
Input: Andiamo a camminare in montagna.
Translation: Let's go for a walk in the mountains.
ASL Sign
Reference Image
LSA
Input: photo.
Translation: photo.
LSA
Translation: mock.
Translation: mock.
LSA
Translation: birthday.
Translation: birthday.
LSA
Translation: breakfast.
Translation: breakfast.
ASL Sign
Reference Image
TSL
Input: Animasyon atölyesinde 9-12 yaş arası işitme engelli çocuklar animasyon sanatını öğrenecekler.
Translation: In the Animation workshop, hearing impaired children ages 9 to 12 will learn about the art of animation.
TSL
Input: Ekrandaki engelleri ortadan kaldırdık.
Translation: We eliminated the barriers on the screen.
TSL
Input: İşitme engelli çocuklarımız, başarılarını dünyaya kanıtladılar.
Translation: Our children with hearing impairments proved their success to the world.
TSL
Input: Yedinci sırada yer aldık, ama daha da önemlisi bu, tüm insanlığa engelin bedende olmadığını ilan etti.
Translation: We ranked seventh, but more importantly, it proclaimed to all humanity that disability is not in the body.

BibTeX

@article{ss2025,
  author    = {xxx},
  title     = {Stable Signer: Hierarchical Sign Language Generative Model},
  journal   = {arXiv},
  year      = {2025},
}