wechsel
Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
Code will be published here once it is ready.
You might also like...
A flexible and efficient library for sequential and session-based recommendation
Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation, available for both PyTorch and Tensorflow
Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling
R2D2: Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling
Ongoing research training transformer language models at scale
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Ongoing research training transformer language models at scale
Megatron (1 and 2) is a large, powerful transformer developed by the Applied Deep Learning Research team at NVIDIA.
Knowledge Inheritance for Pre-trained Language Models
Source code paper: Knowledge Inheritance for Pre-trained Language Models (preprint).
Learning Transferable Visual Models From Natural Language Supervision
CLIP: Connecting Text and Image (Learning Transferable Visual Models From Natural Language Supervision)
Adaptive Token Sampling for Efficient Vision Transformers (ECCV 2022 Oral Presentation)
Adaptive Token Sampling for Efficient Vision Transformers (ECCV 2022 Oral Presentation)
TOIST: Task Oriented Instance Segmentation Transformer with Noun-Pronoun Distillation
TOIST: Task Oriented Instance Segmentation Transformer with Noun-Pronoun Distillation This repository is an official implementation of TOIST: TOIST: Task Oriented Instance Segmentation Transformer with Noun-Pronoun Distillation Pengfei Li, Beiwen Tian, Yongliang Shi, Xiaoxue