Empower Sequence Labeling with Task-Aware Language Model
This project provides high-performance character-aware sequence labeling tools, including Training, Evaluation and Prediction.
Evaluation suite for large-scale language models
Evaluation suite for large-scale language models.
DEMix Layers for Modular Language Modeling
This repository contains modeling utilities for "DEMix Layers: Disentangling Domains for Modular Language Modeling" (Gururangan et. al, 2021).
Few-shot Learning With Language Models
This is a codebase to perform few-shot "in-context" learning using language models similar to the GPT-3 paper.
A novel method to tune language models
A novel method to tune language models. Codes and datasets for paper GPT understands, too.
Combining Images, Language, and 3D Geometry for Learning Multimodal Vision
Towers of Babel: Combining Images, Language, and 3D Geometry for Learning Multimodal Vision. ICCV 2021.
Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling
R2D2: Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling
Question Answering using Language Models and Knowledge Graphs
QA-GNN: Question Answering using Language Models and Knowledge Graphs
A python tools for fine-tuning language models for a task
You have just found the DataTuner. This repository provides tools for fine-tuning language models for a task.
A General Language Model pretrained with an autoregressive blank-filling objective
GLM is a General Language Model pretrained with an autoregressive blank-filling objective and can be finetuned on various natural language understanding and generation tasks.
Ongoing research training transformer language models at scale
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Data-efficient Adaptation of Pretrained Language Models for Image Captioning
VisualGPT: Data-efficient Adaptation of Pretrained Language Models for Image Captioning
The RWKV Language Model
The RWKV Language Model
Datasets from Instructions In Python
This repository contains the code for Generating Datasets with Pretrained Language Models.
Contextual Action Language Model (CALM) and the ClubFloyd Dataset
Contextual Action Language Model (CALM) and the ClubFloyd Dataset
An API to interact with the GPT-J language model
An API to interact with the GPT-J language model.
Meta Language-Specific Layers in Multilingual Language Models
Language-specific layers are served as meta parameters, optimized using an iterative procedure.
Ongoing research training transformer language models at scale
Megatron (1 and 2) is a large, powerful transformer developed by the Applied Deep Learning Research team at NVIDIA.
Language models are open knowledge graphs in pytorch
A non official reimplementation of Language models are open knowledge graphs
PyTorch implementation of OpenAI's Finetuned Transformer Language Model
A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI
True Few-Shot Learning with Language Models
learning to perform a task using a limited number of examples from a single task distribution.
Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigation
Pytorch code for ICRA'21 paper: "Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigation"
Deduplicating Training Data Makes Language Models Better
Deduplicating Training Data Makes Language Models Better
Pretrained model on Marathi language using a masked language modeling objective
Pretrained model on Marathi language using a masked language modeling (MLM) objective.
A heterogeneous entity-augmented academic language model
OAG-BERT is a heterogeneous entity-augmented academic language model which not only understands academic texts but also heterogeneous entity knowledge in OAG.
Knowledge Inheritance for Pre-trained Language Models
Source code paper: Knowledge Inheritance for Pre-trained Language Models (preprint).
Learning Transferable Visual Models From Natural Language Supervision
CLIP: Connecting Text and Image (Learning Transferable Visual Models From Natural Language Supervision)
Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognition
Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognition
Easy access to state-of-the-art pre-trained models with python
This repository aims to give easy access to state-of-the-art pre-trained models.
LoRA: Low-Rank Adaptation of Large Language Models
Code for "LoRA: Low-Rank Adaptation of Large Language Models"