Pre-training of Deep Bidirectional Transformers for Language Understanding

Oct 10, 2019 1 min read

BERT

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Simple implementation of BERT (TensorFlow 2.0 style) https://arxiv.org/abs/1810.04805

ToDo

mecab tokenizer
Multiprocessing (for preprocessing NSP data in parallel)

Requirements

pip install sentencePiece

Future Work

GPT2

GitHub

Machine Learning

John was the first writer to have joined pythonawesome.com. He has since then inculcated very effective writing and reviewing culture at pythonawesome which rivals have found impossible to imitate.

Pre-training of Deep Bidirectional Transformers for Language Understanding

BERT

ToDo

Requirements

Future Work

GitHub

John

Various implementations of Generative adversarial networks using Pytorch

Using approximate bayesian posteriors in deep nets for active learning

BERT

ToDo

Requirements

Future Work

GitHub

Various implementations of Generative adversarial networks using Pytorch

Using approximate bayesian posteriors in deep nets for active learning

You might also like...