Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

Dec 06, 2021 1 min read

NÜWA – Pytorch (wip)

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch. This repository will be populated in the case that Microsoft does not open source the code by end of December. It may also contain an extension into video and audio, using a dual decoder approach.

Citations

@misc{wu2021nuwa,
    title   = {N\"UWA: Visual Synthesis Pre-training for Neural visUal World creAtion}, 
    author  = {Chenfei Wu and Jian Liang and Lei Ji and Fan Yang and Yuejian Fang and Daxin Jiang and Nan Duan},
    year    = {2021},
    eprint  = {2111.12417},
    archivePrefix = {arXiv},
    primaryClass = {cs.CV}
}

GitHub

PyTorch Attention Network Text Video Deep Learning Transformer Text-to-video

John was the first writer to have joined pythonawesome.com. He has since then inculcated very effective writing and reviewing culture at pythonawesome which rivals have found impossible to imitate.

Official PyTorch implementation of Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks

Official PyTorch implementation of Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks

Official PyTorch implementation of Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks

18 February 2022

Swin Transformer V2: Scaling Up Capacity and Resolution

Swin Transformer V2: Scaling Up Capacity and Resolution

12 January 2022

TRACER: Extreme Attention Guided Salient Object Tracing Network implementation in PyTorch

TRACER: Extreme Attention Guided Salient Object Tracing Network implementation in PyTorch

17 December 2021

Official Pytorch Implementation of Relational Self-Attention: What's Missing in Attention for Video Understanding

Official Pytorch Implementation of Relational Self-Attention: What's Missing in Attention for Video Understanding

Official Pytorch Implementation of Relational Self-Attention: What's Missing in Attention for Video Understanding

08 December 2021

SSAT: A Symmetric Semantic-Aware Transformer Network for Makeup Transfer and Removal

SSAT: A Symmetric Semantic-Aware Transformer Network for Makeup Transfer and Removal

SSAT: A Symmetric Semantic-Aware Transformer Network for Makeup Transfer and Removal

07 December 2021

An efficient modular implementation of Associating Objects with Transformers for Video Object Segmentation in PyTorch

An efficient modular implementation of Associating Objects with Transformers for Video Object Segmentation in PyTorch

An efficient modular implementation of Associating Objects with Transformers for Video Object Segmentation in PyTorch

17 November 2021

Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, debuted in ICLR

Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, debuted in ICLR

Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, debuted in ICLR

16 November 2021

Self-Attention Context Network: Addressing the Threat of Adversarial Attacks for Hyperspectral Image Classification

Self-Attention Context Network: Addressing the Threat of Adversarial Attacks for Hyperspectral Image Classification

Self-Attention Context Network: Addressing the Threat of Adversarial Attacks for Hyperspectral Image Classification

18 October 2021