Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting (NeurIPS 2019)

A framework for few-shot evaluation of language models.

Lumina-T2X is a unified framework for Text to Any Modality Generation

Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)

LightSeq: A High Performance Library for Sequence Processing and Generation

The OCR approach is rephrased as Segmentation Transformer: https://arxiv.org/abs/1909.11065. This is an official impleme...

[TPAMI'23] Unifying Flow, Stereo and Depth Estimation

Code for "Heterogeneous Graph Transformer" (WWW'20), which is based on pytorch_geometric

📘 A comprehensive handbook on how to create transformers for TypeScript with code examples.

Diffusion models of protein structure; trigonometry and attention are all you need!

list of efficient attention modules

PostHTML is a tool to transform HTML/XML with JS plugins

Multimodal-GPT

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 论文的中文翻译 Chinese Translation!

SwinIR: Image Restoration Using Swin Transformer (official repository)

Collect some papers about transformer with vision. Awesome Transformer with Computer Vision (CV)