"Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancement" (ICCV 2023) & (NTIRE 2024 Runner-Up...

Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting (NeurIPS 2019)

SwinIR: Image Restoration Using Swin Transformer (official repository)

Official implementation of PVT series

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal a...

PaddleSlim is an open-source library for deep model compression and architecture search.

Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.

list of efficient attention modules

[ECCV 2022] Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Framework

[ICLR 2022] Official implementation of the paper "DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETR"

Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.

[ NeurIPS2021] This is an official implementation of our paper "HRFormer: High-Resolution Transformer for Dense Predicti...

VRT: A Video Restoration Transformer (official repository)

Multimodal-GPT

[Mamba-Survey-2024] Paper list for State-Space-Model/Mamba and it's Applications

[TNSRE 23] EEG Transformer 2.0. i. Convolutional Transformer for EEG Decoding. ii. Novel visualization - Class Activatio...