Papers in 100 Lines of Code
Seminal ML papers, tidy implementations

Maxout Networks (2013-02-18)

Ian J. Goodfellow, David Warde-Farley, Mehdi Mirza, Aaron Courville, Yoshua Bengio

visionactivations
Open page →

Network In Network (2013-12-13)

Min Lin, Qiang Chen, Shuicheng Yan

visioncnn
Open page →

Playing Atari with Deep Reinforcement Learning (2013-12-19)

Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, Martin Riedmiller

rldqn
Open page →

Auto-Encoding Variational Bayes (2013-12-20)

Diederik P Kingma, Max Welling

vaegenerative
Open page →

Generative Adversarial Networks (2014-06-10)

Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio

gans
Open page →

Conditional Generative Adversarial Nets (2014-11-06)

Mehdi Mirza, Simon Osindero

gansconditional
Open page →

Adam: A Method for Stochastic Optimization (2014-12-22)

Diederik P. Kingma, Jimmy Ba

optimizers
Open page →

NICE: Non-linear Independent Components Estimation (2014-10-30)

Laurent Dinh, David Krueger, Yoshua Bengio

flows
Open page →

Human-level control through deep reinforcement learning (2015-02-25)

Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg & Demis Hassabis

rldqn
Open page →

Deep Unsupervised Learning using Nonequilibrium Thermodynamics (2015-03-12)

Jascha Sohl-Dickstein, Eric A. Weiss, Niru Maheswaranathan, Surya Ganguli

diffusion
Open page →

Variational Inference with Normalizing Flows (2015-05-21)

Danilo Jimenez Rezende, Shakir Mohamed

flows
Open page →

Deep Reinforcement Learning with Double Q-learning (2015-09-22)

Hado van Hasselt, Arthur Guez, David Silver

rl
Open page →

Convolutional Generative Adversarial Networks (2015-11-19)

Alec Radford, Luke Metz, Soumith Chintala

gans
Open page →

Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) (2015-11-23)

Djork-Arné Clevert, Thomas Unterthiner, Sepp Hochreiter

visionactivations
Open page →

Adversarially Learned Inference (2016-06-02)

Vincent Dumoulin, Ishmael Belghazi, Ben Poole, Olivier Mastropietro, Alex Lamb, Martin Arjovsky, Aaron Courville

gans
Open page →

Improved Techniques for Training GANs (2016-06-10)

Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, Xi Chen

gans
Open page →

Gaussian Error Linear Units (GELUs) (2016-06-27)

Dan Hendrycks, Kevin Gimpel

visionactivations
Open page →

Least Squares Generative Adversarial Networks (2016-11-13)

Xudong Mao, Qing Li, Haoran Xie, Raymond Y.K. Lau, Zhen Wang, Stephen Paul Smolley

gans
Open page →

Image-to-Image Translation with Conditional Adversarial Networks (2016-11-21)

Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, Alexei A. Efros

gans
Open page →

Wasserstein GAN (2017-01-26)

Martin Arjovsky, Soumith Chintala, Léon Bottou

gans
Open page →

Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks (2017-03-09)

Chelsea Finn, Pieter Abbeel, Sergey Levine

metalearning
Open page →

Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks (2017-03-30)

Jun-Yan Zhu, Taesung Park, Phillip Isola, Alexei A. Efros

gans
Open page →

Improved Training of Wasserstein GANs (2017-03-31)

Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, Aaron Courville

gans
Open page →

Adversarial Feature Learning (2017-04-03)

Jeff Donahue, Philipp Krähenbühl, Trevor Darrell

gans
Open page →

Self-Normalizing Neural Networks (2017-06-08)

Günter Klambauer, Thomas Unterthiner, Andreas Mayr, Sepp Hochreiter

visionactivations
Open page →

Proximal Policy Optimization Algorithms (2017-08-28)

John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, Oleg Klimov

rl
Open page →

Deep Image Prior (2017-11-29)

Dmitry Ulyanov, Andrea Vedaldi, Victor Lempitsky

vision
Open page →

On First-Order Meta-Learning Algorithms (2018-03-08)

Alex Nichol, Joshua Achiam, John Schulman

metalearning
Open page →

Sequential Neural Likelihood (2018-05-18)

George Papamakarios, David C. Sterratt, Iain Murray

flows
Open page →

On the Variance of the Adaptive Learning Rate and Beyond (2019-08-08)

Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han

optimizers
Open page →

Optimizing Millions of Hyperparameters by Implicit Differentiation (2019-10-06)

Jonathan Lorraine, Paul Vicol, David Duvenaud

other
Open page →

Implicit Neural Representations with Periodic Activation Functions (2020-06-17)

Vincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell, Gordon Wetzstein

nerfimplicit
Open page →

Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains (2020-06-18)

Matthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil, Nithin Raghavan, Utkarsh Singhal, Ravi Ramamoorthi, Jonathan T. Barron, Ren Ng

nerfencodings
Open page →

Denoising Diffusion Probabilistic Models (2020-06-19)

Jonathan Ho, Ajay Jain, Pieter Abbeel

diffusion
Open page →

Likelihood-free MCMC with Amortized Approximate Ratio Estimators (2020-06-26)

Joeri Hermans, Volodimir Begy, Gilles Louppe

sbi
Open page →

NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis (2020-08-03)

Ben Mildenhall, Pratul P. Srinivasan, Matthew Tancik, Jonathan T. Barron, Ravi Ramamoorthi, Ren Ng

nerf
Open page →

Multiplicative Filter Networks (2020-09-28)

Rizal Fathony, Anit Kumar Sahu, Devin Willmott, J Zico Kolter

nerfimplicit
Open page →

Denoising Diffusion Implicit Models (2020-10-06)

Jiaming Song, Chenlin Meng, Stefano Ermon

diffusion
Open page →

Learned Initializations for Optimizing Coordinate-Based Neural Representations (2020-12-03)

Matthew Tancik, Ben Mildenhall, Terrance Wang, Divi Schmidt, Pratul P. Srinivasan, Jonathan T. Barron, Ren Ng

nerf
Open page →

FastNeRF: High-Fidelity Neural Rendering at 200FPS (2021-03-18)

Stephan J. Garbin, Marek Kowalski, Matthew Johnson, Jamie Shotton, Julien Valentin

nerf
Open page →

KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs (2021-03-25)

Christian Reiser, Songyou Peng, Yiyi Liao, Andreas Geiger

nerf
Open page →

PlenOctrees for Real-time Rendering of Neural Radiance Fields (2021-03-25)

Alex Yu, Ruilong Li, Matthew Tancik, Hao Li, Ren Ng, Angjoo Kanazawa

nerf
Open page →

NeRF--: Neural Radiance Fields Without Known Camera Parameters (2021-02-14)

Zirui Wang, Shangzhe Wu, Weidi Xie, Min Chen, Victor Adrian Prisacariu

nerf
Open page →

Gromov-Wasserstein Distances between Gaussian Distributions (2021-08-16)

Antoine Salmona, Julie Delon, Agnès Desolneux

other
Open page →

Plenoxels: Radiance Fields without Neural Networks (2021-12-09)

Alex Yu, Sara Fridovich-Keil, Matthew Tancik, Qinhong Chen, Benjamin Recht, Angjoo Kanazawa

nerf
Open page →

InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Rendering (2021-12-31)

Mijeong Kim, Seonguk Seo, Bohyung Han

nerf
Open page →

Instant Neural Graphics Primitives with a Multiresolution Hash Encoding (2022-01-16)

Thomas Müller, Alex Evans, Christoph Schied, Alexander Keller

nerf
Open page →

Pseudo Numerical Methods for Diffusion Models on Manifolds (2022-02-30)

Luping Liu, Yi Ren, Zhijie Lin, Zhou Zhao

diffusion
Open page →

DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps (2022-06-02)

Cheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen, Chongxuan Li, Jun Zhu

diffusion
Open page →

Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow (2022-09-07)

Xingchao Liu, Chengyue Gong, Qiang Liu

diffusion
Open page →

K-Planes: Explicit Radiance Fields in Space, Time, and Appearance (2023-01-24)

Sara Fridovich-Keil, Giacomo Meanti, Frederik Warburg, Benjamin Recht, Angjoo Kanazawa

nerf
Open page →

FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularization (2023-03-13)

Jiawei Yang, Marco Pavone, Yue Wang

nerf
Open page →