Fit More and Train Faster With ZeRO via DeepSpeed and FairScale
Browse
AI News
25887 items — filtered, classified, deduplicated
How we sped up transformer inference 100x for 🤗 API customers
CLIP: Connecting text and images
DALL·E: Creating images from text
Organizational update from OpenAI
Leveraging Pre-trained Language Model Checkpoints for Encoder-Decoder Models
Porting fairseq wmt19 translation system to transformers
Hyperparameter Search with Transformers and Ray Tune
Transformer-based Encoder-Decoder Models
OpenAI licenses GPT-3 technology to Microsoft
Block Sparse Matrices for Smaller and Faster Language Models
Generative language modeling for automated theorem proving
Learning to summarize with human feedback
OpenAI Scholars 2020: Final projects
The Reformer - Pushing the limits of language modeling
Procgen and MineRL Competitions
Image GPT
OpenAI API
Language models are few-shot learners
AI and efficiency
Jukebox
Improving verifiability in AI development
OpenAI Microscope
How to generate text: using different decoding methods for language generation with Trans…
How to train a new language model from scratch using Transformers and Tokenizers
OpenAI standardizes on PyTorch
Scaling laws for neural language models
Dota 2 with large scale deep reinforcement learning
Deep double descent
Procgen Benchmark