sgugger (Sylvain Gugger)

published an article over 2 years ago

Article

Fine-tuning Llama 2 70B using PyTorch FSDP

+2

Sep 13, 2023

•

32

published an article over 2 years ago

Article

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

+3

May 24, 2023

•

171

published an article over 2 years ago

Article

Introducing RWKV - An RNN with the advantages of a transformer

+2

May 15, 2023

•

23

published an article about 3 years ago

Article

How 🤗 Accelerate runs very large models thanks to PyTorch

Sep 27, 2022

•

16

published an article over 3 years ago

Article

Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate

Sep 16, 2022

•

1

published an article over 3 years ago

Article

Accelerate Large Model Training using DeepSpeed

Jun 28, 2022

•

6

published an article over 3 years ago

Article

Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel

May 2, 2022

•

9

published an article about 4 years ago

Article

Course Launch Community Event

Oct 26, 2021

•

3

published an article over 4 years ago

Article

Introducing 🤗 Accelerate

Apr 16, 2021

•

3

published an article over 4 years ago

Article

Introducing 🤗 Accelerate

Apr 16, 2021

•

3

Sylvain Gugger

AI & ML interests

Organizations

Fine-tuning Llama 2 70B using PyTorch FSDP

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

Introducing RWKV - An RNN with the advantages of a transformer

How 🤗 Accelerate runs very large models thanks to PyTorch

Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate

Accelerate Large Model Training using DeepSpeed

Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel

Course Launch Community Event

Introducing 🤗 Accelerate

Introducing 🤗 Accelerate

Sylvain Gugger

AI & ML interests

Organizations

sgugger's activity

Fine-tuning Llama 2 70B using PyTorch FSDP

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

Introducing RWKV - An RNN with the advantages of a transformer

How 🤗 Accelerate runs very large models thanks to PyTorch

Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate

Accelerate Large Model Training using DeepSpeed

Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel

Course Launch Community Event

Introducing 🤗 Accelerate

Introducing 🤗 Accelerate