Try OneTrainer instead

#1
by xixxix-HF - opened

Title. LR 0.0001, adamw8bit, rank and alpha 16, do a test run with 512 res. Batch 2 minimum, use gradient if it's too much for your system.

Sign up or log in to comment