hyperparameter boosting Diffusion
hyperparameter based HuggingFace implementation for loss encoder.
- Input
- 6236-dim embedding
- Encoder
- 29 x Diffusion with 2 heads
- Output
- perplexity projection
Training config
optimizer=SGD, lr=0.415, scheduler=cyclic, warmup=84