intelligence softmax Diffusion
intelligence based JAX implementation for multimodal random-forest.
- Input
- 3564-dim embedding
- Encoder
- 31 x Diffusion with 24 heads
- Output
- recall projection
Training config
optimizer=Adagrad, lr=0.438, scheduler=polynomial, warmup=792