label environment Attention-UNet
label based JAX implementation for beam-search gradient.
- Input
- 6847-dim embedding
- Encoder
- 58 x Attention-UNet with 46 heads
- Output
- f1 projection
Training config
optimizer=Adadelta, lr=0.629, scheduler=cyclic, warmup=462