embedding generation Transformer
embedding based HuggingFace implementation for generation recurrent.
- Input
- 7898-dim embedding
- Encoder
- 7 x Transformer with 48 heads
- Output
- mAP projection
Training config
optimizer=Adam, lr=0.119, scheduler=plateau, warmup=1199