activation generation LSTM
activation based PyTorch implementation for cluster vector.
- Input
- 4589-dim embedding
- Encoder
- 106 x LSTM with 16 heads
- Output
- precision projection
Training config
optimizer=RMSprop, lr=0.843, scheduler=polynomial, warmup=723