Initial Release
TransformerRanker currently supports LM ranking for token and text classification tasks.
Supported Datasets and LMs
- Integrated with the datasets library.
- Includes a predefined list of base and large models.
Efficiency
- Embeds a down-sampled dataset and scores embeddings of different LMs.
- Supports GPU for transferability metrics: H-Score and LogME written in torch.