-
Notifications
You must be signed in to change notification settings - Fork 786
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
1 changed file
with
5 additions
and
5 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,6 +1,10 @@ | ||
# BertViz | ||
|
||
BertViz is a tool for visualizing attention in the Transformer model, supporting most models from the [transformers](https://github.com/huggingface/transformers) library (BERT, GPT-2, XLNet, RoBERTa, XLM, CTRL, etc.). It extends the [Tensor2Tensor visualization tool](https://github.com/tensorflow/tensor2tensor/tree/master/tensor2tensor/visualization) by [Llion Jones](https://medium.com/@llionj) and the [transformers](https://github.com/huggingface/transformers) library from [HuggingFace](https://github.com/huggingface). | ||
BertViz is a tool for visualizing attention in the Transformer model, supporting most models from the | ||
[transformers](https://github.com/huggingface/transformers) library (BERT, GPT-2, XLNet, RoBERTa, XLM, CTRL, MarianMT, | ||
etc.). It extends the | ||
[Tensor2Tensor visualization tool](https://github.com/tensorflow/tensor2tensor/tree/master/tensor2tensor/visualization) | ||
by [Llion Jones](https://medium.com/@llionj) and the [transformers](https://github.com/huggingface/transformers) library from [HuggingFace](https://github.com/huggingface). | ||
|
||
## Resources | ||
|
||
|
@@ -120,10 +124,6 @@ git clone --depth 1 [email protected]:jessevig/bertviz.git | |
cd bertviz/notebooks | ||
jupyter notebook | ||
``` | ||
|
||
Specifying `--depth 1`, as shown above, excludes older revisions thus providing a faster download. Note that the sample notebooks do not cover | ||
all Huggingface models, but the code should be similar for those not included. | ||
|
||
|
||
## Detailed Instructions | ||
|
||
|