| Model Name | SciBERT |
| Description | A BERT model pretrained on scientific text with a specific science focused vocabulary |
| Use For | Scientific text |
| Limitations | Text longer than 512 tokens will be truncated |
| Graft Default | No |
Reference information
| Source | allenai/scibert_scivocab_uncased - hugging face |
| Trained on | Semantic Scholar 1.14M scientific papers |
| Paper | D19-1371 |
| Embedding Dimension | 768 |