Usage
Most of your text is short, less than around 400 words, and your primary goal is to train a classifier on the text.
Methodology
The truncate and special token average method looks at the first n tokens in the input text, prepends a special classification token, and averages the embeddings for all tokens including the special tokens. The value of n is often 512 tokens and thus usually captures the meaningful semantics of the text.