Tiktokenizer Plus
한국어
gpt-4o
Tokenizer
Embedding
Contextualization
Generation
What are tokens?
Click to expand
You are a helpful assistant
You are a helpful assistant
Hi! Introduce yourself in one sentence.
Hi! Introduce yourself in one sentence.
Add message
Context window
0 / 128,000 (0.0%)
Token count
0
Show whitespace
Remixed by
Bora Lee
· Based on the original
Tiktokenizer
GitHub
X