danube-chatml / added_tokens.json
TinyPixel's picture
Upload tokenizer
e648af2 verified
raw
history blame contribute delete
69 Bytes
{
"<PAD>": 32002,
"<|im_end|>": 32001,
"<|im_start|>": 32000
}