pietrolesci
/

tokenisers

Model card Files Files and versions

tokenisers / bpe8064minipile

536 kB

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

pietrolesci's picture

Upload folder using huggingface_hub

c5527f0 verified over 1 year ago

raw_tok_path.txt

66 Bytes
Upload folder using huggingface_hub over 1 year ago
special_tokens_map.json

35 Bytes
Upload folder using huggingface_hub over 1 year ago
tokenizer.json

535 kB
Upload folder using huggingface_hub over 1 year ago
tokenizer_config.json

385 Bytes
Upload folder using huggingface_hub over 1 year ago