File size: 117 Bytes
9394d37 |
1 2 3 4 5 6 7 8 9 |
---
license: mit
---
```python
from tokenizers import Tokenizer
tokenizer = Tokenizer.from_file(tokenizer_path)
``` |
9394d37 |
1 2 3 4 5 6 7 8 9 |
---
license: mit
---
```python
from tokenizers import Tokenizer
tokenizer = Tokenizer.from_file(tokenizer_path)
``` |