How to use naot97/whisper-base-8bit with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="naot97/whisper-base-8bit")
# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq processor = AutoProcessor.from_pretrained("naot97/whisper-base-8bit") model = AutoModelForSpeechSeq2Seq.from_pretrained("naot97/whisper-base-8bit", device_map="auto")
https://huggingface.co/naot97/whisper-base-8bit/resolve/main/tokenizer.json
hf download hf://naot97/whisper-base-8bit/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/naot97/whisper-base-8bit/resolve/main/tokenizer.json
