How to use efederici/e5-multilingual-base-int8-dynamic with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("efederici/e5-multilingual-base-int8-dynamic") model = AutoModel.from_pretrained("efederici/e5-multilingual-base-int8-dynamic", device_map="auto")
jzhang86