Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ReadyON
/
Vecteus-V2-7B-gguf
like
0
Text Generation
GGUF
TFMC/imatrix-dataset-for-japanese-llm
English
Japanese
text-generation-inference
imatrix
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
Vecteus-V2-7B-gguf
Vecteus-V2-7B-gguf
gguf version of
Vecteus-V2-7B
.
Downloads last month
31
GGUF
Model size
7B params
Architecture
llama
Hardware compatibility
Log In
to view the estimation
4-bit
IQ4_XS
3.91 GB
Q4_K_M
4.37 GB
5-bit
Q5_K_M
5.13 GB
Q5_K_M
5.13 GB
8-bit
Q8_0
7.7 GB
Inference Providers
NEW
Text Generation
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Dataset used to train
ReadyON/Vecteus-V2-7B-gguf
TFMC/imatrix-dataset-for-japanese-llm
Viewer
•
Updated
Apr 19, 2024
•
239
•
67
•
25