Feature Extraction
GGUF
English
gemma3_text
embedding
retrieval
electrical-engineering
unsloth
llama-cpp
information-retrieval
rag
semantic-search
arxiv:2509.20354
Instructions to use disham993/electrical-embeddinggemma-ir_q4_k_m with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use disham993/electrical-embeddinggemma-ir_q4_k_m with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible embeddings server: llama serve -hf disham993/electrical-embeddinggemma-ir_q4_k_m:Q4_K_M --embeddings
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible embeddings server: llama serve -hf disham993/electrical-embeddinggemma-ir_q4_k_m:Q4_K_M --embeddings
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible embeddings server: ./build/bin/llama serve -hf disham993/electrical-embeddinggemma-ir_q4_k_m:Q4_K_M --embeddings
- Llama new
- LM Studio
- Jan
- Ollama
How to use disham993/electrical-embeddinggemma-ir_q4_k_m with Ollama:
ollama run hf.co/disham993/electrical-embeddinggemma-ir_q4_k_m:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use disham993/electrical-embeddinggemma-ir_q4_k_m with Docker Model Runner:
docker model run hf.co/disham993/electrical-embeddinggemma-ir_q4_k_m:Q4_K_M
- Lemonade
How to use disham993/electrical-embeddinggemma-ir_q4_k_m with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull disham993/electrical-embeddinggemma-ir_q4_k_m:Q4_K_M
Run and chat with the model
lemonade run user.electrical-embeddinggemma-ir_q4_k_m-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Update README.md
Browse files
README.md
CHANGED
|
@@ -21,13 +21,12 @@ license: mit
|
|
| 21 |
|
| 22 |
# gemma-300m-electrical-electronics-ir_q4_k_m
|
| 23 |
|
| 24 |
-
<p align="center"><img src="https://huggingface.co/disham993/gemma-300m-electrical-electronics-ir_fp16/resolve/main/poster.png" width="340"/></p>
|
| 25 |
-
|
| 26 |
-
|
| 27 |
## Model Description
|
| 28 |
|
| 29 |
This model is the **GGUF q4_k_m (4-bit K-quant) variant** of the `gemma-300m-electrical-electronics-ir` family, fine-tuned from [`unsloth/embeddinggemma-300m`](https://huggingface.co/unsloth/embeddinggemma-300m) for dense Information Retrieval (IR) in the electrical and electronics engineering domain. This is the **recommended production build** — it is ~4× smaller than the f16 GGUF (~236 MB), runs on a laptop CPU without a GPU, and loses only 0.0008 MAP@100 points versus the full-precision f16 variant.
|
| 30 |
|
|
|
|
|
|
|
| 31 |
## Training Data
|
| 32 |
|
| 33 |
The model was trained on the [`disham993/ElectricalElectronicsIR`](https://huggingface.co/datasets/disham993/ElectricalElectronicsIR) dataset — 20,000 question-passage pairs covering electrical engineering, electronics, power systems, and communications.
|
|
@@ -73,7 +72,7 @@ Evaluated on the held-out test split (2,000 queries) of `disham993/ElectricalEle
|
|
| 73 |
|
| 74 |
| Model | MAP@100 | NDCG@10 | MRR@10 | Recall@10 |
|
| 75 |
|---|---|---|---|---|
|
| 76 |
-
| `
|
| 77 |
| `gemma-300m-electrical-electronics-ir_lora` | 0.9795 | 0.9847 | 0.9795 | 1.0000 |
|
| 78 |
| `gemma-300m-electrical-electronics-ir_fp16` | 0.9797 | 0.9849 | 0.9797 | 1.0000 |
|
| 79 |
| `gemma-300m-electrical-electronics-ir_f16` | 0.9849 | 0.9887 | 0.9849 | 0.9995 |
|
|
@@ -208,22 +207,6 @@ For the complete fine-tuning and evaluation pipeline — from data loading to GG
|
|
| 208 |
|
| 209 |
## Citation
|
| 210 |
|
| 211 |
-
### EmbeddingGemma base model
|
| 212 |
-
|
| 213 |
-
```bibtex
|
| 214 |
-
@misc{schechter2025embeddinggemma,
|
| 215 |
-
title = {EmbeddingGemma: Powerful and Lightweight Text Representations},
|
| 216 |
-
author = {Henrique Schechter Vera},
|
| 217 |
-
year = {2025},
|
| 218 |
-
eprint = {2509.20354},
|
| 219 |
-
archivePrefix = {arXiv},
|
| 220 |
-
primaryClass = {cs.CL},
|
| 221 |
-
url = {https://arxiv.org/abs/2509.20354},
|
| 222 |
-
}
|
| 223 |
-
```
|
| 224 |
-
|
| 225 |
-
### Fine-tuned model
|
| 226 |
-
|
| 227 |
```bibtex
|
| 228 |
@misc{gemma-300m-electrical-electronics-ir,
|
| 229 |
author = {disham993},
|
|
|
|
| 21 |
|
| 22 |
# gemma-300m-electrical-electronics-ir_q4_k_m
|
| 23 |
|
|
|
|
|
|
|
|
|
|
| 24 |
## Model Description
|
| 25 |
|
| 26 |
This model is the **GGUF q4_k_m (4-bit K-quant) variant** of the `gemma-300m-electrical-electronics-ir` family, fine-tuned from [`unsloth/embeddinggemma-300m`](https://huggingface.co/unsloth/embeddinggemma-300m) for dense Information Retrieval (IR) in the electrical and electronics engineering domain. This is the **recommended production build** — it is ~4× smaller than the f16 GGUF (~236 MB), runs on a laptop CPU without a GPU, and loses only 0.0008 MAP@100 points versus the full-precision f16 variant.
|
| 27 |
|
| 28 |
+
<p align="center"><img src="https://huggingface.co/disham993/gemma-300m-electrical-electronics-ir_fp16/resolve/main/poster.png" width="340"/></p>
|
| 29 |
+
|
| 30 |
## Training Data
|
| 31 |
|
| 32 |
The model was trained on the [`disham993/ElectricalElectronicsIR`](https://huggingface.co/datasets/disham993/ElectricalElectronicsIR) dataset — 20,000 question-passage pairs covering electrical engineering, electronics, power systems, and communications.
|
|
|
|
| 72 |
|
| 73 |
| Model | MAP@100 | NDCG@10 | MRR@10 | Recall@10 |
|
| 74 |
|---|---|---|---|---|
|
| 75 |
+
| `unsloth/embeddinggemma-300m` (baseline) | 0.5753 | 0.6221 | 0.5682 | 0.7925 |
|
| 76 |
| `gemma-300m-electrical-electronics-ir_lora` | 0.9795 | 0.9847 | 0.9795 | 1.0000 |
|
| 77 |
| `gemma-300m-electrical-electronics-ir_fp16` | 0.9797 | 0.9849 | 0.9797 | 1.0000 |
|
| 78 |
| `gemma-300m-electrical-electronics-ir_f16` | 0.9849 | 0.9887 | 0.9849 | 0.9995 |
|
|
|
|
| 207 |
|
| 208 |
## Citation
|
| 209 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 210 |
```bibtex
|
| 211 |
@misc{gemma-300m-electrical-electronics-ir,
|
| 212 |
author = {disham993},
|