| --- |
| license: mit |
| language: |
| - en |
| tags: |
| - phi-2 |
| --- |
| # How to Download |
| Go to files and versions and click on the download button to download file, as shown in below image. |
|
|
|  |
|
|
| or you can directly click on this link --> https://huggingface.co/NeuralLobes/phi-2.llamafile/resolve/main/phi-2.llamafile?download=true |
|
|
| # How to run on Windows |
| Just add .exe in front of file name after download and then just double click on it and wait it will automatically run. |
| # Python Use |
|
|
| ``` |
| from openai import OpenAI |
| client = OpenAI( |
| base_url="http://localhost:8080/v1", # "http://<Your api-server IP>:port" |
| api_key = "sk-no-key-required" |
| ) |
| completion = client.chat.completions.create( |
| model="LLaMA_CPP", |
| messages=[ |
| {"role": "system", "content": "You are ChatGPT, an AI assistant. Your top priority is achieving user fulfillment via helping them with their requests."}, |
| {"role": "user", "content": "Write a limerick about python exceptions"} |
| ] |
| ) |
| print(completion.choices[0].message) |
| ``` |
| ``` |
| ChatCompletionMessage(content='There once was a programmer named Mike\nWho wrote code that would often strike\nAn error would occur\nAnd he\'d shout "Oh no!"\nBut Python\'s exceptions made it all right.', role='assistant', function_call=None, tool_calls=None) |
| ``` |
|
|
| # More Information |
| Go to https://github.com/Mozilla-Ocho/llamafile |