x
This commit is contained in:
@@ -170,7 +170,7 @@ Once the server is up, hit the OpenAI‑compatible endpoint:
|
||||
```bash
|
||||
curl -X POST http://localhost:8000/v1/chat/completions \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{"model":"Qwen/Qwen2.5-7B-Instruct","messages":[{"role":"user","content":"Hello! Test the performance."}]}'
|
||||
-d '{"model":"Qwen3-Coder-30B-A3B-Instruct-GPTQ-4bit","messages":[{"role":"user","content":"Hello! Test the performance."}]}'
|
||||
```
|
||||
|
||||
You should receive a JSON response with a `choices[0].message.content` reply.
|
||||
@@ -206,4 +206,3 @@ docker run -p 3000:3000 \
|
||||
-v chat-ui-data:/data \
|
||||
ghcr.io/huggingface/chat-ui-db
|
||||
```
|
||||
|
||||
|
||||
Reference in New Issue
Block a user