This commit is contained in:
2026-03-29 02:57:21 +08:00
parent 3792606cf9
commit 8802e9b226
4 changed files with 19 additions and 6 deletions
+1 -2
View File
@@ -170,7 +170,7 @@ Once the server is up, hit the OpenAI‑compatible endpoint:
```bash
curl -X POST http://localhost:8000/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{"model":"Qwen/Qwen2.5-7B-Instruct","messages":[{"role":"user","content":"Hello! Test the performance."}]}'
-d '{"model":"Qwen3-Coder-30B-A3B-Instruct-GPTQ-4bit","messages":[{"role":"user","content":"Hello! Test the performance."}]}'
```
You should receive a JSON response with a `choices[0].message.content` reply.
@@ -206,4 +206,3 @@ docker run -p 3000:3000 \
-v chat-ui-data:/data \
ghcr.io/huggingface/chat-ui-db
```