Skip to content

serving_dinfer_openai.md

Latest commit

 

History

History
13 lines (9 loc) · 351 Bytes

serving_dinfer_openai.md

File metadata and controls

13 lines (9 loc) · 351 Bytes

Demo of dinfer openai serving

Serving

python3 serving_dinfer_openai.py

Client

date && curl -X POST -H "Content-Type: application/json" -H "Authorization: Bearer 12345678" -N -d '{"messages": [{"role": "user", "content": "你好， 我是小明"}], "stream": false}' http://0.0.0.0:48000/v1/chat/completions && date