Add files using upload-large-folder tool
Browse files
README.md
CHANGED
|
@@ -121,7 +121,8 @@ pip install sglang==0.5.3 sgl-kernel==0.3.15 torch==2.8.0 torchvision==0.23.0 to
|
|
| 121 |
|
| 122 |
Then you should install our sglang wheel package:
|
| 123 |
```shell
|
| 124 |
-
|
|
|
|
| 125 |
```
|
| 126 |
|
| 127 |
#### Run Inference
|
|
@@ -147,4 +148,4 @@ curl -s http://localhost:${PORT}/v1/chat/completions \
|
|
| 147 |
-d '{"model": "auto", "temperature": 0.6, "messages": [{"role": "user", "content": "Give me a short introduction to large language models."}]}'
|
| 148 |
```
|
| 149 |
|
| 150 |
-
More usage can be found [here](https://docs.sglang.ai/basic_usage/send_request.html)
|
|
|
|
| 121 |
|
| 122 |
Then you should install our sglang wheel package:
|
| 123 |
```shell
|
| 124 |
+
git clone https://github.com/inclusionAI/Ring-V2.git
|
| 125 |
+
pip install Ring-V2/moba/whls/sglang-0.5.3.post1-py3-none-any.whl --no-deps --force-reinstall
|
| 126 |
```
|
| 127 |
|
| 128 |
#### Run Inference
|
|
|
|
| 148 |
-d '{"model": "auto", "temperature": 0.6, "messages": [{"role": "user", "content": "Give me a short introduction to large language models."}]}'
|
| 149 |
```
|
| 150 |
|
| 151 |
+
More usage can be found [here](https://docs.sglang.ai/basic_usage/send_request.html)
|