Update README.md
Browse files
README.md
CHANGED
|
@@ -38,11 +38,9 @@ Note: the last layer, i.e., the MTP layer index 46 is ignored due to transformer
|
|
| 38 |
## Inference
|
| 39 |
|
| 40 |
### Prerequisite
|
| 41 |
-
Install the latest vllm
|
| 42 |
```
|
| 43 |
-
pip install -U vllm
|
| 44 |
-
--pre \
|
| 45 |
-
--extra-index-url https://wheels.vllm.ai/nightly
|
| 46 |
```
|
| 47 |
|
| 48 |
### vllm
|
|
|
|
| 38 |
## Inference
|
| 39 |
|
| 40 |
### Prerequisite
|
| 41 |
+
Install the latest vllm releases:
|
| 42 |
```
|
| 43 |
+
pip install -U vllm
|
|
|
|
|
|
|
| 44 |
```
|
| 45 |
|
| 46 |
### vllm
|