You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If you have any lingering processes after running `ctrl-c`, you can kill them by running
240
+
> [!IMPORTANT]
241
+
> We are aware of an issue where vLLM subprocesses might not be killed when `ctrl-c` is pressed.
242
+
> We are working on addressing this. Relevant vLLM issues can be found [here](https://github.com/vllm-project/vllm/pull/8492) and [here](https://github.com/vllm-project/vllm/issues/6219#issuecomment-2439257824).
241
243
242
-
```bash
243
-
functionkill_tree() {
244
-
local parent=$1
245
-
local children=$(ps -o pid= --ppid $parent)
246
-
forchildin$children;do
247
-
kill_tree $child
248
-
done
249
-
echo"Killing process $parent"
250
-
kill -9 $parent
251
-
}
252
-
253
-
kill_tree $(pgrep circusd)
254
-
```
244
+
To stop the serve, you can press `ctrl-c` which will kill the different components. In order to kill the remaining vLLM subprocesses you can run `nvidia-smi` and `kill -9` the remaining processes or run `pkill python3` from inside of the container.
Copy file name to clipboardExpand all lines: examples/llm/README.md
+1-5Lines changed: 1 addition & 5 deletions
Original file line number
Diff line number
Diff line change
@@ -157,8 +157,4 @@ See [multinode-examples.md](multinode-examples.md) for more details.
157
157
158
158
### Close deployment
159
159
160
-
> [!IMPORTANT]
161
-
> We are aware of an issue where vLLM subprocesses might not be killed when `ctrl-c` is pressed.
162
-
> We are working on addressing this. Relevant vLLM issues can be found [here](https://github.com/vllm-project/vllm/pull/8492) and [here](https://github.com/vllm-project/vllm/issues/6219#issuecomment-2439257824).
163
-
164
-
To stop the serve, you can press `ctrl-c` which will kill the different components. In order to kill the remaining vLLM subprocesses you can run `nvidia-smi` and `kill -9` the remaining processes or run `pkill python3` from inside of the container.
160
+
See [close deployment](../../docs/guides/dynamo_serve.md#close-deployment) section to learn about how to close the deployment.
0 commit comments