Bug 2311895 (CVE-2024-8768) - CVE-2024-8768 vllm: A completions API request with an empty prompt will crash the vllm API server.
Summary: CVE-2024-8768 vllm: A completions API request with an empty prompt will crash...
Keywords:
Status: NEW
Alias: CVE-2024-8768
Product: Security Response
Classification: Other
Component: vulnerability
Version: unspecified
Hardware: All
OS: Linux
high
high
Target Milestone: ---
Assignee: Product Security DevOps Team
QA Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2024-09-12 11:13 UTC by OSIDB Bzimport
Modified: 2024-09-17 15:43 UTC (History)
2 users (show)

Fixed In Version:
Clone Of:
Environment:
Last Closed:
Embargoed:

Attachments (Terms of Use)

Description OSIDB Bzimport 2024-09-12 11:13:07 UTC 
A completions API request with an empty prompt will crash the vllm API server.

The impact is limited based on what model is being served.
* Serving gpt2 is affected.
* Most models are not affected, as vllm will prepend tokens to the prompt, avoiding the problematic code.

https://github.com/vllm-project/vllm/commit/e25fee57c2e69161bd261f5986dc5aeb198bbd42
Note You need to log in before you can comment on or make changes to this bug.