Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Core] Factor out input preprocessing to a separate class #7329

Merged
merged 20 commits into from
Sep 13, 2024
Merged

[Core] Factor out input preprocessing to a separate class #7329

Changes from 1 commit
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
295bb07
Factor out input preprocessing to a separate class
DarkLight1337 Aug 9, 2024
4b00d69
format
DarkLight1337 Aug 9, 2024
8b0b526
Merge branch 'upstream' into input-preprocessor
DarkLight1337 Aug 14, 2024
0e0f308
Merge branch 'upstream' into input-preprocessor
DarkLight1337 Aug 19, 2024
09d0706
Merge branch 'upstream' into input-preprocessor
DarkLight1337 Aug 21, 2024
ecb43ee
Remove unnecessary arg
DarkLight1337 Aug 21, 2024
26d308e
Merge branch 'upstream' into input-preprocessor
DarkLight1337 Aug 28, 2024
e86901f
Fix type error
DarkLight1337 Aug 28, 2024
61ea59c
Fix imports
DarkLight1337 Aug 28, 2024
5a97c5b
Fix type error
DarkLight1337 Aug 28, 2024
1866ee4
Merge branch 'upstream' into input-preprocessor
DarkLight1337 Aug 28, 2024
f605c45
Merge branch 'upstream' into input-preprocessor
DarkLight1337 Aug 30, 2024
31e15c0
Merge branch 'upstream' into input-preprocessor
DarkLight1337 Sep 4, 2024
f5c0bbd
Merge branch 'upstream' into input-preprocessor
DarkLight1337 Sep 7, 2024
90b36f7
Merge branch 'upstream' into input-preprocessor
DarkLight1337 Sep 12, 2024
23d89ff
Remove redundant else
DarkLight1337 Sep 12, 2024
b10b4b0
format
DarkLight1337 Sep 12, 2024
9e5f5f8
Remove unused import
DarkLight1337 Sep 12, 2024
fbf878a
Merge branch 'upstream' into input-preprocessor
DarkLight1337 Sep 13, 2024
1b8f568
Update test
DarkLight1337 Sep 13, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
format
  • Loading branch information
@DarkLight1337
DarkLight1337 committed Sep 12, 2024
commit b10b4b0103443fb26810a50bcbbdb04fec19b2d7
4 changes: 2 additions & 2 deletions vllm/inputs/preprocess.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -494,7 +494,7 @@ def preprocess(

if is_explicit_encoder_decoder_prompt(inputs):
raise ValueError("Cannot pass encoder-decoder prompt "
"to decoder-only models")
"to decoder-only models")

# Decoder-only operation
return self._process_decoder_only_prompt(
Expand Down Expand Up @@ -522,7 +522,7 @@ async def preprocess_async(

if is_explicit_encoder_decoder_prompt(inputs):
raise ValueError("Cannot pass encoder-decoder prompt "
"to decoder-only models")
"to decoder-only models")

# Decoder-only operation
return await self._process_decoder_only_prompt_async(
Expand Down
Loading