Skip to content

Commit

Permalink
fix
Browse files Browse the repository at this point in the history
  • Loading branch information
hnyls2002 committed Sep 19, 2024
1 parent 6cce0db commit 331e954
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions python/sglang/srt/managers/policy_scheduler.py
Original file line number Diff line number Diff line change
Expand Up @@ -251,6 +251,7 @@ def add_req_state(r, insert_sort=False):
)
else:
# Chunked prefill
return False
trunc_len = self.rem_chunk_tokens
req.extend_input_len = trunc_len
req.fill_ids = req.fill_ids[:trunc_len]
Expand Down

0 comments on commit 331e954

Please sign in to comment.