4 people 425c4eafb0 [Sampler] Stop upcasting logits to fp32 in apply_sampling_params (#48641) ...

Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

2026-07-17 18:15:20 -07:00

..

__init__.py

[V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681)

2024-12-26 19:02:58 +09:00

test_batched_count_greater_than.py

[Performance Improvement] Update batched_count_greater_than to handle batch size 1 without recompile (#38933)

2026-04-09 23:51:31 +08:00

test_head_dtype.py

[ROCm][Bugfix] Enable the fp32 head_dtype torch.mm fast path on ROCm (#48688)

2026-07-15 08:18:22 +00:00

test_logprobs_e2e.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_logprobs.py

[Bugfix][V1/V2] Fix prompt_logprobs to respect logprobs_mode (#47680)

2026-07-17 21:58:59 +01:00

test_rejection_sampler.py

[Spec Decode] Reject placeholder (-1) draft tokens in rejection sampler (#46533)

2026-06-24 03:32:32 +00:00

test_sampler.py

refactor hard coded device string in test files under tests/v1 and tests/lora (#37566)

2026-04-03 11:21:47 +08:00

test_sampling_params_e2e.py

[Bugfix][Model Runner V2] Preserve all allowed_token_ids in the logit bias kernel (#46245)

2026-06-23 07:01:13 +00:00

test_topk_topp_sampler.py

[Sampler] Stop upcasting logits to fp32 in apply_sampling_params (#48641)

2026-07-17 18:15:20 -07:00

utils.py

[Reasoning] Support for speculative decoding with thinking budget (#34668)

2026-04-29 06:14:52 +00:00