Nick HillandGitHub c6dd32a810 [ModelRunner V2] Support realtime embeddings (#46762)

2026-06-26 19:42:27 -07:00

..

__init__.py

[V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681)

2024-12-26 19:02:58 +09:00

test_attn_utils.py

[Spec Decode] Support mixed KV page sizes for DFlash (#45181)

2026-06-21 22:45:14 +08:00

test_encoder_runner.py

[ModelRunner V2] Support realtime embeddings (#46762)

2026-06-26 19:42:27 -07:00

test_gpu_block_table.py

[PERF] Fuse multi-group block table staged writes (#44944)

2026-06-16 10:53:27 -07:00

test_gpu_gumbel_sample.py

[MRV2] Make FP32 Gumbel sampling more accurate (#45996)

2026-06-18 19:42:09 +00:00

test_gpu_input_batch.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

test_gpu_model_runner_mm_gather.py

[Bugfix][Spec Decode] Fix EAGLE drafter multimodal encoder cache misses (#46315)

2026-06-22 18:14:02 +00:00

test_gpu_model_runner_v2_eplb.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

test_gpu_model_runner.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

test_gpu_profiler.py

Support custom URI schemes and trace handlers for profiler (#32393)

2026-01-22 09:45:40 -08:00

test_gpu_worker_weight_transfer.py

[Frontend][Core] Add sparse NCCL weight transfer support for in-place updates (#40096)

2026-06-01 15:37:30 -04:00

test_gpu_worker.py

Vram semaphore infra (#44465)

2026-06-26 17:32:51 -07:00

test_late_interaction_runner.py

[Frontend] Re-enable running MaxSim on GPU (#38620)

2026-04-03 00:03:13 +08:00

test_mamba_utils.py

[Kernel] Support DS Mamba tail copy for MTP align mode (#45473)

2026-06-16 22:50:30 +00:00

test_mrope_prompt_embeds.py

[Security] Fix DoS via prompt_embeds on M-RoPE models (#45252)

2026-06-13 10:17:38 +00:00

test_utils.py

[V0 Deprecation] Refactor kv cache from list to element (#37487)

2026-03-23 20:10:11 -07:00

test_worker_memory_snapshot.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00