Commit e31d8d7

and

authored

[TRTLLM-11540][feat] Revert EAGLE3 dynamic tree speculative decoding support (NVIDIA#12062) (NVIDIA#13006)

Signed-off-by: Balaram Buddharaju <169953907+brb-nv@users.noreply.github.com> Signed-off-by: Yiqing Yan <yiqingy@nvidia.com> Co-authored-by: Yiqing Yan <yiqingy@nvidia.com>

1 parent 1480140 commit e31d8d7Copy full SHA for e31d8d7

37 files changed

+414

-3571

lines changed

cpp/tensorrt_llm
- kernels
  - speculativeDecoding
  - trtllmGenKernels/fmha
    - fmhaRunnerParams.h
    - prepareCustomMask.cu
  - xqaDispatcher.cpp
- thop
docs/source
- features
  - feature-combination-matrix.md
  - speculative-decoding.md
- models
  - supported-models.md
examples/llm-api
- quickstart_advanced.py
tensorrt_llm
- _torch
  - attention_backend
    - interface.py
    - sparse
      - dsa.py
    - trtllm.py
  - modules
    - attention.py
  - pyexecutor
  - speculative
- llmapi
  - llm_args.py
tests
- integration/test_lists
  - waives.txt
- unittest
  - _torch
    - modeling
      - test_modeling_llama.py
    - speculative
    - thop/parallel
      - test_custom_ops.py
  - others
    - test_kv_cache_update.py

37 files changed

+414

-3571

lines changed

`‎cpp/tensorrt_llm/kernels/speculativeDecoding/dynamicTreeKernels.cu‎`

This file was deleted.

Comments

(0)