Commit 6b55b0c
Add tracing support in deepseek for vLLM flow (#36605)
### Ticket
#36604
### What's changed
Deepseek supports tracing only in decode path for now. This patch
implements tracing in vLLM workflow for deepseek.
### Checklist
- [ ] [](https://github.com/tenstorrent/tt-metal/actions/workflows/all-post-commit-workflows.yaml?query=branch:pprajapati/vllm_tracing)
- [ ] [](https://github.com/tenstorrent/tt-metal/actions/workflows/blackhole-post-commit.yaml?query=branch:pprajapati/vllm_tracing)
- [ ]
[](https://github.com/tenstorrent/tt-metal/actions/workflows/tt-metal-l2-nightly.yaml?query=branch:pprajapati/vllm_tracing)
- [ ] New/Existing tests provide coverage for changes
#### Model tests
If your changes cover model-related code, you should run tests
corresponding to affected models and platforms (Single card, T3K,
Galaxy). "Choose your pipeline" workflows facilitate running multiple
kinds of tests in a single run. Each offers `models-mandatory` and
`models-extended` presets.
The former includes a minimal set of tests, to be run always. The latter
extends that with additional ones - use your best judgement in deciding
which is the most appropriate for your PR.
- [ ] [](https://github.com/tenstorrent/tt-metal/actions/workflows/pipeline-select.yaml?query=branch:pprajapati/vllm_tracing)
- [ ] `models-mandatory` preset (runs: [Device perf
regressions](https://github.com/tenstorrent/tt-metal/actions/workflows/perf-device-models.yaml)
and [Frequent model and ttnn
tests](https://github.com/tenstorrent/tt-metal/actions/workflows/fast-dispatch-full-regressions-and-models.yaml))
- [ ] `models-extended` preset (runs: the mandatory tests, plus
[Demo](https://github.com/tenstorrent/tt-metal/actions/workflows/single-card-demo-tests.yaml)
and [Model
perf](https://github.com/tenstorrent/tt-metal/actions/workflows/perf-models.yaml)
tests)
- [ ] other selection - specify runs
- [ ] [](https://github.com/tenstorrent/tt-metal/actions/workflows/pipeline-select-t3k.yaml?query=branch:pprajapati/vllm_tracing)
- [ ] `models-mandatory` preset (runs: [Unit
tests](https://github.com/tenstorrent/tt-metal/actions/workflows/t3000-unit-tests.yaml))
- [ ] `models-extended` preset (runs: the mandatory tests, plus
[Demo](https://github.com/tenstorrent/tt-metal/actions/workflows/t3000-demo-tests.yaml)
and [Model
perf](https://github.com/tenstorrent/tt-metal/actions/workflows/t3000-model-perf-tests.yaml)
tests)
- [ ] other selection - specify runs
- [ ] [](https://github.com/tenstorrent/tt-metal/actions/workflows/pipeline-select-galaxy.yaml?query=branch:pprajapati/vllm_tracing)
- [ ] `models-mandatory` preset (runs: [Quick
tests](https://github.com/tenstorrent/tt-metal/actions/workflows/galaxy-quick.yaml))
- [ ] `models-extended` preset (runs: the mandatory tests, plus
[Demo](https://github.com/tenstorrent/tt-metal/actions/workflows/galaxy-demo-tests.yaml)
and [Model
perf](https://github.com/tenstorrent/tt-metal/actions/workflows/galaxy-model-perf-tests.yaml)
tests)
- [ ] other selection - specify runs
---------
Signed-off-by: Pratikkumar Prajapati <pprajapati@tenstorrent.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>1 parent 7ca802b commit 6b55b0c
File tree
3 files changed
+115
-50
lines changed- models/demos/deepseek_v3
- demo
- tt
3 files changed
+115
-50
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
277 | 277 | | |
278 | 278 | | |
279 | 279 | | |
280 | | - | |
| 280 | + | |
| 281 | + | |
| 282 | + | |
| 283 | + | |
| 284 | + | |
| 285 | + | |
| 286 | + | |
| 287 | + | |
| 288 | + | |
| 289 | + | |
| 290 | + | |
| 291 | + | |
281 | 292 | | |
282 | 293 | | |
283 | 294 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
132 | 132 | | |
133 | 133 | | |
134 | 134 | | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
135 | 143 | | |
136 | 144 | | |
137 | 145 | | |
138 | 146 | | |
139 | 147 | | |
140 | 148 | | |
| 149 | + | |
141 | 150 | | |
142 | 151 | | |
143 | 152 | | |
| |||
279 | 288 | | |
280 | 289 | | |
281 | 290 | | |
282 | | - | |
| 291 | + | |
283 | 292 | | |
284 | 293 | | |
285 | 294 | | |
286 | 295 | | |
287 | 296 | | |
288 | | - | |
| 297 | + | |
289 | 298 | | |
290 | 299 | | |
291 | 300 | | |
292 | 301 | | |
| 302 | + | |
| 303 | + | |
| 304 | + | |
| 305 | + | |
| 306 | + | |
| 307 | + | |
| 308 | + | |
| 309 | + | |
| 310 | + | |
| 311 | + | |
| 312 | + | |
| 313 | + | |
| 314 | + | |
| 315 | + | |
| 316 | + | |
| 317 | + | |
| 318 | + | |
| 319 | + | |
| 320 | + | |
| 321 | + | |
| 322 | + | |
| 323 | + | |
| 324 | + | |
| 325 | + | |
| 326 | + | |
| 327 | + | |
| 328 | + | |
293 | 329 | | |
294 | 330 | | |
295 | | - | |
| 331 | + | |
296 | 332 | | |
297 | 333 | | |
298 | 334 | | |
| |||
304 | 340 | | |
305 | 341 | | |
306 | 342 | | |
307 | | - | |
| 343 | + | |
308 | 344 | | |
309 | 345 | | |
310 | 346 | | |
311 | 347 | | |
312 | 348 | | |
313 | 349 | | |
314 | | - | |
| 350 | + | |
315 | 351 | | |
316 | 352 | | |
317 | 353 | | |
318 | 354 | | |
319 | 355 | | |
320 | 356 | | |
321 | | - | |
| 357 | + | |
322 | 358 | | |
323 | | - | |
| 359 | + | |
324 | 360 | | |
325 | | - | |
| 361 | + | |
326 | 362 | | |
327 | 363 | | |
328 | 364 | | |
329 | 365 | | |
330 | 366 | | |
331 | 367 | | |
332 | 368 | | |
333 | | - | |
| 369 | + | |
334 | 370 | | |
335 | 371 | | |
336 | 372 | | |
337 | 373 | | |
338 | | - | |
339 | | - | |
340 | | - | |
341 | | - | |
342 | | - | |
343 | | - | |
344 | | - | |
345 | | - | |
346 | 374 | | |
347 | 375 | | |
348 | 376 | | |
| |||
414 | 442 | | |
415 | 443 | | |
416 | 444 | | |
417 | | - | |
| 445 | + | |
418 | 446 | | |
419 | 447 | | |
420 | 448 | | |
| |||
444 | 472 | | |
445 | 473 | | |
446 | 474 | | |
447 | | - | |
448 | | - | |
| 475 | + | |
| 476 | + | |
449 | 477 | | |
450 | 478 | | |
451 | 479 | | |
| |||
637 | 665 | | |
638 | 666 | | |
639 | 667 | | |
640 | | - | |
641 | | - | |
642 | | - | |
643 | | - | |
644 | | - | |
| 668 | + | |
| 669 | + | |
| 670 | + | |
| 671 | + | |
| 672 | + | |
645 | 673 | | |
646 | 674 | | |
647 | 675 | | |
| |||
818 | 846 | | |
819 | 847 | | |
820 | 848 | | |
821 | | - | |
| 849 | + | |
| 850 | + | |
| 851 | + | |
| 852 | + | |
| 853 | + | |
822 | 854 | | |
823 | 855 | | |
824 | 856 | | |
825 | 857 | | |
826 | 858 | | |
827 | 859 | | |
828 | | - | |
| 860 | + | |
829 | 861 | | |
830 | 862 | | |
831 | 863 | | |
| |||
838 | 870 | | |
839 | 871 | | |
840 | 872 | | |
| 873 | + | |
| 874 | + | |
| 875 | + | |
| 876 | + | |
| 877 | + | |
| 878 | + | |
| 879 | + | |
841 | 880 | | |
842 | 881 | | |
843 | 882 | | |
| |||
847 | 886 | | |
848 | 887 | | |
849 | 888 | | |
850 | | - | |
851 | | - | |
852 | | - | |
853 | 889 | | |
854 | 890 | | |
855 | 891 | | |
856 | 892 | | |
857 | 893 | | |
858 | | - | |
| 894 | + | |
859 | 895 | | |
860 | 896 | | |
861 | 897 | | |
| |||
866 | 902 | | |
867 | 903 | | |
868 | 904 | | |
869 | | - | |
870 | | - | |
| 905 | + | |
| 906 | + | |
871 | 907 | | |
| 908 | + | |
872 | 909 | | |
| 910 | + | |
| 911 | + | |
| 912 | + | |
873 | 913 | | |
874 | | - | |
| 914 | + | |
875 | 915 | | |
876 | 916 | | |
877 | 917 | | |
878 | | - | |
| 918 | + | |
879 | 919 | | |
880 | 920 | | |
881 | 921 | | |
| |||
892 | 932 | | |
893 | 933 | | |
894 | 934 | | |
| 935 | + | |
895 | 936 | | |
896 | 937 | | |
897 | 938 | | |
| |||
921 | 962 | | |
922 | 963 | | |
923 | 964 | | |
| 965 | + | |
| 966 | + | |
| 967 | + | |
| 968 | + | |
| 969 | + | |
924 | 970 | | |
925 | | - | |
| 971 | + | |
| 972 | + | |
926 | 973 | | |
927 | | - | |
928 | | - | |
929 | | - | |
930 | | - | |
| 974 | + | |
| 975 | + | |
| 976 | + | |
| 977 | + | |
| 978 | + | |
931 | 979 | | |
932 | 980 | | |
933 | 981 | | |
| |||
1034 | 1082 | | |
1035 | 1083 | | |
1036 | 1084 | | |
1037 | | - | |
| 1085 | + | |
| 1086 | + | |
| 1087 | + | |
1038 | 1088 | | |
1039 | 1089 | | |
1040 | 1090 | | |
1041 | 1091 | | |
1042 | 1092 | | |
1043 | 1093 | | |
| 1094 | + | |
| 1095 | + | |
1044 | 1096 | | |
1045 | 1097 | | |
1046 | 1098 | | |
| |||
1051 | 1103 | | |
1052 | 1104 | | |
1053 | 1105 | | |
1054 | | - | |
| 1106 | + | |
1055 | 1107 | | |
1056 | 1108 | | |
1057 | 1109 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
132 | 132 | | |
133 | 133 | | |
134 | 134 | | |
135 | | - | |
| 135 | + | |
136 | 136 | | |
| 137 | + | |
137 | 138 | | |
138 | 139 | | |
139 | 140 | | |
140 | 141 | | |
141 | 142 | | |
| 143 | + | |
142 | 144 | | |
143 | | - | |
144 | | - | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
145 | 148 | | |
146 | 149 | | |
147 | | - | |
| 150 | + | |
| 151 | + | |
148 | 152 | | |
149 | | - | |
150 | | - | |
151 | 153 | | |
152 | | - | |
| 154 | + | |
153 | 155 | | |
154 | 156 | | |
155 | 157 | | |
| |||
0 commit comments