Skip to content

[DRAFT] 3d warmup #1178

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 42 commits into
base: habana_main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
42 commits
Select commit Hold shift + click to select a range
3d13cda
3d warmup part1
iboiko-habana Apr 29, 2025
ac8b693
3d warmup part3
iboiko-habana Apr 29, 2025
043cafe
3d warmup part4
iboiko-habana Apr 29, 2025
f0520af
After review 5
iboiko-habana Apr 29, 2025
23c9eb8
After review 6
iboiko-habana Apr 30, 2025
494d2b4
Part 7
iboiko-habana May 5, 2025
2b92fb7
Part 8
iboiko-habana May 5, 2025
dba3ebc
Part 9
iboiko-habana May 5, 2025
6d9c427
Part 10
iboiko-habana May 6, 2025
a0ed908
Part 11
iboiko-habana May 7, 2025
4e4edb4
Part 12
iboiko-habana May 8, 2025
824ccfd
Cleanup commit, add use_prefix_prefill var
adobrzyn May 8, 2025
ff0dfb2
Merge branch 'habana_main' into 3d_warmup
iboiko-habana May 9, 2025
76d1212
Fix after merge, prefix prefill buckets
adobrzyn May 9, 2025
9256071
Working v0 with no APC
adobrzyn May 9, 2025
aa2c625
v1 part1
iboiko-habana May 9, 2025
7841905
v1 part1
iboiko-habana May 9, 2025
25ddac2
v0 warmup refactor
adobrzyn May 13, 2025
2d88cd9
Precommit and styling
adobrzyn May 13, 2025
88177dc
Precommit, hpu pooling model runner fix
adobrzyn May 13, 2025
272d429
Fix decode format - bs, query = 1, ctx
adobrzyn May 14, 2025
7f80617
Formating
adobrzyn May 14, 2025
696383c
Merge branch 'habana_main' into 3d_warmup
adobrzyn May 14, 2025
1ed890e
Formating 2
adobrzyn May 14, 2025
ce3fa3c
v1 part3
iboiko-habana May 16, 2025
a66ee27
Merge branch 'habana_main' into 3d_warmup
adobrzyn May 20, 2025
0c483e7
Fix v0, add enc dec support
adobrzyn May 21, 2025
d467608
Merge branch 'habana_main' into 3d_warmup
iboiko-habana May 22, 2025
9149776
didnt add that whoopsie
adobrzyn May 22, 2025
bd5716f
v0 fix enc dec phase definition
adobrzyn May 22, 2025
81f3d8d
Once again enc dec v0
adobrzyn May 22, 2025
297177c
enc dec for the third time
adobrzyn May 22, 2025
950fc45
....
adobrzyn May 22, 2025
36fdea1
.........
adobrzyn May 22, 2025
88c0548
v0 precommit, change ctx to ctx_blocks in exec fun
adobrzyn May 22, 2025
d5dede7
..
adobrzyn May 22, 2025
f3fd161
v0 precommit
adobrzyn May 22, 2025
d274c26
is this gonna work
adobrzyn May 22, 2025
4d7dd32
what the duck
adobrzyn May 22, 2025
c049551
yolo
adobrzyn May 22, 2025
f6d7ed7
..
adobrzyn May 22, 2025
9cf6ac7
final v0
adobrzyn May 23, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion requirements/hpu.txt
Original file line number Diff line number Diff line change
Expand Up @@ -9,4 +9,4 @@ numpy==1.26.4
tabulate
setuptools>=77.0.3,<80.0.0
setuptools-scm>=8
vllm-hpu-extension @ git+https://github.com/HabanaAI/vllm-hpu-extension.git@03d5800
vllm-hpu-extension @ git+https://github.com/HabanaAI/vllm-hpu-extension.git@3d_warmup
Loading