Skip to content

Switch CUBLAS to device-side pointer mode #2616

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
maleadt merged 18 commits into from
Feb 7, 2025
Merged

Switch CUBLAS to device-side pointer mode #2616

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
7316ef0
Split out level 3 gemm tests
kshyatt Jan 8, 2025
da49416
Use non-blocking device side pointer mode in CUBLAS, with fallbacks
kshyatt Jan 10, 2025
73c21fe
Convert more scalars to CuRef.
maleadt Feb 4, 2025
1680e59
Remove RefOrCuRef.
maleadt Feb 4, 2025
fbd3bae
Simplify conversions.
maleadt Feb 4, 2025
da3e6b6
Fix tests
kshyatt Feb 4, 2025
b7b170f
Switch CuRef to Ref for cublasXt wrappers
kshyatt Feb 4, 2025
40363fe
More tests and small fixes
kshyatt Feb 5, 2025
e069f9d
Fix iamax result type
kshyatt Feb 5, 2025
7fc03c8
Remove unneeded import.
maleadt Feb 6, 2025
32788fe
Recycle workers after messing with the device.
maleadt Feb 6, 2025
2ebbadb
Remove unneeded import.
maleadt Feb 6, 2025
f58c491
Re-enable mixed precision GEMM test.
maleadt Feb 6, 2025
dda04b4
Simplify using CuRef getindex method.
maleadt Feb 6, 2025
ecf57c7
Fix new wrappers.
maleadt Feb 6, 2025
f0be27f
Re-enable test.
maleadt Feb 6, 2025
6bb7f86
Restore grouped batched gemm functionality.
maleadt Feb 6, 2025
252cfe6
More fixes.
maleadt Feb 6, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions lib/cublas/CUBLAS.jl
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -104,6 +104,7 @@ function handle()
end

cublasSetStream_v2(new_handle, cuda.stream)
cublasSetPointerMode_v2(new_handle, CUBLAS_POINTER_MODE_DEVICE)
math_mode!(new_handle, cuda.math_mode)

(; handle=new_handle, cuda.stream, cuda.math_mode)
Expand Down
1,204 changes: 602 additions & 602 deletions lib/cublas/libcublas.jl
View file
Open in desktop

Large diffs are not rendered by default.

Loading
Loading