Commit a876ed4
committed
Migrate _binaries and _utils path handling to pathlib
Part 3 of the series proposed in #2410.
_binaries/find_nvidia_binary_utility.py now works in Path internally:
_is_executable_candidate, _ctk_bin_subdirs and _resolve_in_trusted_dirs take
and return Path. str() is applied once, on the public return of
find_nvidia_binary_utility(), which is unchanged.
SITE_PACKAGES_BINDIRS holds path components instead of joined strings. The
caller immediately did sub_dir.split(os.sep) to undo the join, and
find_sub_dirs_all_sitepackages wants components anyway.
find_sub_dirs_no_cache walks in Path. Its return type stays list[str]:
_binaries, _dynamic_libs, _headers and _static_libs all consume it, so
flipping it is better done on its own once those have moved.
Its directory test goes through a small _is_dir() helper rather than calling
Path.is_dir() directly. The two are not interchangeable here: os.path.isdir()
returns False for any stat error, while Path.is_dir() only swallows the errnos
in pathlib's ignore list and propagates the rest. This function walks
site-packages trees that nobody here controls, so a single unreadable
directory would have turned a clean "not found" into a PermissionError.
_utils/env_vars.py uses Path.exists/Path.samefile. Both calls are already
inside the existing try/except OSError, so the same error-handling difference
does not apply. os.path.normcase and os.path.normpath stay in _paths_differ:
PurePath does not collapse "..", which test_paths_differ_text_only depends on,
and Path.resolve() would also follow symlinks. os.path.abspath likewise stays
in _resolve_in_trusted_dirs, since Path.absolute() does not normalize.
test_find_nvidia_binaries.py moves with the module: it asserts on the exact
values passed to and returned by these private helpers, so it cannot be
separated from the signature change.
Verified by differential fuzzing of find_sub_dirs_no_cache against the
previous implementation: 3000 calls over randomized trees comparing result
order, plus 720 calls over trees containing unreadable directories. Identical,
except that a parent dir spelled with redundant separators now yields the
normalized form.
Signed-off-by: LeSingh1 <sshaurya914@gmail.com>1 parent 29acb74 commit a876ed4
5 files changed
Lines changed: 142 additions & 119 deletions
File tree
- cuda_pathfinder
- cuda/pathfinder
- _binaries
- _utils
- tests
Lines changed: 27 additions & 24 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
| 8 | + | |
8 | 9 | | |
9 | 10 | | |
10 | 11 | | |
| |||
44 | 45 | | |
45 | 46 | | |
46 | 47 | | |
47 | | - | |
48 | | - | |
| 48 | + | |
| 49 | + | |
49 | 50 | | |
50 | 51 | | |
51 | 52 | | |
| 53 | + | |
52 | 54 | | |
53 | 55 | | |
54 | 56 | | |
55 | | - | |
| 57 | + | |
56 | 58 | | |
57 | 59 | | |
58 | | - | |
59 | | - | |
60 | | - | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
61 | 63 | | |
62 | | - | |
| 64 | + | |
63 | 65 | | |
64 | 66 | | |
65 | 67 | | |
| |||
69 | 71 | | |
70 | 72 | | |
71 | 73 | | |
72 | | - | |
| 74 | + | |
73 | 75 | | |
74 | 76 | | |
75 | 77 | | |
| |||
145 | 147 | | |
146 | 148 | | |
147 | 149 | | |
148 | | - | |
| 150 | + | |
149 | 151 | | |
150 | | - | |
| 152 | + | |
151 | 153 | | |
152 | 154 | | |
153 | 155 | | |
154 | | - | |
| 156 | + | |
| 157 | + | |
155 | 158 | | |
156 | | - | |
| 159 | + | |
157 | 160 | | |
158 | 161 | | |
159 | | - | |
| 162 | + | |
| 163 | + | |
| 164 | + | |
160 | 165 | | |
161 | 166 | | |
162 | 167 | | |
163 | 168 | | |
164 | | - | |
| 169 | + | |
165 | 170 | | |
166 | | - | |
| 171 | + | |
167 | 172 | | |
168 | 173 | | |
169 | 174 | | |
170 | | - | |
| 175 | + | |
171 | 176 | | |
172 | | - | |
| 177 | + | |
173 | 178 | | |
174 | 179 | | |
175 | 180 | | |
| |||
263 | 268 | | |
264 | 269 | | |
265 | 270 | | |
266 | | - | |
| 271 | + | |
267 | 272 | | |
268 | 273 | | |
269 | | - | |
| 274 | + | |
270 | 275 | | |
271 | 276 | | |
272 | 277 | | |
273 | | - | |
274 | | - | |
275 | | - | |
276 | | - | |
| 278 | + | |
| 279 | + | |
277 | 280 | | |
278 | 281 | | |
279 | 282 | | |
| |||
305 | 308 | | |
306 | 309 | | |
307 | 310 | | |
308 | | - | |
| 311 | + | |
309 | 312 | | |
Lines changed: 6 additions & 6 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
4 | 3 | | |
5 | 4 | | |
6 | | - | |
7 | | - | |
8 | | - | |
9 | | - | |
10 | | - | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
22 | 22 | | |
23 | 23 | | |
24 | 24 | | |
| 25 | + | |
25 | 26 | | |
26 | 27 | | |
27 | 28 | | |
| |||
36 | 37 | | |
37 | 38 | | |
38 | 39 | | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
39 | 43 | | |
40 | 44 | | |
41 | 45 | | |
42 | 46 | | |
43 | 47 | | |
| 48 | + | |
44 | 49 | | |
45 | | - | |
| 50 | + | |
46 | 51 | | |
47 | | - | |
| 52 | + | |
48 | 53 | | |
49 | 54 | | |
50 | 55 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
5 | | - | |
6 | 5 | | |
7 | 6 | | |
8 | 7 | | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
9 | 23 | | |
10 | 24 | | |
11 | 25 | | |
| 26 | + | |
| 27 | + | |
12 | 28 | | |
13 | 29 | | |
14 | | - | |
| 30 | + | |
15 | 31 | | |
16 | 32 | | |
17 | 33 | | |
18 | | - | |
19 | | - | |
| 34 | + | |
| 35 | + | |
20 | 36 | | |
21 | 37 | | |
22 | 38 | | |
23 | 39 | | |
24 | 40 | | |
25 | | - | |
| 41 | + | |
26 | 42 | | |
27 | 43 | | |
28 | | - | |
29 | | - | |
30 | | - | |
| 44 | + | |
| 45 | + | |
31 | 46 | | |
32 | 47 | | |
33 | | - | |
34 | | - | |
| 48 | + | |
| 49 | + | |
35 | 50 | | |
36 | 51 | | |
37 | 52 | | |
| |||
0 commit comments