Commit ccb957b
committed
Migrate _binaries and _utils path handling to pathlib
Part 3 of the series proposed in #2410.
_binaries/find_nvidia_binary_utility.py now works in Path internally:
_is_executable_candidate, _ctk_bin_subdirs and _resolve_in_trusted_dirs take
and return Path. str() is applied once, on the public return of
find_nvidia_binary_utility(), which is unchanged.
SITE_PACKAGES_BINDIRS holds path components instead of joined strings. The
caller immediately did sub_dir.split(os.sep) to undo the join, and
find_sub_dirs_all_sitepackages wants components anyway.
find_sub_dirs_no_cache walks in Path. Its return type stays list[str]:
_binaries, _dynamic_libs, _headers and _static_libs all consume it, so
flipping it is better done on its own once those have moved.
Its directory test goes through a small _is_dir() helper rather than calling
Path.is_dir() directly. The two are not interchangeable here: os.path.isdir()
returns False for any stat error, while Path.is_dir() only swallows the errnos
in pathlib's ignore list and propagates the rest. This function walks
site-packages trees that nobody here controls, so a single unreadable
directory would have turned a clean "not found" into a PermissionError.
_utils/env_vars.py uses Path.exists/Path.samefile. Both calls are already
inside the existing try/except OSError, so the same error-handling difference
does not apply. os.path.normcase and os.path.normpath stay in _paths_differ:
PurePath does not collapse "..", which test_paths_differ_text_only depends on,
and Path.resolve() would also follow symlinks. os.path.abspath likewise stays
in _resolve_in_trusted_dirs, since Path.absolute() does not normalize.
test_find_nvidia_binaries.py moves with the module: it asserts on the exact
values passed to and returned by these private helpers, so it cannot be
separated from the signature change.
Verified by differential fuzzing of find_sub_dirs_no_cache against the
previous implementation: 3000 calls over randomized trees comparing result
order, plus 720 calls over trees containing unreadable directories. Identical,
except that a parent dir spelled with redundant separators now yields the
normalized form.
Signed-off-by: LeSingh1 <sshaurya914@gmail.com>1 parent e0a2d1a commit ccb957b
5 files changed
Lines changed: 142 additions & 119 deletions
File tree
- cuda_pathfinder
- cuda/pathfinder
- _binaries
- _utils
- tests
Lines changed: 27 additions & 24 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| 7 | + | |
7 | 8 | | |
8 | 9 | | |
9 | 10 | | |
| |||
29 | 30 | | |
30 | 31 | | |
31 | 32 | | |
32 | | - | |
33 | | - | |
| 33 | + | |
| 34 | + | |
34 | 35 | | |
35 | 36 | | |
36 | 37 | | |
| 38 | + | |
37 | 39 | | |
38 | 40 | | |
39 | 41 | | |
40 | | - | |
| 42 | + | |
41 | 43 | | |
42 | 44 | | |
43 | | - | |
44 | | - | |
45 | | - | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
46 | 48 | | |
47 | | - | |
| 49 | + | |
48 | 50 | | |
49 | 51 | | |
50 | 52 | | |
| |||
54 | 56 | | |
55 | 57 | | |
56 | 58 | | |
57 | | - | |
| 59 | + | |
58 | 60 | | |
59 | 61 | | |
60 | 62 | | |
| |||
75 | 77 | | |
76 | 78 | | |
77 | 79 | | |
78 | | - | |
| 80 | + | |
79 | 81 | | |
80 | | - | |
| 82 | + | |
81 | 83 | | |
82 | 84 | | |
83 | 85 | | |
84 | | - | |
| 86 | + | |
| 87 | + | |
85 | 88 | | |
86 | | - | |
| 89 | + | |
87 | 90 | | |
88 | 91 | | |
89 | | - | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
90 | 95 | | |
91 | 96 | | |
92 | 97 | | |
93 | 98 | | |
94 | | - | |
| 99 | + | |
95 | 100 | | |
96 | | - | |
| 101 | + | |
97 | 102 | | |
98 | 103 | | |
99 | 104 | | |
100 | | - | |
| 105 | + | |
101 | 106 | | |
102 | | - | |
| 107 | + | |
103 | 108 | | |
104 | 109 | | |
105 | 110 | | |
| |||
193 | 198 | | |
194 | 199 | | |
195 | 200 | | |
196 | | - | |
| 201 | + | |
197 | 202 | | |
198 | 203 | | |
199 | | - | |
| 204 | + | |
200 | 205 | | |
201 | 206 | | |
202 | 207 | | |
203 | | - | |
204 | | - | |
205 | | - | |
206 | | - | |
| 208 | + | |
| 209 | + | |
207 | 210 | | |
208 | 211 | | |
209 | 212 | | |
| |||
235 | 238 | | |
236 | 239 | | |
237 | 240 | | |
238 | | - | |
| 241 | + | |
239 | 242 | | |
Lines changed: 6 additions & 6 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
4 | 3 | | |
5 | 4 | | |
6 | | - | |
7 | | - | |
8 | | - | |
9 | | - | |
10 | | - | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
22 | 22 | | |
23 | 23 | | |
24 | 24 | | |
| 25 | + | |
25 | 26 | | |
26 | 27 | | |
27 | 28 | | |
| |||
36 | 37 | | |
37 | 38 | | |
38 | 39 | | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
39 | 43 | | |
40 | 44 | | |
41 | 45 | | |
42 | 46 | | |
43 | 47 | | |
| 48 | + | |
44 | 49 | | |
45 | | - | |
| 50 | + | |
46 | 51 | | |
47 | | - | |
| 52 | + | |
48 | 53 | | |
49 | 54 | | |
50 | 55 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
5 | | - | |
6 | 5 | | |
7 | 6 | | |
8 | 7 | | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
9 | 23 | | |
10 | 24 | | |
11 | 25 | | |
| 26 | + | |
| 27 | + | |
12 | 28 | | |
13 | 29 | | |
14 | | - | |
| 30 | + | |
15 | 31 | | |
16 | 32 | | |
17 | 33 | | |
18 | | - | |
19 | | - | |
| 34 | + | |
| 35 | + | |
20 | 36 | | |
21 | 37 | | |
22 | 38 | | |
23 | 39 | | |
24 | 40 | | |
25 | | - | |
| 41 | + | |
26 | 42 | | |
27 | 43 | | |
28 | | - | |
29 | | - | |
30 | | - | |
| 44 | + | |
| 45 | + | |
31 | 46 | | |
32 | 47 | | |
33 | | - | |
34 | | - | |
| 48 | + | |
| 49 | + | |
35 | 50 | | |
36 | 51 | | |
37 | 52 | | |
| |||
0 commit comments