Add progress tracker for identifying source files

If a source directory contains many files (e.g., because a build directory was
accidentally included) it can take a long time to identify the source files in
the code base. This commit adds a progress tracker with tqdm to make it clear
that CBI is doing something and hasn't just stalled.

We don't get a progress bar, because the number of files in the code base is
not known a priori, but tqdm will print the number of files found so far.

Signed-off-by: John Pennycook <[email protected]>

Author: Pennycook

codebasin/finder.py

@@ -163,12 +163,22 @@ def find(
     if isinstance(rootdir, Path):
         rootdir = str(rootdir)
 
-    # Build a tree for each unique file for all platforms.
-    state = ParserState(summarize_only)
-    filenames = set(codebase)
+    # Identify all of the files in the codebase.
+    filenames = set()
+    for f in tqdm(
+        codebase,
+        desc="Identifying source files",
+        unit=" files",
+        leave=False,
+        disable=not show_progress,
+    ):
+        filenames.add(f)
     for p in configuration:
         for e in configuration[p]:
             filenames.add(e["file"])
+
+    # Build a tree for each unique file for all platforms.
+    state = ParserState(summarize_only)
     for f in tqdm(
         filenames,
         desc="Parsing",