fix: improve storage-initializer error messages (kserve#5016)

Signed-off-by: Milind Waykole <mwaykole@redhat.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Jooho Lee <jlee@redhat.com>
Co-authored-by: Sivanantham <90966311+sivanantha321@users.noreply.github.com>

Author: 4 people

python/storage-initializer/scripts/initializer-entrypoint

@@ -8,10 +8,18 @@ configure_logging()
 
 if len(sys.argv) < 3 or len(sys.argv) % 2 != 1:
     print("Usage: initializer-entrypoint src_uri_0 dest_path_0 ... src_uri_n dest_path_n")
-    sys.exit()
+    sys.exit(1)
 
 src_uris = sys.argv[1::2]
 dest_paths = sys.argv[2::2]
 
-logger.info(f"Initializing, args: (src_uri, dest_path): {[(src_uri, dest_path) for src_uri, dest_path in zip(src_uris, dest_paths)]}")
-Storage.download_files(src_uris, dest_paths)
+logger.info("Initializing, args: (src_uri, dest_path): %s", list(zip(src_uris, dest_paths)))
+
+try:
+    Storage.download_files(src_uris, dest_paths)
+except RuntimeError as e:
+    logger.error("Storage initialization failed: %s", e)
+    sys.exit(1)
+except Exception as e:
+    logger.error("Unexpected error during storage initialization: %s", e)
+    sys.exit(1)

python/storage/README.md

@@ -115,7 +115,10 @@ These are all handled by the `huggingface_hub` package, you can see all the avai
 - `S3_VERIFY_SSL`: Enable/disable SSL verification
 - `S3_USER_VIRTUAL_BUCKET`: Use virtual hosted-style URLs
 - `S3_USE_ACCELERATE`: Use transfer acceleration
-- `S3_MAX_FILE_CONCURRENCY`: number of files to download parallel
+- `S3_MAX_FILE_CONCURRENCY`: Number of files to download in parallel
+- `S3_CONNECT_TIMEOUT`: Connection timeout in seconds (default: 15)
+- `S3_READ_TIMEOUT`: Read timeout in seconds (default: 30)
+- `S3_MAX_ATTEMPTS`: Maximum retry attempts for S3 operations (default: 3)
 - `awsAnonymousCredential`: Use unsigned requests for public access
 
 ### Azure Configuration