Skip to content

Updating retry logic for API requests #600

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
scorreard wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Updating retry logic for API requests #600

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
a97da58
Update retry logic in get_request_json function
scorreard Feb 10, 2026
ba62831
Modify retry delay in message
scorreard Feb 10, 2026
3661d51
linting
scorreard Feb 10, 2026
e40e014
Merge branch 'main' into scorreard_citation_API_issue
scorreard Feb 19, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions sources/bin/shared.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -111,14 +111,14 @@ def read_suite_per_tool_id(tool_fp: str) -> Dict:
return tools


def get_request_json(url: str, headers: dict, retries: int = 3, delay: float = 2.0) -> dict:
def get_request_json(url: str, headers: dict, retries: int = 7, delay: float = 2.0) -> dict:
"""
Perform a GET request to retrieve JSON output from a specified URL, with retry on ConnectionError.

:param url: URL to send the GET request to.
:param headers: Headers to include in the GET request.
:param retries: Number of retry attempts in case of a ConnectionError (default is 3).
:param delay: Delay in seconds between retries (default is 2.0 seconds).
:param retries: Number of retry attempts in case of a ConnectionError (default is 7).
:param delay: Delay in seconds between retries (default is 2.0 seconds), now multiplied by the number of attempt to increase delay as number of attempt increases.
:return: JSON response as a dictionary, or None if all retries fail.
:raises ConnectionError: If all retry attempts fail due to a connection error.
:raises SystemExit: For any other request-related errors.
Expand All @@ -136,8 +136,8 @@ def get_request_json(url: str, headers: dict, retries: int = 3, delay: float = 2
raise ConnectionError(
"Connection aborted after multiple retries: Remote end closed connection without response"
) from e
print(f"Connection error on attempt {attempt}/{retries}. Retrying in {delay} seconds...")
time.sleep(delay) # Wait before retrying
print(f"Connection error on attempt {attempt}/{retries}. Retrying in {delay**attempt} seconds...")
time.sleep(delay**attempt) # Wait before retrying, wait time increases as number of attempt increases
except requests.exceptions.RequestException as e:
# Handles all other exceptions from the requests library
raise SystemExit(f"Request failed: {e}")
Expand Down