Regression Failure: OPS | C2264134019-GES_DISC | GPM_2AGPROFF16SSMIS_CLIM

[github-actions]

Updated: 2026-08-10 10:37:17 UTC

Job Run: https://github.com/podaac/l2ss-py-autotest/actions/runs/31370375753/job/93397806849

Regression Failures:

Concept ID: C2264134019-GES_DISC | Short Name: GPM_2AGPROFF16SSMIS_CLIM | Test Type: temporal

Error Message:

[gw0] linux -- Python 3.12.13 /home/runner/.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/bin/python
/opt/hostedtoolcache/Python/3.12.13/x64/lib/python3.12/ssl.py:992: in _create
    self.getpeername()
E   OSError: [Errno 107] Transport endpoint is not connected

During handling of the above exception, another exception occurred:
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/connectionpool.py:788: in urlopen
    response = self._make_request(
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/connectionpool.py:488: in _make_request
    raise new_e
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/connectionpool.py:464: in _make_request
    self._validate_conn(conn)
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/connectionpool.py:1106: in _validate_conn
    conn.connect()
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/connection.py:796: in connect
    sock_and_verified = _ssl_wrap_socket_and_match_hostname(
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/connection.py:975: in _ssl_wrap_socket_and_match_hostname
    ssl_sock = ssl_wrap_socket(
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/util/ssl_.py:433: in ssl_wrap_socket
    ssl_sock = _ssl_wrap_socket_impl(sock, context, tls_in_tls, server_hostname)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/util/ssl_.py:477: in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
/opt/hostedtoolcache/Python/3.12.13/x64/lib/python3.12/ssl.py:455: in wrap_socket
    return self.sslsocket_class._create(
/opt/hostedtoolcache/Python/3.12.13/x64/lib/python3.12/ssl.py:1004: in _create
    notconn_pre_handshake_data = self.recv(1)
                                 ^^^^^^^^^^^^
/opt/hostedtoolcache/Python/3.12.13/x64/lib/python3.12/ssl.py:1234: in recv
... (truncated) ...

Summary:

OSError: [Errno 107] Transport endpoint is not connected during SSL handshake, indicating the socket
was not connected before the handshake, often due to network interruptions, server closure, or
incorrect endpoint configuration.

Suggested Solution:

1. Verify network connectivity between the test runner and the Harmony endpoint. 2. Check firewall
rules and ensure outbound HTTPS traffic is allowed. 3. Confirm the target URL and port are correct
and reachable. 4. Implement retry logic with exponential backoff for transient connection failures.
5. Monitor server status and logs for early closure or overload indications.

Concept ID: C2264134019-GES_DISC | Short Name: GPM_2AGPROFF16SSMIS_CLIM | Test Type: spatial

Error Message:

[gw1] linux -- Python 3.12.13 /home/runner/.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/bin/python
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/connectionpool.py:788: in urlopen
    response = self._make_request(
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/connectionpool.py:488: in _make_request
    raise new_e
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/connectionpool.py:464: in _make_request
    self._validate_conn(conn)
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/connectionpool.py:1106: in _validate_conn
    conn.connect()
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/connection.py:796: in connect
    sock_and_verified = _ssl_wrap_socket_and_match_hostname(
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/connection.py:975: in _ssl_wrap_socket_and_match_hostname
    ssl_sock = ssl_wrap_socket(
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/util/ssl_.py:433: in ssl_wrap_socket
    ssl_sock = _ssl_wrap_socket_impl(sock, context, tls_in_tls, server_hostname)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/urllib3/util/ssl_.py:477: in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
/opt/hostedtoolcache/Python/3.12.13/x64/lib/python3.12/ssl.py:455: in wrap_socket
    return self.sslsocket_class._create(
/opt/hostedtoolcache/Python/3.12.13/x64/lib/python3.12/ssl.py:1041: in _create
    self.do_handshake()
/opt/hostedtoolcache/Python/3.12.13/x64/lib/python3.12/ssl.py:1319: in do_handshake
    self._sslobj.do_handshake()
E   ConnectionResetError: [Errno 104] Connection reset by peer

During handling of the above exception, another exception occurred:
../../../../.cache/pypoetry/virtualenvs/l2ss-py-autotest-iYz8Sff2-py3.12/lib/python3.12/site-packages/requests/adapters.py:644: in send
    resp = conn.urlopen(
... (truncated) ...

Summary:

ProcessingFailedException: WorkItem failed: podaac/l2ss-py:3.3.2: Service failed due to running out
of memory

Suggested Solution:

1. Increase allocated memory or memory limits for the service. 2. Reduce input data size or job
complexity. 3. Optimize processing steps to lower memory usage. 4. Add retry logic with exponential
backoff for transient OOM failures. 5. Monitor service resource usage and scale resources if needed.