Skip to content

Commit 6e9d7b3

Browse files
committed
docs(athena): explain why SparkConnectSessionPool is a singleton
1 parent aed1178 commit 6e9d7b3

1 file changed

Lines changed: 6 additions & 1 deletion

File tree

  • dbt-athena/src/dbt/adapters/athena/spark_connect

dbt-athena/src/dbt/adapters/athena/spark_connect/session.py

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,12 @@ class _GlobalSessionLimitReached(Exception):
2626

2727

2828
class SparkConnectSessionPool:
29-
"""Singleton pool of Athena Spark Connect sessions."""
29+
"""Singleton pool of Athena Spark Connect sessions.
30+
31+
Singleton so dbt Cloud's long-lived process can share sessions across
32+
invocations; ``(invocation_id, fingerprint)`` keying keeps each
33+
invocation logically isolated within the shared registry.
34+
"""
3035

3136
_instance: Optional["SparkConnectSessionPool"] = None
3237
_singleton_lock = threading.Lock()

0 commit comments

Comments
 (0)