feat: add Cursor.new() method and notebook improvements

- Add Cursor.new() method for creating fresh conversation threads
- Fix DatabricksAgent empty text elements issue  
- Add notebook build utilities and improve cleaning scripts
- Update vibes tutorial notebook with lui.new() pattern
- Improve pre-commit hook to recognize redaction patterns

Author: lmeyerov

.github/workflows/ci.yml

@@ -5,6 +5,10 @@ on:
   pull_request:
     types: [opened, synchronize, reopened]
 
+concurrency:
+  group: ${{ github.workflow }}-${{ github.ref }}
+  cancel-in-progress: true
+
 jobs:
   # Stage 1: Quick quality checks (fail fast on basic issues)
   quality-checks:
@@ -30,11 +34,35 @@ jobs:
       - name: Type Check (mypy)
         run: uv run mypy .
 
-  # Stage 2: Unit tests (only run if quality checks pass)
+  # Stage 2: Light smoke test (quick test run before full matrix)
+  light-smoke-test:
+    runs-on: ubuntu-latest
+    timeout-minutes: 5
+    needs: quality-checks
+    steps:
+      - uses: actions/checkout@v3
+      - uses: actions/setup-python@v4
+        with:
+          python-version: "3.12"
+      - name: Install uv
+        run: |
+          curl -LsSf https://astral.sh/uv/install.sh | sh
+          echo "$HOME/.cargo/bin" >> $GITHUB_PATH
+      - name: Install dependencies
+        run: |
+          uv venv --python python3.12
+          uv pip install -e ".[dev]"
+      - name: Run basic smoke tests
+        run: |
+          # Run only critical tests to quickly catch obvious failures
+          source .venv/bin/activate
+          python -m pytest tests/unit/test_imports.py tests/unit/test_louie_factory.py -v --tb=short
+
+  # Stage 3: Unit tests (only run if smoke test passes)
   unit-tests:
     runs-on: ubuntu-latest
     timeout-minutes: 10
-    needs: quality-checks
+    needs: [quality-checks, light-smoke-test]
     strategy:
       matrix:
         python-version: ["3.10", "3.11", "3.12", "3.13"]
@@ -64,7 +92,7 @@ jobs:
           name: Unit Tests
           fail_ci_if_error: false  # Don't fail if Codecov is down
 
-  # Stage 3: Integration tests (conditional on credentials)
+  # Stage 4: Integration tests (conditional on credentials)
   integration-tests:
     runs-on: ubuntu-latest
     timeout-minutes: 10
@@ -108,7 +136,7 @@ jobs:
           name: Integration Tests
           fail_ci_if_error: false
 
-  # Stage 4: Documentation tests (can run in parallel with other tests)
+  # Stage 5: Documentation tests (can run in parallel with other tests)
   docs-test:
     runs-on: ubuntu-latest
     timeout-minutes: 10
@@ -149,7 +177,7 @@ jobs:
           test -f site/assets/louie-logo.png || (echo "❌ Logo not found in built docs" && exit 1)
           echo "✅ Logo included in documentation"
 
-  # Stage 5: Build and installation tests (only if unit tests pass)
+  # Stage 6: Build and installation tests (only if unit tests pass)
   install-test:
     runs-on: ubuntu-latest
     timeout-minutes: 10
@@ -196,7 +224,7 @@ jobs:
   # Final summary job (for branch protection rules)
   ci-success:
     runs-on: ubuntu-latest
-    needs: [quality-checks, unit-tests, docs-test, install-test]
+    needs: [quality-checks, light-smoke-test, unit-tests, docs-test, install-test]
     # Note: integration-tests is not required since it's conditional
     if: always()
     steps:

.gitsecret-whitelist

@@ -14,3 +14,4 @@ README.md
 config.template.json
 .env.examplesrc/louieai/_client.py
 docs/getting-started/notebooks/*.ipynb
+src/louieai/__init__.py

README.md

@@ -6,6 +6,14 @@
 
 AI-powered investigation platform for natural language data analysis.
 
+
+
+https://github.com/user-attachments/assets/de73f7b3-2862-4298-b9d8-2d38426ab255
+
+[Video: Louie <> Graphistry - Python edition!](https://www.loom.com/share/8d84c9abc0e34df6b233bd7b2e10af9a?sid=4a87707a-79e6-416b-a628-01b5c31c7db3)
+
+
+
 ## 🚀 Get Started in 30 Seconds
 
 ```python
@@ -139,4 +147,4 @@ We welcome contributions! See [CONTRIBUTING.md](CONTRIBUTING.md) for guidelines.
 
 ## License
 
-Apache 2.0 - see [LICENSE](LICENSE)
+Apache 2.0 - see [LICENSE](LICENSE)

docs/api/notebook.md

@@ -30,7 +30,7 @@ The cleanest import method - make the module itself callable:
 import louieai
 
 # Create authenticated instance
-lui = louieai(username="user", password="pass")
+lui = louieai(username="user", password="<password>")
 # Or with existing PyGraphistry client
 lui = louieai(g)
 
@@ -271,7 +271,7 @@ cursor = louie()
 
 # Create cursor with PyGraphistry client
 import graphistry
-g = graphistry.register(api=3, username="user", password="pass")
+g = graphistry.register(api=3, username="user", password="<password>")
 cursor = louie(g)
 
 # Create cursor with personal key authentication
@@ -284,11 +284,50 @@ cursor = louie(
 # Create cursor with API key
 cursor = louie(api_key="your_api_key")
 
+# Create cursor with thread name and share mode
+cursor = louie(name="Security Analysis", share_mode="Organization")
+
 # Use any cursor
 cursor("Your query here")
 print(cursor.text)
 ```
 
+### Creating New Conversation Threads
+
+The `new()` method allows you to create fresh conversation threads while preserving all authentication and configuration:
+
+```python
+# Start with your main analysis
+lui = louie()
+lui("Analyze security incidents from last week")
+
+# Create a new thread for a different topic
+perf_analysis = lui.new(name="Performance Analysis")
+perf_analysis("Show me API response times")
+
+# Create another thread with different visibility
+private_investigation = lui.new(
+    name="Sensitive Investigation",
+    share_mode="Private"
+)
+private_investigation("Investigate user account anomalies")
+
+# Original thread is unchanged
+lui("Continue with security analysis...")  # Still in original thread
+```
+
+**Key features of `new()`:**
+- **Preserves all configuration**: Authentication, server URLs, timeouts
+- **Fresh context**: Each new thread starts without previous conversation history
+- **Optional naming**: Provide meaningful names to organize your analyses
+- **Share mode control**: Override visibility per thread (Private, Organization, Public)
+
+**Common use cases:**
+1. **Organize by topic**: Separate threads for security, performance, business analysis
+2. **Isolate investigations**: Keep sensitive queries in private threads
+3. **Parallel analysis**: Run different analyses without context confusion
+4. **Clean slate**: Start fresh when switching to unrelated topics
+
 ### Custom Client Configuration
 
 For more control, you can create a client directly:
@@ -310,7 +349,7 @@ client = LouieClient(
 client = LouieClient(
     server_url="https://custom.louie.ai",
     username="user",
-    password="pass"
+    password="<password>"
 )
 
 # Create cursor with custom client
@@ -350,11 +389,11 @@ lui = louie()
 # 2. From existing PyGraphistry client
 import graphistry
 gc = graphistry.client()
-gc.register(api=3, username="user", password="pass")
+gc.register(api=3, username="user", password="<password>")
 lui = louie(gc)
 
 # 3. With direct credentials
-lui = louie(username="user", password="pass")
+lui = louie(username="user", password="<password>")
 lui = louie(personal_key_id="pk_123", personal_key_secret="sk_456")
 lui = louie(api_key="your_api_key")