Merge development into main: daemon IPC, installer refactor, i18n, and uv-ffi healing

✨ Features:
  * feat(i18n): per-language help routing and fast-path string micro-optimizations (8ef5cf2)
      - Implement is_help_flag and is_version_flag in the C dispatcher using uint64_t
      word loads to optimize string comparison for '--help' and '--version' flags.
      - Check for a lightweight marker file (~/.config/omnipkg/lang_marker_en) in both
      the C dispatcher and dispatcher.py to decide when to instantly serve the
      baked English help text.
      - Fall back to Python argparse for non-English locales to correctly serve fully
      translated subcommand lists and argument menus.
      - Restore translated argument descriptions (removed argparse.SUPPRESS) across
      all subcommands so localized menus render properly on fallback.
      - Update .bashrc and .zshrc with OMNIPKG_LANG when the language is changed via
      the config menu to keep settings persistent.
      - Ensure i18n.py and worker_daemon.py read the config file directly during early
      initialization so language variables are set before ConfigManager starts.
      Modified:
      • src/omnipkg/cli.py (+296/-216 lines)
      • src/omnipkg/dispatcher.c (+44/-8 lines)
      • src/omnipkg/dispatcher.py (+11/-3 lines)
      • src/omnipkg/i18n.py (+11/-1 lines)
      • src/omnipkg/isolation/worker_daemon.py (+7/-1 lines)
  * feat(daemon): add Torch MP Queue IPC fallback and interactive idle policy (290da0e)
      - Implemented  fallback for Turing/CUDA 13 GPUs where  is broken.
      -  now correctly uses  for true zero-copy.
      - Upgraded resource monitor with interactive TUI (, ).
      - Users can now configure persistent idle-worker policies directly from the CLI.
  * feat(abi): implement ELF parsing for NumPy C-API resolution (11a4500)
      -  now parses  ELF sections to extract .
      - Added  and  to the Knowledge Base.
      - Loader now injects correct NumPy ABI bubble paths before PyTorch/TensorFlow initialization.
      - Added  injection to sterile environments to fix Torch import verification.
  * refactor(core): decouple installers and implement atomic stash-swaps (2c9a2fd)
      - Extracted monolithic install logic into  and .
      - Implemented staircase dispatch: FFI → Daemon IPC → subprocess uv → pip.
      - Added : atomically renames current packages to protect them during uv installs, eliminating the need to rebuild bubbles from scratch.
      - Updated  contract to support atomic plan callback interception.
  * feat(cli): implement zero-overhead help system and C-dispatcher fast paths (eae5bcb)
      - Extracted help text into  and compiled directly into .
      - C dispatcher now intercepts  and  instantly (0ms startup).
      - Refactored  to use normalized arguments and pre-rendered help strings.
      - Added  utility and normalized  handling.

🐛 Fixes:
  * fix: fix safe print usage in dispatcher.py (8dc66ab)
      Modified:
      • src/omnipkg/dispatcher.py (+104/-104 lines)
  * fix: resolve translation shadowing, standardize safe_print, and refactor tests (d5b0642)
      - Replaced tuple unpacking dummy variables (`_`) with `unused` globally to prevent shadowing the `_` gettext translation function.
      - Swapped standard `print()` calls for `safe_print()` in the core, dispatcher, and tests to prevent UnicodeEncodeErrors on strict terminals and Windows.
      - Refactored `test_verify_bubble_deps.py` into an OOP `KBSyncVerifier` class with bi-directional (DB ↔ Disk) symmetry checks.
      - Relocated FFI and diagnostic tests (`diag_uv_ffi.py`, `test_uv_ffi_contracts.py`) to the root `tests/` directory and fixed linter-induced AttributeErrors.
      - Added the "Daemon IPC Showcase" (Option 11) to the interactive `8pkg demo` CLI menu.
      - Enhanced the daemon worker pre-warm logic to accurately detect and strip framework (torch/tensorflow) site-packages from the bubble path.
      - Registered the `integration` pytest marker in `pytest.ini`.
      New files:
      • tests/diag_uv_ffi.py (425 lines)
      • tests/test_uv_ffi_contracts.py (793 lines)
      Modified:
      • build_hooks.py (+1/-1 lines)
      • src/omnipkg/cli.py (+4/-2 lines)
      • src/omnipkg/core.py (+2/-2 lines)
      • src/omnipkg/dispatcher.py (+34/-34 lines)
      • src/omnipkg/installation/installers.py (+4/-4 lines)
      • src/omnipkg/installation/smart_install.py (+3/-3 lines)
      • src/omnipkg/integration/reproducible.py (+44/-40 lines)
      • src/omnipkg/isolation/fs_lock_queue.py (+1/-1 lines)
      • src/omnipkg/isolation/fs_watcher.py (+7/-7 lines)
      • src/omnipkg/isolation/resource_monitor.py (+7/-7 lines)
      • src/omnipkg/isolation/worker_daemon.py (+17/-4 lines)
      • src/omnipkg/package_meta_builder.py (+10/-10 lines)
      • src/omnipkg/windows_bootstrap/launcher.py (+1/-1 lines)
      • setup.py (+4/-4 lines)
      • pytest.ini (+1/-0 lines)
      • src/omnipkg/tests/omnipkg_ipc_showcase.py (+22/-17 lines)
      • src/omnipkg/tests/test_concurrent_install.py (+2/-2 lines)
      • src/omnipkg/tests/test_daemon_tags.py (+22/-18 lines)
      • src/omnipkg/tests/test_loader_stress_test.py (+1/-1 lines)
      • src/omnipkg/tests/test_old_rich.py (+1/-1 lines)
      • src/omnipkg/tests/test_rich_switching.py (+3/-3 lines)
      • src/omnipkg/tests/test_tensorflow_switching.py (+1/-1 lines)
      • tests/test_dispatcher_contracts.py (+1/-1 lines)
      • tests/test_ffi_verify.py (+13/-9 lines)
      • tests/test_flask_port_finder.py (+9/-9 lines)
      • tests/test_omnipkg_contracts.py (+11/-11 lines)
      • tests/test_verify_bubble_deps.py (+117/-179 lines)
  * fix(windows): guard fcntl usage behind platform checks (5855d88)
      - core.py: lazy import now branches to msvcrt on win32
      - smart_install.py: _BubbleLock uses msvcrt.locking on win32, fcntl on POSIX
      - Fixes 'Missing standard library module fcntl' crash on Windows CI
  * fix(heal): target ghost repair directly to main environment (9b1a1c0)
      -  now checks physical site-packages paths, bypassing bubble pollution.
      -  now forces  strategy during repair.
      - Fixes bug where healed packages were bubbled while broken metadata was restored to main.

📚 Documentation:
  * docs: update ARM32 piwheels stats for v3.3.5 [skip ci] (x8)
  * docs: update ARM32 piwheels stats for v3.3.4 [skip ci] (866196c)

🧪 Tests:
  * test: add IPC showcase and FFI contract diagnostics (c4e98cd)
      - Added  to demonstrate the 'Impossible Pipeline' (zero-copy GPU IPC across Python 3.9/3.10/3.11).
      - Added  to validate stale-dir and ghost-eviction logic.
      - Added  to lock in FFI expected behaviors.
      - Updated  to track planned install files.

📝 Other changes:
  * Update 1 code files (x2)
  * Modify omnipkg info commands for non-interactive mode (5c84b32)
      Updated omnipkg info command to use non-interactive mode for final state verification and TensorFlow import testing.

📊 47 files changed, 9289 insertions(+), 4311 deletions(-)

📁 Detailed file changes:
  Source code:
  • src/omnipkg/core.py: +617 -2044
  • src/omnipkg/installation/smart_install.py: +1305 -1148
  • src/omnipkg/cli.py: +853 -219
  • src/omnipkg/installation/installers.py: +805
  • src/omnipkg/isolation/worker_daemon.py: +535 -118
  • src/omnipkg/help.toml: +440
  • src/omnipkg/isolation/resource_monitor.py: +348 -84
  • src/omnipkg/_help.h: +354
  • src/omnipkg/_help.py: +336
  • src/omnipkg/dispatcher.c: +229 -28
  • src/omnipkg/_vendor/uv_ffi/__init__.py: +204 -46
  • src/omnipkg/dispatcher.py: +144 -106
  • src/omnipkg/commands/run.py: +162 -25
  • src/omnipkg/integration/reproducible.py: +58 -47
  • src/omnipkg/common_utils.py: +41
  • src/omnipkg/installation/verification_strategy.py: +18
  • src/omnipkg/loader.py: +15 -1
  • src/omnipkg/isolation/fs_watcher.py: +7 -7
  • src/omnipkg/i18n.py: +11 -1
  • src/omnipkg/isolation/patchers.py: +7
  • src/omnipkg/_vendor/uv: +1 -1
  • src/omnipkg/isolation/fs_lock_queue.py: +1 -1
  • src/omnipkg/windows_bootstrap/launcher.py: +1 -1

  Tests:
  • src/omnipkg/tests/omnipkg_ipc_showcase.py: +1002
  • tests/test_uv_ffi_contracts.py: +793
  • tests/diag_uv_ffi.py: +425
  • tests/test_verify_bubble_deps.py: +117 -179
  • tests/test_verify_bubble_deps2.py: -127
  • src/omnipkg/tests/test_loader_stress_test.py: +57 -15
  • src/omnipkg/tests/test_daemon_tags.py: +22 -18
  • tests/test_ffi_verify.py: +13 -9
  • tests/test_omnipkg_contracts.py: +11 -11
  • tests/test_flask_port_finder.py: +9 -9
  • src/omnipkg/tests/test_tensorflow_switching.py: +11 -6
  • src/omnipkg/tests/test_rich_switching.py: +3 -3
  • src/omnipkg/tests/test_concurrent_install.py: +2 -2
  • src/omnipkg/tests/test_old_rich.py: +1 -1
  • tests/test_dispatcher_contracts.py: +1 -1
  • pytest.ini: +1

  Documentation:
  • README.md: +12 -3
  • .github/piwheels-stats.md: +3 -3

  Configuration:
  • src/omnipkg/package_meta_builder.py: +299 -34
  • .github/workflows/cross_interpreter_installs.yml: +7 -6
  • setup.py: +4 -4

  Other:
  • .github/platform-matrix.json: +2 -2
  • build_hooks.py: +1 -1
  • .gitignore: +1

Commits: 0e15c2f..808b0f6

Author: 1minds3t

.github/piwheels-stats.md

@@ -1,11 +1,11 @@
 <!-- PIWHEELS_STATS_START -->
 ## 🥧 ARM32 Support (Raspberry Pi)
 [![piwheels](https://img.shields.io/badge/piwheels-ARM32%20verified-97BF0D?logo=raspberrypi&logoColor=white)](https://www.piwheels.org/project/omnipkg/)
-**Latest Version:** `3.3.4` | **Python:**  | [View on piwheels](https://www.piwheels.org/project/omnipkg/)
+**Latest Version:** `3.3.5` | **Python:**  | [View on piwheels](https://www.piwheels.org/project/omnipkg/)
 ```bash
-pip3 install omnipkg==3.3.4
+pip3 install omnipkg==3.3.5
 ```
 **Verified Platforms:**
 - 🍓 Raspberry Pi (armv6/armv7) - Bullseye, Bookworm, Trixie
-- 📦 Wheel: [`https://www.piwheels.org/simple/omnipkg/omnipkg-3.3.4-cp37-abi3-linux_armv6l.whl`](https://www.piwheels.org/simple/omnipkg/omnipkg-3.3.4-cp37-abi3-linux_armv6l.whl)
+- 📦 Wheel: [`https://www.piwheels.org/simple/omnipkg/omnipkg-3.3.5-cp37-abi3-linux_armv6l.whl`](https://www.piwheels.org/simple/omnipkg/omnipkg-3.3.5-cp37-abi3-linux_armv6l.whl)
 <!-- PIWHEELS_STATS_END -->

.github/platform-matrix.json

@@ -1,12 +1,12 @@
 {
   "arm32": {
     "verified": true,
-    "version": "3.3.4",
+    "version": "3.3.5",
     "python_versions": "",
     "cp39_bullseye":  false,
     "cp311_bookworm": false,
     "cp313_trixie":   false,
-    "install_command": "pip3 install omnipkg==3.3.4",
+    "install_command": "pip3 install omnipkg==3.3.5",
     "platforms": ["Raspberry Pi", "Raspbian Bullseye", "Raspbian Bookworm", "Raspbian Trixie"]
   }
 }

.github/workflows/cross_interpreter_installs.yml

@@ -119,11 +119,10 @@ jobs:
           fi
 
       - name: Verify Final State
+        env:
+          OMNIPKG_NONINTERACTIVE: "1"
         run: |
-          echo "--- Verifying final state ---"
-          FINAL_INFO=$(omnipkg info python 2>/dev/null)
-          echo "Final Python info:"
-          echo "$FINAL_INFO"
+          FINAL_INFO=$(omnipkg info python -y 2>/dev/null)
 
           if echo "$FINAL_INFO" | grep -q "Active Context:.*3.13" || \
              echo "$FINAL_INFO" | grep -q "Python 3.13.*currently active"; then
@@ -147,10 +146,12 @@ jobs:
           echo '```' >> $GITHUB_STEP_SUMMARY
 
       - name: Test TensorFlow Import on Python 3.13
+        env:
+          OMNIPKG_NONINTERACTIVE: "1"
         run: |
           echo "--- Testing TensorFlow import ---"
-          PYTHON_INFO=$(omnipkg info python 2>/dev/null)
-          PYTHON_313_EXE=$(echo "$PYTHON_INFO" | grep 'Python 3.13:' | awk '{print $4}' || echo "")
+          PYTHON_INFO=$(omnipkg info python -y 2>/dev/null)
+          PYTHON_313_EXE=$(echo "$PYTHON_INFO" | grep '3.13' | awk '{print $NF}')
 
           if [ -n "$PYTHON_313_EXE" ]; then
             echo "Testing TensorFlow import on Python 3.13..."

.gitignore

@@ -214,3 +214,4 @@ build/
 __pycache__/
 *.pyc
 *.pyo
+src/omnipkg/installation/*_planned.py

README.md

@@ -1405,13 +1405,13 @@ brew install omnipkg
 <!-- PIWHEELS_STATS_START -->
 ## 🥧 ARM32 Support (Raspberry Pi)
 [![piwheels](https://img.shields.io/badge/piwheels-ARM32%20verified-97BF0D?logo=raspberrypi&logoColor=white)](https://www.piwheels.org/project/omnipkg/)
-**Latest Version:** `3.3.4` | **Python:**  | [View on piwheels](https://www.piwheels.org/project/omnipkg/)
+**Latest Version:** `3.3.5` | **Python:**  | [View on piwheels](https://www.piwheels.org/project/omnipkg/)
 ```bash
-pip3 install omnipkg==3.3.4
+pip3 install omnipkg==3.3.5
 ```
 **Verified Platforms:**
 - 🍓 Raspberry Pi (armv6/armv7) - Bullseye, Bookworm, Trixie
-- 📦 Wheel: [`https://www.piwheels.org/simple/omnipkg/omnipkg-3.3.4-cp37-abi3-linux_armv6l.whl`](https://www.piwheels.org/simple/omnipkg/omnipkg-3.3.4-cp37-abi3-linux_armv6l.whl)
+- 📦 Wheel: [`https://www.piwheels.org/simple/omnipkg/omnipkg-3.3.5-cp37-abi3-linux_armv6l.whl`](https://www.piwheels.org/simple/omnipkg/omnipkg-3.3.5-cp37-abi3-linux_armv6l.whl)
 <!-- PIWHEELS_STATS_END -->
 
 
@@ -1439,6 +1439,15 @@ pip3 install omnipkg==3.3.4
 
 
 
+
+
+
+
+
+
+
+
+
 
 
 

build_hooks.py

@@ -101,7 +101,7 @@ def _collect_host_info() -> dict:
                 fields = {}
                 for line in Path(osr).read_text().splitlines():
                     if "=" in line and not line.startswith("#"):
-                        k, _, v = line.partition("=")
+                        k, unused, v = line.partition("=")
                         fields[k.strip()] = v.strip().strip('"')
                 info["linux_distro_id"]      = fields.get("ID", "unknown").lower()
                 info["linux_distro_version"] = fields.get("VERSION_ID", "unknown")

pytest.ini

@@ -2,3 +2,4 @@
 addopts = -ra --color=yes --continue-on-collection-errors
 markers =
     windows_compat: Tests that verify Windows-specific compatibility
+    integration: marks tests as integration tests (deselect with '-m "not integration"')

setup.py

@@ -160,7 +160,7 @@ def _skip(reason, **kw): return {"status": "skipped", "reason": reason, **kw}
 
         if replaced:
             binary_out.unlink(missing_ok=True)
-            print(f"  [dispatcher] ✅ Fast C dispatcher installed over: {replaced}")
+            safe_print(f"  [dispatcher] ✅ Fast C dispatcher installed over: {replaced}")
             installed_paths = []
             for name in replaced:
                 target = Path(install_dir) / (name + _exe)
@@ -276,7 +276,7 @@ def _clean_env():
             import importlib.util, site
             sp = site.getsitepackages()
             sp0 = sp[0] if sp else "unknown"
-            print("  [uv-ffi] ✅ PyO3 FFI extension built and installed")
+            safe_print("  [uv-ffi] ✅ PyO3 FFI extension built and installed")
             print(f"  [uv-ffi]    site-packages : {sp0}")
             # Find the actual .so path for the manifest
             import glob as _uvg
@@ -375,7 +375,7 @@ def _collect_host_info() -> dict:
                 fields = {}
                 for line in Path(osr).read_text().splitlines():
                     if "=" in line and not line.startswith("#"):
-                        k, _, v = line.partition("=")
+                        k, unused, v = line.partition("=")
                         fields[k.strip()] = v.strip().strip('"')
                 info["linux_distro_id"]      = fields.get("ID", "unknown").lower()
                 info["linux_distro_version"] = fields.get("VERSION_ID", "unknown")
@@ -672,7 +672,7 @@ def build_extension(self, ext):
         print(f"  [atomic]   output (.so)  : {Path(so_path).resolve()}")
         try:
             super().build_extension(ext)
-            print(f"  [atomic]   ✅ built to   : {Path(so_path).resolve()}")
+            safe_print(f"  [atomic]   ✅ built to   : {Path(so_path).resolve()}")
             self._atomic_result = {"status": "ok", "so_path": str(Path(so_path).resolve())}
         except Exception as e:
             print(f"\n{'!'*60}")