Implement Unified Array Digestion System

[csadorf]

Consolidate array handling into a single approach, refactor memory management and ownership models, optimize performance, update documentation, and validate changes.