[feat]: Provide an infra mode to display lance dataset internal

[dentiny]

Summary

Hi team, using lance in production, I found more often than not, devs need to investigate dataset information to see whether the storage version, compression, file size, etc are properly set.

Use case

Help users and infra devs especially to better understand lance dataset.

Proposed approach

No response

Design constraint check

• I have read CONTRIBUTING.md and this proposal does not conflict with the load-bearing design constraints.

[gordonmurray]

Hi @dentiny, would a Data | Infrastructure switch in the main dataset panel work for you?

The first version could show row and column counts, snapshot history, storage size, fragments, indexes, and the manifest path format. Compression and the Lance storage format need more investigation because LanceDB does not expose them directly.

Does this match what you had in mind?

[dentiny]

Thanks for the quick reply! And yes, that perfectly matches my expectation :)