[Feature]: split `delta-rs` into multiple crates

[abhiaagarwal]

Is your feature request related to a problem?

Developing on delta-rs can be a tough experience, owning to the long compilation times. This is particularly exacerbated by the datafusion dependency, which itself is huge and blocks compiling the rest of the crate.

Describe the solution you'd like

Instead, we should split delta-rs into multiple crates. For example, the "protocol" folder could become deltalake-protocol, the "logstore" folder could become deltalake-logstore, deltalake-operations / deltalake-datafusion-operations, deltalake-datafusion. This way, we benefit from build parallelization and can avoid huge recompiles.

Describe alternatives you've considered

N/A

Priority

Medium - Would be helpful

Additional context

No response

Contribution

• I'm willing to submit a pull request for this feature
• I can help with testing this feature
• I can help with documentation for this feature