Expose config schemas (`TypedDict`) at runtime

[danielgafni]

I am using Obstore with Dagster.

Currently, Dagster's config system does not support forward references, so Obstore's typed dicts used to annotate configuration options are unusable with Dagster.

I understand this may be just a Dagster problem (I am not sure how easy would it be to support forward references there), but at the same time is there anything preventing Obstore from exposing these objects at runtime instead of just in .pyi files? What is the reason for doing things the current way?

[kylebarron]

exposing these objects at runtime instead of just in .pyi files?

The problem is that those objects do not exist in Python. The typed dicts are defining the Rust interface that only exists on the rust side. There are no such classes in Python.

I believe I tried to convert the TypedDicts into Python objects once, but I couldn't get things working. I don't remember what the problem was and I can't find the PR now.

If you're interested you could play around with a branch and see if you hit the same issues as I hit