Remove internal packages and reuse from GIE when available

[elevran]

The tls and runnable packages under internal are copied from GIE and can/should be eliminated if/once kubernetes-sigs/gateway-api-inference-extension#920 is addressed.

[mccormickt]

Hey there 👋

It looks like this is unblocked. I'd be happy to pick this up to help out and get more familiar with the project.

[nirrozenbaum]

@mccormickt Thanks for your involvement and your willingness to contribute to llm-d-inference-scheduler!

This issue is actually a bit more complex than it was initially meant.
The original issue in GIE was eventually solved in a different way than the suggested change (solved by This PR).

We're currently in the transition of llm-d-inference-scheduler to latest GIE version which includes major changes that were introduced to GIE to support llm-d use cases. This transition requires updating main package to get it done and therefore also stop using the internal package (it's inevitable). more details can be seen in the ongoing PR #179.

The above makes this issue a matter of only deleting the unused files, so not much left to do after #179 is completed.

[elevran]

thanks for updating @nirrozenbaum. Could you please ensure that #179 also removes the internal/ packages on llm-d and marks this issue as fixed? 🙏

[nirrozenbaum]

thanks for updating @nirrozenbaum. Could you please ensure that #179 also removes the internal/ packages on llm-d and marks this issue as fixed? 🙏

yes, np 👍 .

[mccormickt]

@mccormickt Thanks for your involvement and your willingness to contribute to llm-d-inference-scheduler!

This issue is actually a bit more complex than it was initially meant. The original issue in GIE was eventually solved in a different way than the suggested change (solved by This PR).

We're currently in the transition of llm-d-inference-scheduler to latest GIE version which includes major changes that were introduced to GIE to support llm-d use cases. This transition requires updating main package to get it done and therefore also stop using the internal package (it's inevitable). more details can be seen in the ongoing PR #179.

The above makes this issue a matter of only deleting the unused files, so not much left to do after #179 is completed.

Ah, no worries - you're a lot quicker than me! I was working through updating to latest GIE, and got a decent understanding of the components in the meantime. 😄

[nirrozenbaum]

fixed by #179