Skip to content

Improve CLI startup performance with lazy imports#1

Open
maichler wants to merge 2 commits intoiannuttall:mainfrom
maichler:fix/cli-startup-performance
Open

Improve CLI startup performance with lazy imports#1
maichler wants to merge 2 commits intoiannuttall:mainfrom
maichler:fix/cli-startup-performance

Conversation

@maichler
Copy link

Summary

  • Lazy-load command handlers in cli.ts based on which command is run
  • Lazy-load node-llama-cpp in embed.ts (only when embedding is actually used)

Results

Command Before After
--help ~1.6s ~70ms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant