-
Notifications
You must be signed in to change notification settings - Fork 2
[CAI-741][CAI-762] Chatbot-index creates new indexes on Redis #2008
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
mdciri
wants to merge
38
commits into
main
Choose a base branch
from
CAI-741-refactor-for-new-index
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from 8 commits
Commits
Show all changes
38 commits
Select commit
Hold shift + click to select a range
56cbc91
Refactor for multi index in redis
mdciri a0fe349
Copilot terraform skills
uolter 24ad7a4
[CAI-747] add parser app (#1996)
anemone008 542cd2c
[CAI-748] Add Puppeteer (#1999)
anemone008 e779b68
Update scripts to accept structured documents to create a dedicated i…
mdciri 15b8b95
Update github action accordingly to python script
mdciri f096b08
Update chatbot create index workflow to accept input types
mdciri 062d3b7
Update documents to read structured data into llamaindex documents
mdciri af6dc9c
Update apps/chatbot-index/src/modules/settings.py
mdciri 7128817
Update apps/chatbot-index/src/modules/documents.py
mdciri 17badb0
Update .github/actions/chatbot/action.yaml
mdciri f50a388
Fix the input and output types
mdciri 0df9e63
Update structured llamaindex documents id
mdciri 338efd6
Add assertion for the inputs
mdciri d1a8d4d
Update .changeset/eager-colts-smile.md
mdciri 57d348f
Update apps/chatbot-index/src/modules/create_vector_index.py
mdciri 4b315f0
Update document to safe load jsons
mdciri 01ed416
Merge branch 'CAI-741-refactor-for-new-index' of github.com:pagopa/de…
mdciri dc9663a
Merge branch 'main' into CAI-741-refactor-for-new-index
mdciri 74d9b35
Update cleaning redis when creating index given an index id
mdciri 8966f99
Update .github/workflows/chatbot_create_index.yaml
mdciri 6025cc3
Sobstitute s3 client with s3 resource
mdciri 7a2232a
Update apps/chatbot-index/src/modules/vector_index.py
mdciri e2547c5
Update apps/chatbot-index/src/modules/documents.py
mdciri 15187d3
Update apps/chatbot-index/src/modules/codec.py
mdciri bc02597
Update documents json loads
mdciri 149725b
fix docker compose
batdevis ac5bd1f
Merge branch 'CAI-741-refactor-for-new-index' of github.com:pagopa/de…
batdevis 4f70244
Add to the github workflow and action the index-id to create as env var
mdciri c3f2e8b
Merge branch 'CAI-741-refactor-for-new-index' of github.com:pagopa/de…
mdciri cda13ba
Update class name to be more generic
mdciri 779967b
Update class name to be more generic
mdciri 14e0a75
Merge branch 'main' into CAI-741-refactor-for-new-index
mdciri 873f81e
Update workflow inputs
mdciri 34dbc95
Update create-index service in compose.yaml
mdciri f3271e0
Update dockerfile and scripts
mdciri 5b91eff
Update codec return
mdciri 6c65f57
fix s3 init on create index
batdevis File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,5 @@ | ||
| --- | ||
| "parser": minor | ||
| --- | ||
|
|
||
| Create parser app |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,5 @@ | ||
| --- | ||
| "chatbot-index": minor | ||
| --- | ||
|
|
||
| "create index now considers also structured data" | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,5 @@ | ||
| --- | ||
| "parser": minor | ||
| --- | ||
|
|
||
| Add Puppeteer to parser app |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.