Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix indexing to work multithread #60

Closed
wants to merge 26 commits into from
Closed

Fix indexing to work multithread #60

wants to merge 26 commits into from

Conversation

rquesada
Copy link
Contributor

Summary

This PR fix an issue related with indexing files, that cause the server will not work async while indexing was executed

Changes

  • Updated RagManager.py
  • Updated models.py
  • Updated schemas.py
  • Updated requirements.txt
  • Migrations for File, Page and Chunk tables

Related Issues

N/A

Type of Change

Feature

Checklist

  • I have read the CONTRIBUTING documentation.
  • I have performed a self-review of my own code.
  • I have added tests that prove my fix is effective or that my feature works.
  • I have updated the documentation (if applicable).

Screenshots (if applicable) Example of use:

Additional Context

Tested locally using Swagger.

AnniePacheco and others added 25 commits August 15, 2024 12:37
@AnniePacheco
CRUD Assistant fix
1656702
@AnniePacheco
Rag Indexing
64bb8d3
@AnniePacheco
CRUD LLM
a5f5a6b
@rquesada
Retrieve and generate
e614950
@AnniePacheco
Get and set an llm
4f3bad1
@rquesada
WIP : Delete documents
2a9238c
@rquesada
Delete documents Chroma and db
e8bbf39
@rquesada
Create test message
2d8ab23
@AnniePacheco
Add config file
eac0472
@AnniePacheco
set configurable env variables
88da54b
@AnniePacheco
include assistant description in system prompt
be049fa
@rquesada
- Delete tmp files
fb3521a 
- Fix config
- Avoid delete persona if it is assigned
@rquesada
fix warning: Define a constant instead of duplicating literal
6f1f3da
@rquesada
Fix issues with SonarCloud
38d3e6d
@AnniePacheco
include persona descrip, fix index pdf pages, make str chat_response
a11cd7f
@AnniePacheco
Set a valid voice for a persona (xi_labs voices)
f6504f2
@AnniePacheco
set temperature as configurable value
de9f870
@AnniePacheco
cast to int and float
3785c8b
@AnniePacheco
fix crud rag index
4c8e4d9
@rquesada
Get status of indexing of each file
d4005b5
@AnniePacheco
Get Installed ollama models, set them and activate and deactivate
d11caa1
@AnniePacheco
Update status
1c4bf87
@AnniePacheco
generate voice messsage
0a008df
@AnniePacheco
delete voice msg directory
e27dbb9
@rquesada
Fix indexing to work multithread
231a1f4
@rquesada rquesada requested review from samj and quaid as code owners September 30, 2024 20:48
@sonarqubecloud SonarQubeCloud
Copy link

Quality Gate Passed Quality Gate passed

Issues
4 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

@samj samj added the assistant pAI Assistant Application label Oct 2, 2024
@rquesada rquesada changed the base branch from feat/generate-voice-response to develop October 9, 2024 16:09
@samj samj closed this Jan 16, 2025
@samj samj deleted the fix/indexing-async branch January 18, 2025 21:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@samj samj Awaiting requested review from samj samj is a code owner

@quaid quaid Awaiting requested review from quaid quaid is a code owner

Assignees
No one assigned
Labels
assistant pAI Assistant Application
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@rquesada @samj @AnniePacheco