raise redis connections and using blocking connection pool for more d…

[rkuo-danswer]

…eterministic behavior

Description

Fixes DAN-735.

ConnectionPool's default behavior is to error if max_connection is reached and we open a new client. We're not really equipped to deal with transient errors like this, so use a BlockingConnectionPool instead. Also increase the number of connections allowed (redis allows up to 10k by default, so 128 seems fine even if multiplied across a single digit number of services).

How Has This Been Tested?

[Describe the tests you ran to verify your changes]

Accepted Risk

[Any know risks or failure modes to point out to reviewers]

Related Issue(s)

[If applicable, link to the issue(s) this PR addresses]

Checklist:

• All of the automated tests pass
• All PR comments are addressed and marked resolved
• If there are migrations, they have been rebased to latest main
• If there are new dependencies, they are added to the requirements
• If there are new environment variables, they are added to all of the deployment methods
• If there are new APIs that don't require auth, they are added to PUBLIC_ENDPOINT_SPECS
• Docker images build and basic functionalities work
• Author has done a final read through of the PR right before merge

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
internal-search	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Oct 1, 2024 5:10pm