Commit 973d431
authored
Add async support to semantic cache extension (#214)
This PR introduces new async compliant methods to the semantic cache
class using lazy index construction. Because the `AsyncSearchIndex`
requires an async redis python client, we needed to construct that class
lazily upon first usage within the semantic cache class. This PR fixes
some unclosed connection errors and is also in support of
BerriAI/litellm#5412 at LiteLLM.1 parent 5f1e046 commit 973d431
File tree
10 files changed
+588
-109
lines changed- redisvl
- extensions/llmcache
- index
- redis
- utils/vectorize
- text
- tests/integration
10 files changed
+588
-109
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
31 | 31 | | |
32 | 32 | | |
33 | 33 | | |
34 | | - | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
35 | 39 | | |
36 | 40 | | |
37 | 41 | | |
| |||
41 | 45 | | |
42 | 46 | | |
43 | 47 | | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
44 | 59 | | |
45 | 60 | | |
46 | 61 | | |
| |||
50 | 65 | | |
51 | 66 | | |
52 | 67 | | |
53 | | - | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
54 | 80 | | |
55 | 81 | | |
56 | 82 | | |
| |||
0 commit comments