Skip to content

feat: support milvus #1666

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 26 commits into from
Jul 2, 2023
Merged

feat: support milvus #1666

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
ad4b7d9
feat: init commit for milvus storage backend
maxwelljin Jun 21, 2023
888cb73
feat: milvus index & get items
maxwelljin Jun 26, 2023
a4cfe03
feat: milvus index & get items
maxwelljin Jun 26, 2023
b47924c
feat: add vector search
maxwelljin Jun 27, 2023
c444626
fix: release resources after loading
maxwelljin Jun 28, 2023
87a75d4
feat: add filters
maxwelljin Jun 28, 2023
79ae266
feat: batch find for mivlus backend
maxwelljin Jun 29, 2023
7376b90
test: find/batch find
maxwelljin Jun 29, 2023
8dde5a1
chore: single quote
maxwelljin Jun 29, 2023
e7f28fd
chore: single quote
maxwelljin Jun 29, 2023
f3c64a3
test: filter
maxwelljin Jun 29, 2023
030dc0d
refractor: remove to_vector function
maxwelljin Jun 29, 2023
0695a3b
chore: add comments
maxwelljin Jun 29, 2023
f23b181
chore: update lock
maxwelljin Jun 29, 2023
1b2e08c
fix: num of docs not precise
maxwelljin Jun 29, 2023
06af471
test: add flat document test
maxwelljin Jun 30, 2023
9b96009
feat: support multiple vectors
maxwelljin Jun 30, 2023
7ab088b
feat: support multi-dimensional vector for milvus
maxwelljin Jun 30, 2023
87f35ac
feat: support nested doc
maxwelljin Jun 30, 2023
fc72ab0
test: test index get/del
maxwelljin Jun 30, 2023
6e1fe26
chore: update lock
maxwelljin Jun 30, 2023
b261801
chore: add yaml
maxwelljin Jun 30, 2023
7dc72a9
chore: update dependency
maxwelljin Jun 30, 2023
79152a3
ci: change protobuf version to accomodate milvus
maxwelljin Jun 30, 2023
c512c59
Merge branch 'main' into feat-milvus
jupyterjazz Jul 2, 2023
c6ade33
Merge branch 'feat-support-milvus' into feat-milvus
jupyterjazz Jul 2, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions .github/workflows/ci.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -179,7 +179,7 @@ jobs:
python -m pip install --upgrade pip
python -m pip install poetry
poetry install --all-extras
poetry run pip install protobuf==3.19.0 # we check that we support 3.19
poetry run pip install protobuf==3.20.0 # we check that we support 3.19
sudo apt-get update
sudo apt-get install --no-install-recommends ffmpeg
- name: Test
Expand Down Expand Up @@ -208,7 +208,7 @@ jobs:
python -m pip install --upgrade pip
python -m pip install poetry
poetry install --all-extras
poetry run pip install protobuf==3.19.0
poetry run pip install protobuf==3.20.0
poetry run pip install tensorflow==2.11.0
sudo apt-get update
sudo apt-get install --no-install-recommends ffmpeg
Expand Down Expand Up @@ -238,7 +238,7 @@ jobs:
python -m pip install --upgrade pip
python -m pip install poetry
poetry install --all-extras
poetry run pip install protobuf==3.19.0
poetry run pip install protobuf==3.20.0
poetry run pip install tensorflow==2.11.0
poetry run pip install elasticsearch==8.6.2
sudo apt-get update
Expand Down Expand Up @@ -268,7 +268,7 @@ jobs:
python -m pip install --upgrade pip
python -m pip install poetry
poetry install --all-extras
poetry run pip install protobuf==3.19.0
poetry run pip install protobuf==3.20.0
poetry run pip install tensorflow==2.11.0
sudo apt-get update
sudo apt-get install --no-install-recommends ffmpeg
Expand Down
3 changes: 3 additions & 0 deletions docarray/index/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,9 @@ def __getattr__(name: str):
elif name == 'WeaviateDocumentIndex':
import_library('weaviate', raise_error=True)
import docarray.index.backends.weaviate as lib
elif name == 'MilvusDocumentIndex':
import_library('pymilvus', raise_error=True)
import docarray.index.backends.milvus as lib
else:
raise ImportError(
f'cannot import name \'{name}\' from \'{_get_path_from_docarray_root_level(__file__)}\''
Expand Down
Loading