Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adapt refactor comps #1340

Merged
merged 19 commits into from
Jan 8, 2025
Merged
Show file tree
Hide file tree
Changes from 11 commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/workflows/_run-docker-compose.yml
Original file line number Diff line number Diff line change
Expand Up @@ -134,6 +134,7 @@ jobs:
SERVING_TOKEN: ${{ secrets.SERVING_TOKEN }}
IMAGE_REPO: ${{ inputs.registry }}
IMAGE_TAG: ${{ inputs.tag }}
opea_branch: 'wenjiao/extract_rerank'
example: ${{ inputs.example }}
hardware: ${{ inputs.hardware }}
test_case: ${{ matrix.test_case }}
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/pr-docker-compose-e2e.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
name: E2E test with docker compose

on:
pull_request_target:
pull_request:
branches: ["main", "*rc"]
types: [opened, reopened, ready_for_review, synchronize] # added `ready_for_review` since draft is skipped
paths:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ jobs:
run: |
cd ..
git clone https://github.com/opea-project/GenAIComps.git

cd GenAIComps && git checkout "wenjiao/refactor_rerank"
- name: Check for Missing Dockerfile Paths in GenAIComps
run: |
cd ${{github.workspace}}
Expand Down
2 changes: 1 addition & 1 deletion AgentQnA/tests/step1_build_images.sh
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ function build_docker_images_for_retrieval_tool(){
# git clone https://github.com/opea-project/GenAIComps.git && cd GenAIComps && git checkout "${opea_branch:-"main"}" && cd ../
get_genai_comps
echo "Build all the images with --no-cache..."
service_list="doc-index-retriever dataprep-redis embedding-tei retriever-redis reranking-tei"
service_list="doc-index-retriever dataprep-redis embedding-tei retriever-redis reranking"
docker compose -f build.yaml build ${service_list} --no-cache
docker pull ghcr.io/huggingface/text-embeddings-inference:cpu-1.5

Expand Down
4 changes: 2 additions & 2 deletions ChatQnA/docker_image_build/build.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -68,9 +68,9 @@ services:
reranking-tei:
build:
context: GenAIComps
dockerfile: comps/reranks/src/Dockerfile
dockerfile: comps/rerankings/src/Dockerfile
extends: chatqna
image: ${REGISTRY:-opea}/reranking-tei:${TAG:-latest}
image: ${REGISTRY:-opea}/reranking:${TAG:-latest}
llm-textgen:
build:
context: GenAIComps
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -924,7 +924,7 @@ spec:
runAsUser: 1000
seccompProfile:
type: RuntimeDefault
image: "opea/reranking-tei:latest"
image: "opea/reranking:latest"
imagePullPolicy: Always
ports:
- name: reranking-usvc
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -832,7 +832,7 @@ spec:
runAsUser: 1000
seccompProfile:
type: RuntimeDefault
image: "opea/reranking-tei:latest"
image: "opea/reranking:latest"
imagePullPolicy: Always
ports:
- name: reranking-usvc
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -961,7 +961,7 @@ spec:
runAsUser: 1000
seccompProfile:
type: RuntimeDefault
image: "opea/reranking-tei:latest"
image: "opea/reranking:latest"
imagePullPolicy: Always
ports:
- name: reranking-usvc
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ DocRetriever are the most widely adopted use case for leveraging the different m
- Rerank TEI Image

```bash
docker build -t opea/reranking-tei:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/reranks/src/Dockerfile .
docker build -t opea/reranking:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/rerankings/src/Dockerfile .
```

- Dataprep Image
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -107,7 +107,7 @@ services:
timeout: 10s
retries: 60
reranking:
image: ${REGISTRY:-opea}/reranking-tei:${TAG:-latest}
image: ${REGISTRY:-opea}/reranking:${TAG:-latest}
container_name: reranking-tei-xeon-server
depends_on:
tei-reranking-service:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ DocRetriever are the most widely adopted use case for leveraging the different m
- Rerank TEI Image

```bash
docker build -t opea/reranking-tei:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/reranks/src/Dockerfile .
docker build -t opea/reranking:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/rerankings/src/Dockerfile .
```

- Dataprep Image
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -110,7 +110,7 @@ services:
timeout: 10s
retries: 60
reranking:
image: ${REGISTRY:-opea}/reranking-tei:${TAG:-latest}
image: ${REGISTRY:-opea}/reranking:${TAG:-latest}
container_name: reranking-tei-gaudi-server
depends_on:
tei-reranking-service:
Expand Down
4 changes: 2 additions & 2 deletions DocIndexRetriever/docker_image_build/build.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -26,9 +26,9 @@ services:
reranking-tei:
build:
context: GenAIComps
dockerfile: comps/reranks/src/Dockerfile
dockerfile: comps/rerankings/src/Dockerfile
extends: doc-index-retriever
image: ${REGISTRY:-opea}/reranking-tei:${TAG:-latest}
image: ${REGISTRY:-opea}/reranking:${TAG:-latest}
dataprep-redis:
build:
context: GenAIComps
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ docker build --no-cache -t opea/retriever-redis:latest --build-arg https_proxy=$
### 3. Build Rerank Image

```bash
docker build --no-cache -t opea/reranking-tei:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/reranks/src/Dockerfile .
docker build --no-cache -t opea/reranking:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/rerankings/src/Dockerfile .
```

### 4. Build LLM Image
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -111,7 +111,7 @@ services:
timeout: 10s
retries: 60
reranking:
image: ${REGISTRY:-opea}/reranking-tei:${TAG:-latest}
image: ${REGISTRY:-opea}/reranking:${TAG:-latest}
container_name: reranking-tei-xeon-server
depends_on:
tei-reranking-service:
Expand Down
4 changes: 2 additions & 2 deletions ProductivitySuite/docker_image_build/build.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -26,9 +26,9 @@ services:
reranking-tei:
build:
context: GenAIComps
dockerfile: comps/reranks/src/Dockerfile
dockerfile: comps/rerankings/src/Dockerfile
extends: chatqna
image: ${REGISTRY:-opea}/reranking-tei:${TAG:-latest}
image: ${REGISTRY:-opea}/reranking:${TAG:-latest}
llm-textgen:
build:
context: GenAIComps
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -753,7 +753,7 @@ spec:
runAsUser: 1000
seccompProfile:
type: RuntimeDefault
image: "opea/reranking-tei:latest"
image: "opea/reranking:latest"
imagePullPolicy: IfNotPresent
ports:
- name: reranking-usvc
Expand Down
4 changes: 2 additions & 2 deletions SearchQnA/docker_compose/intel/cpu/xeon/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ docker build --no-cache -t opea/web-retriever-chroma:latest --build-arg https_pr
### 3. Build Rerank Image

```bash
docker build --no-cache -t opea/reranking-tei:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/reranks/src/Dockerfile .
docker build --no-cache -t opea/reranking:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/rerankings/src/Dockerfile .
```

### 4. Build LLM Image
Expand Down Expand Up @@ -53,7 +53,7 @@ Then run the command `docker images`, you will have following images ready:

1. `opea/embedding-tei:latest`
2. `opea/web-retriever-chroma:latest`
3. `opea/reranking-tei:latest`
3. `opea/reranking:latest`
4. `opea/llm-textgen:latest`
5. `opea/searchqna:latest`
6. `opea/searchqna-ui:latest`
Expand Down
2 changes: 1 addition & 1 deletion SearchQnA/docker_compose/intel/cpu/xeon/compose.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -73,7 +73,7 @@ services:
timeout: 10s
retries: 60
reranking:
image: ${REGISTRY:-opea}/reranking-tei:${TAG:-latest}
image: ${REGISTRY:-opea}/reranking:${TAG:-latest}
container_name: reranking-tei-xeon-server
depends_on:
tei-reranking-service:
Expand Down
4 changes: 2 additions & 2 deletions SearchQnA/docker_compose/intel/hpu/gaudi/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ docker build --no-cache -t opea/web-retriever-chroma:latest --build-arg https_pr
### 3. Build Rerank Image

```bash
docker build --no-cache -t opea/reranking-tei:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/reranks/src/Dockerfile .
docker build --no-cache -t opea/reranking:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/rerankings/src/Dockerfile .
```

### 4. Build LLM Image
Expand Down Expand Up @@ -53,7 +53,7 @@ Then run the command `docker images`, you will have

1. `opea/embedding-tei:latest`
2. `opea/web-retriever-chroma:latest`
3. `opea/reranking-tei:latest`
3. `opea/reranking:latest`
4. `opea/llm-textgen:latest`
5. `opea/searchqna:latest`

Expand Down
2 changes: 1 addition & 1 deletion SearchQnA/docker_compose/intel/hpu/gaudi/compose.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -80,7 +80,7 @@ services:
timeout: 10s
retries: 60
reranking:
image: ${REGISTRY:-opea}/reranking-tei:${TAG:-latest}
image: ${REGISTRY:-opea}/reranking:${TAG:-latest}
container_name: reranking-tei-gaudi-server
depends_on:
tei-reranking-service:
Expand Down
4 changes: 2 additions & 2 deletions SearchQnA/docker_image_build/build.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -32,9 +32,9 @@ services:
reranking-tei:
build:
context: GenAIComps
dockerfile: comps/reranks/src/Dockerfile
dockerfile: comps/rerankings/src/Dockerfile
extends: searchqna
image: ${REGISTRY:-opea}/reranking-tei:${TAG:-latest}
image: ${REGISTRY:-opea}/reranking:${TAG:-latest}
llm-textgen:
build:
context: GenAIComps
Expand Down
2 changes: 1 addition & 1 deletion SearchQnA/tests/test_compose_on_gaudi.sh
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ function build_docker_images() {
git clone https://github.com/opea-project/GenAIComps.git && cd GenAIComps && git checkout "${opea_branch:-"main"}" && cd ../

echo "Build all the images with --no-cache, check docker_image_build.log for details..."
service_list="searchqna searchqna-ui embedding-tei web-retriever-chroma reranking-tei llm-textgen"
service_list="searchqna searchqna-ui embedding-tei web-retriever-chroma reranking llm-textgen"
docker compose -f build.yaml build ${service_list} --no-cache > ${LOG_PATH}/docker_image_build.log

docker pull ghcr.io/huggingface/text-embeddings-inference:cpu-1.5
Expand Down
2 changes: 1 addition & 1 deletion SearchQnA/tests/test_compose_on_xeon.sh
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ function build_docker_images() {
git clone https://github.com/opea-project/GenAIComps.git && cd GenAIComps && git checkout "${opea_branch:-"main"}" && cd ../

echo "Build all the images with --no-cache, check docker_image_build.log for details..."
service_list="searchqna searchqna-ui embedding-tei web-retriever-chroma reranking-tei llm-textgen"
service_list="searchqna searchqna-ui embedding-tei web-retriever-chroma reranking llm-textgen"
docker compose -f build.yaml build ${service_list} --no-cache > ${LOG_PATH}/docker_image_build.log

docker pull ghcr.io/huggingface/text-embeddings-inference:cpu-1.5
Expand Down
6 changes: 3 additions & 3 deletions VideoQnA/docker_compose/intel/cpu/xeon/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -62,10 +62,10 @@ docker build -t opea/embedding-multimodal-clip:latest --build-arg https_proxy=$h
docker build -t opea/retriever-vdms:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/retrievers/vdms/langchain/Dockerfile .
```

### 3. Build Rerank Image
### 3. Build Reranking Image

```bash
docker build -t opea/reranking-tei:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/reranks/src/Dockerfile .
docker build -t opea/reranking:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/rerankings/src/Dockerfile .
```

### 4. Build LVM Image (Xeon)
Expand Down Expand Up @@ -109,7 +109,7 @@ Then run the command `docker images`, you will have the following 8 Docker Image
1. `opea/dataprep-multimodal-vdms:latest`
2. `opea/embedding-multimodal-clip:latest`
3. `opea/retriever-vdms:latest`
4. `opea/reranking-tei:latest`
4. `opea/reranking:latest`
5. `opea/video-llama-lvm-server:latest`
6. `opea/lvm-video-llama:latest`
7. `opea/videoqna:latest`
Expand Down
2 changes: 1 addition & 1 deletion VideoQnA/docker_compose/intel/cpu/xeon/compose.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -61,7 +61,7 @@ services:
volumes:
- /home/$USER/.cache/huggingface/hub:/home/user/.cache/huggingface/hub
reranking:
image: ${REGISTRY:-opea}/reranking-tei:${TAG:-latest}
image: ${REGISTRY:-opea}/reranking:${TAG:-latest}
container_name: reranking-tei-server
ports:
- "8000:8000"
Expand Down
4 changes: 2 additions & 2 deletions VideoQnA/docker_image_build/build.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -38,9 +38,9 @@ services:
reranking-tei:
build:
context: GenAIComps
dockerfile: comps/reranks/src/Dockerfile
dockerfile: comps/rerankings/src/Dockerfile
extends: videoqna
image: ${REGISTRY:-opea}/reranking-tei:${TAG:-latest}
image: ${REGISTRY:-opea}/reranking:${TAG:-latest}
video-llama-lvm-server:
build:
context: GenAIComps
Expand Down
Loading