Skip to content

Commit

Permalink
adapt for odh
Browse files Browse the repository at this point in the history
- get rid of Dockerfile (available at
  https://github.com/opendatahub-io/vllm/tree/main/Dockerfile.ubi)
- get rid of image build workflow: image is built by OpenShift CI (https://github.com/openshift/release/blob/master/ci-operator/config/opendatahub-io/vllm/opendatahub-io-vllm-main.yaml)
- update README links to point to opendatahub org
  • Loading branch information
dtrifiro committed Jun 17, 2024
1 parent eb353cb commit 325f259
Show file tree
Hide file tree
Showing 4 changed files with 6 additions and 300 deletions.
171 changes: 0 additions & 171 deletions .github/workflows/image.yml

This file was deleted.

122 changes: 0 additions & 122 deletions Dockerfile

This file was deleted.

9 changes: 4 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,9 +3,8 @@
vLLM adapter for a TGIS-compatible grpc server.

[![PyPi](https://img.shields.io/pypi/v/vllm-tgis-adapter?label=pip)](https://pypi.org/project/vllm-tgis-adapter)
[![Tests](https://github.com/dtrifiro/vllm-tgis-adapter/actions/workflows/tests.yaml/badge.svg)](https://github.com/dtrifiro/vllm-tgis-adapter/actions/workflows/tests.yaml)
[![Docker Image Build](https://github.com/dtrifiro/vllm-tgis-adapter/actions/workflows/image.yml/badge.svg)](https://github.com/dtrifiro/vllm-tgis-adapter/actions/workflows/image.yml)
[![quay.io/dtrifiro/vllm-tgis](https://img.shields.io/badge/quay.io-dtrifiro/vllm--tgis-darkred)](https://quay.io/repository/dtrifiro/vllm-tgis?tab=tags)
[![Tests](https://github.com/opendatahub-io/vllm-tgis-adapter/actions/workflows/tests.yaml/badge.svg)](https://github.com/opendatahub-io/vllm-tgis-adapter/actions/workflows/tests.yaml)
[![quay.io/opendatahub/vllm](https://img.shields.io/badge/quay.io-opendatahub/vllm--tgis-darkred)](https://quay.io/repository/opendatahub/vllm?tab=tags)

## Install

Expand Down Expand Up @@ -49,10 +48,10 @@ bash examples/inference.sh

### Docker

Image available at [quay.io/dtrifiro/vllm-tgis](https://quay.io/dtrifiro/vllm-tgis?tab=tags)
Image available at [quay.io/opendatahub/vllm](https://quay.io/opendatahub/vllm?tab=tags), built from [opendatahub-io/vllm](https://github.com/opendatahub-io/vllm)'s [Dockerfile.ubi](https://github.com/opendatahub-io/vllm/tree/main/Dockerfile.ubi)

```bash
docker pull quay.io/dtrifiro/vllm-tgis
docker pull quay.io/opendatahub/vllm
```

### Inference
Expand Down
4 changes: 2 additions & 2 deletions pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -37,8 +37,8 @@ dependencies = [
]

[project.urls]
Issues = "https://github.com/dtrifiro/vllm_tgis_adapter/issues"
Source = "https://github.com/dtrifiro/vllm_tgis_adapter"
Issues = "https://github.com/opendatahub-io/vllm_tgis_adapter/issues"
Source = "https://github.com/opendatahub-io/vllm_tgis_adapter"

[project.scripts]
grpc_healthcheck = "vllm_tgis_adapter.healthcheck:cli"
Expand Down

0 comments on commit 325f259

Please sign in to comment.