Browse Source

Adding separate reqiorements to avoid GPU depencies issues

tags/v0.3.3-rc1^2
haixuanTao 1 year ago
parent
commit
c5a1c1a4ee
2 changed files with 12 additions and 1 deletions
  1. +3
    -1
      examples/python-operator-dataflow/README.md
  2. +9
    -0
      examples/python-operator-dataflow/requirements_llm.txt

+ 3
- 1
examples/python-operator-dataflow/README.md View File

@@ -13,6 +13,7 @@ The [`dataflow.yml`](./dataflow.yml) defines a simple dataflow graph with the fo
## Getting started

```bash
pip install -r requirements.txt
cargo run --example python-operator-dataflow
```

@@ -22,6 +23,7 @@ cargo run --example python-operator-dataflow
conda create -n example_env python=3.11
conda activate test_env
pip install -r requirements.txt
pip install -r requirements_llm.txt
```

## Run the dataflow
@@ -32,7 +34,7 @@ pip install -r requirements.txt
dora start dataflow.yml
```

- Start the llm dataflow:
- Start the llm dataflow (Only works on Windows and Linux):

```bash
dora start dataflow_llm.yml


+ 9
- 0
examples/python-operator-dataflow/requirements_llm.txt View File

@@ -0,0 +1,9 @@
openai-whisper
sounddevice
pynput
sentence-transformers
transformers
pylcs
accelerate
optimum
auto-gptq>=0.7.1

Loading…
Cancel
Save