| Author | SHA1 | Message | Date |
|---|---|---|---|
|
|
eb6512fb81 | Add additional details | 9 months ago |
|
|
528bb90489 | phi4 gpu example | 9 months ago |
|
|
b8a6ae2caf | Adding phi4 remote example build command | 9 months ago |
|
|
c11d9c95eb | Add phi4 remote flow | 9 months ago |
| @@ -12,3 +12,31 @@ dora run phi4-dev.yml --uv | |||
| # Start talking or play a recording in English, Chinese, German, French, Italian, Japanese, Spanish, Portuguese | |||
| ``` | |||
| For the remote instance, with an example instance at ip: 3.82.54.170 | |||
| ```bash | |||
| cd examples/translation | |||
| uv venv --seed -p 3.11 | |||
| uv pip install -e ../../node-hub/dora-microphone | |||
| uv pip install -e ../../node-hub/dora-rerun | |||
| dora daemon --coordinator-addr 3.82.54.170 --machine-id macbook & | |||
| dora start phi4-remote.yml --coordinator-addr 3.82.54.170 --uv | |||
| # When you see `all nodes are ready` | |||
| # Start talking and you should see text appearing | |||
| ``` | |||
| To setup the remote instance: | |||
| ```bash | |||
| git clone https://github.com/dora-rs/dora.git | |||
| cd examples/translation | |||
| uv venv --seed -p 3.11 | |||
| dora build phi4-remote.yml --uv | |||
| dora coordinator & # In a separate window is better | |||
| dora daemon --machine-id gpu | |||
| ``` | |||
| @@ -0,0 +1,58 @@ | |||
| nodes: | |||
| - id: dora-microphone | |||
| build: pip install -e ../../node-hub/dora-microphone | |||
| path: dora-microphone | |||
| _unstable_deploy: | |||
| machine: macbook | |||
| inputs: | |||
| tick: dora/timer/millis/2000 | |||
| outputs: | |||
| - audio | |||
| - id: dora-vad | |||
| build: pip install -e ../../node-hub/dora-vad | |||
| path: dora-vad | |||
| _unstable_deploy: | |||
| machine: gpu | |||
| inputs: | |||
| audio: dora-microphone/audio | |||
| outputs: | |||
| - audio | |||
| env: | |||
| VIRTUAL_ENV: /home/ubuntu/dora/examples/translation/.venv | |||
| - id: dora-phi4 | |||
| # This build currently only work on Linux/CUDA | |||
| build: | | |||
| pip install flash-attn --no-build-isolation | |||
| pip install -e ../../node-hub/dora-phi4 | |||
| path: dora-phi4 | |||
| _unstable_deploy: | |||
| machine: gpu | |||
| inputs: | |||
| audio: dora-vad/audio | |||
| text: sender/data | |||
| outputs: | |||
| - text | |||
| env: | |||
| LEAD_MODALITY: audio | |||
| VIRTUAL_ENV: /home/ubuntu/dora/examples/translation/.venv | |||
| - id: sender | |||
| build: pip install -e ../../node-hub/pyarrow-sender | |||
| path: pyarrow-sender | |||
| _unstable_deploy: | |||
| machine: gpu | |||
| outputs: | |||
| - data | |||
| env: | |||
| DATA: "Translate this audio to english." | |||
| VIRTUAL_ENV: /home/ubuntu/dora/examples/translation/.venv | |||
| - id: dora-rerun | |||
| build: pip install dora-rerun | |||
| path: dora-rerun | |||
| _unstable_deploy: | |||
| machine: macbook | |||
| inputs: | |||
| original_text: dora-phi4/text | |||