You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.

README.md 1.8 kB

7 months ago
12345678910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364656667686970717273747576777879808182838485868788899091929394
  1. # SO100 and SO101 Remote Example
  2. ## Hardware requirements
  3. - Realsense Camera
  4. - so101 robotic arm
  5. ## Download the 3D model of the SO100
  6. ```bash
  7. [ -f "$HOME/Downloads/so100_urdf.zip" ] || (wget -O "$HOME/Downloads/so100_urdf.zip" https://huggingface.co/datasets/haixuantao/urdfs/resolve/main/so100/so100_urdf.zip && unzip -o "$HOME/Downloads/so100_urdf.zip" -d "$HOME/Downloads/so100_urdf")
  8. ```
  9. ## To get started
  10. ```bash
  11. uv venv --seed
  12. dora build no_torque.yml --uv
  13. ```
  14. ## Make sure that both realsense and robotic arm connected
  15. On linux, for the arm you can check connection with:
  16. ```bash
  17. ls /dev/ttyACM*
  18. ```
  19. This should show something like:
  20. ```bash
  21. /dev/ttyACM0
  22. ```
  23. Make sure to enable read with:
  24. ```bash
  25. sudo chmod 777 /dev/ttyACM0
  26. ```
  27. On linux, For the camera, make sure to have it well connected and check with:
  28. ```bash
  29. ls /dev/video**
  30. ```
  31. Result should be as follows:
  32. ```bash
  33. /dev/video0 /dev/video2 /dev/video4 /dev/video6 /dev/video8
  34. /dev/video1 /dev/video3 /dev/video5 /dev/video7 /dev/video9
  35. ```
  36. ## To run the no torque demo:
  37. ```bash
  38. dora run no_torque.yml --uv
  39. ```
  40. If the placement of the virtual robot arm is wrong, you can move it using the so100_transform environment configuration.
  41. ## To run the qwenvl demo:
  42. ```bash
  43. dora run qwenvl.yml --uv
  44. ```
  45. ## To run the qwenvl remote demo:
  46. On a remote machine:
  47. ```bash
  48. dora coordinator &
  49. dora daemon --machine-id gpu
  50. ```
  51. ```bash
  52. dora daemon --coordinator-addr <IP_COORDINATOR_ADDR>
  53. dora start qwenvl-remote.yml --uv --coordinator-addr <IP_COORDINATOR_ADDR>
  54. ```
  55. ## To run the qwenvl compression demo:
  56. On a remote machine:
  57. ```bash
  58. dora coordinator &
  59. dora daemon --machine-id gpu
  60. ```
  61. ```bash
  62. dora daemon --coordinator-addr <IP_COORDINATOR_ADDR>
  63. dora start qwenvl-compression.yml --uv --coordinator-addr <IP_COORDINATOR_ADDR>
  64. ```