haixuanTao
da044e9d1c
Bump rerun to version 0.19
1 year ago
haixuanTao
6623274b52
Add urdf-visualization for rerun
1 year ago
Haixuan Xavier Tao
d6cb7c6de6
Bump rust toolchains 1.81 ( #707 )
Small PR to bump rust toolchains to 1.81
1 year ago
haixuanTao
716c3e7ab9
Bump rust toolchains to `1.81`
1 year ago
Haixuan Xavier Tao
cb31a293c5
Update README.md ( #705 )
updated some outdated links.
1 year ago
monem
2822f0d4d3
Update README.md
1 year ago
Haixuan Xavier Tao
1d33d0eb43
Docs: README ( #697 )
The old link was inactive, replaced it with a new one
1 year ago
Radovenchyk
089d86212d
Update README.md
1 year ago
Radovenchyk
a1f14f51a3
Docs: README
The old link was inactive, replaced it with a new one
1 year ago
Haixuan Xavier Tao
af620b4bb1
Publish rust project on pip to make it simpler to deploy dora node on different machine without requiring installing cargo ( #695 )
Currently rust node and the cli requires easier to use cargo or wget,
but it would be simpler if we could just pip install them.
This PR do this.
People will be able to do:
```bash
pip install dora-rerun
pip install dora-rs-cli
```
This will make the pull process of nodes simpler for people who only use
python.
1 year ago
haixuanTao
dc716b2871
Remove -i from sdist
1 year ago
haixuanTao
be9c3019c8
Set python version
1 year ago
Haixuan Xavier Tao
20c6328901
Update dependencies ( #692 )
This PR contains the following updates:
| Package | Type | Update | Change |
|---|---|---|---|
| [anyhow](https://redirect.github.com/dtolnay/anyhow ) | dependencies |
patch | `1.0.89` -> `1.0.91` |
| [arrow](https://redirect.github.com/apache/arrow-rs ) |
workspace.dependencies | minor | `53.1.0` -> `53.2.0` |
| [arrow-array](https://redirect.github.com/apache/arrow-rs ) |
workspace.dependencies | minor | `53.1.0` -> `53.2.0` |
| [arrow-data](https://redirect.github.com/apache/arrow-rs ) |
workspace.dependencies | minor | `53.1.0` -> `53.2.0` |
| [arrow-schema](https://redirect.github.com/apache/arrow-rs ) |
workspace.dependencies | minor | `53.1.0` -> `53.2.0` |
| [flume](https://redirect.github.com/zesterer/flume ) | dependencies |
patch | `0.11.0` -> `0.11.1` |
| [proc-macro2](https://redirect.github.com/dtolnay/proc-macro2 ) |
dependencies | patch | `1.0.87` -> `1.0.89` |
| [pyo3](https://redirect.github.com/pyo3/pyo3 ) | workspace.dependencies
| patch | `0.22.4` -> `0.22.5` |
| [regex](https://redirect.github.com/rust-lang/regex ) | dependencies |
patch | `1.11.0` -> `1.11.1` |
| [serde](https://serde.rs )
([source](https://redirect.github.com/serde-rs/serde )) | dependencies |
patch | `1.0.210` -> `1.0.214` |
| [thiserror](https://redirect.github.com/dtolnay/thiserror ) |
dependencies | patch | `1.0.64` -> `1.0.66` |
| [tokio](https://tokio.rs )
([source](https://redirect.github.com/tokio-rs/tokio )) | dependencies |
minor | `1.40.0` -> `1.41.0` |
| [tokio](https://tokio.rs )
([source](https://redirect.github.com/tokio-rs/tokio )) |
dev-dependencies | minor | `1.40.0` -> `1.41.0` |
| [uuid](https://redirect.github.com/uuid-rs/uuid ) | dependencies |
minor | `1.10.0` -> `1.11.0` |
| [uuid](https://redirect.github.com/uuid-rs/uuid ) | dev-dependencies |
minor | `1.10.0` -> `1.11.0` |
---
### Release Notes
<details>
<summary>dtolnay/anyhow (anyhow)</summary>
###
[`v1.0.91`](https://redirect.github.com/dtolnay/anyhow/releases/tag/1.0.91 )
[Compare
Source](https://redirect.github.com/dtolnay/anyhow/compare/1.0.90...1.0.91 )
- Ensure OUT_DIR is left with deterministic contents after build script
execution
([#​388](https://redirect.github.com/dtolnay/anyhow/issues/388 ))
###
[`v1.0.90`](https://redirect.github.com/dtolnay/anyhow/releases/tag/1.0.90 )
[Compare
Source](https://redirect.github.com/dtolnay/anyhow/compare/1.0.89...1.0.90 )
- Documentation improvements
</details>
<details>
<summary>apache/arrow-rs (arrow)</summary>
###
[`v53.2.0`](https://redirect.github.com/apache/arrow-rs/blob/HEAD/CHANGELOG.md#5320-2024-10-21 )
[Compare
Source](https://redirect.github.com/apache/arrow-rs/compare/53.1.0...53.2.0 )
[Full
Changelog](https://redirect.github.com/apache/arrow-rs/compare/53.1.0...53.2.0 )
**Implemented enhancements:**
- Implement arrow_json encoder for Decimal128 & Decimal256 DataTypes
[#​6605](https://redirect.github.com/apache/arrow-rs/issues/6605 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Support DataType::FixedSizeList in make_builder within
struct_builder.rs
[#​6594](https://redirect.github.com/apache/arrow-rs/issues/6594 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Support DataType::Dictionary in `make_builder` within
struct_builder.rs
[#​6589](https://redirect.github.com/apache/arrow-rs/issues/6589 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Interval parsing from string - accept "mon" and "mons" token
[#​6548](https://redirect.github.com/apache/arrow-rs/issues/6548 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- `AsyncArrowWriter` API to get the total size of a written parquet file
[#​6530](https://redirect.github.com/apache/arrow-rs/issues/6530 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
- `append_many` for Dictionary builders
[#​6529](https://redirect.github.com/apache/arrow-rs/issues/6529 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Missing tonic `GRPC_STATUS` with tonic 0.12.1
[#​6515](https://redirect.github.com/apache/arrow-rs/issues/6515 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
- Add example of how to use parquet metadata reader APIs for a local
cache
[#​6504](https://redirect.github.com/apache/arrow-rs/issues/6504 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
- Remove reliance on `raw-entry` feature of Hashbrown
[#​6498](https://redirect.github.com/apache/arrow-rs/issues/6498 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
- Improve page index metadata loading in
`SerializedFileReader::new_with_options`
[#​6491](https://redirect.github.com/apache/arrow-rs/issues/6491 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
- Release arrow-rs / parquet minor version `53.1.0` (October 2024)
[#​6340](https://redirect.github.com/apache/arrow-rs/issues/6340 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
**Fixed bugs:**
- Compilation fail where `c_char = u8`
[#​6571](https://redirect.github.com/apache/arrow-rs/issues/6571 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Arrow flight CI test failing on `master`
[#​6568](https://redirect.github.com/apache/arrow-rs/issues/6568 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
**Documentation updates:**
- Minor: Document SIMD rationale and tips
[#​6554](https://redirect.github.com/apache/arrow-rs/pull/6554 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([alamb](https://redirect.github.com/alamb ))
**Closed issues:**
- Casting to and from unions
[#​6247](https://redirect.github.com/apache/arrow-rs/issues/6247 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
**Merged pull requests:**
- Minor: more comments for `RecordBatch.get_array_memory_size()`
[#​6607](https://redirect.github.com/apache/arrow-rs/pull/6607 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([2010YOUY01](https://redirect.github.com/2010YOUY01 ))
- Implement arrow_json encoder for Decimal128 & Decimal256
[#​6606](https://redirect.github.com/apache/arrow-rs/pull/6606 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([phillipleblanc](https://redirect.github.com/phillipleblanc ))
- Add support for building FixedSizeListBuilder in struct_builder's mak…
[#​6595](https://redirect.github.com/apache/arrow-rs/pull/6595 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([kszlim](https://redirect.github.com/kszlim ))
- Add limited support for dictionary builders in `make_builders` for
stru…
[#​6593](https://redirect.github.com/apache/arrow-rs/pull/6593 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([kszlim](https://redirect.github.com/kszlim ))
- Fix CI with new valid certificates and add script for future usage
[#​6585](https://redirect.github.com/apache/arrow-rs/pull/6585 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
([itsjunetime](https://redirect.github.com/itsjunetime ))
- Update proc-macro2 requirement from =1.0.87 to =1.0.88
[#​6579](https://redirect.github.com/apache/arrow-rs/pull/6579 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
([dependabot\[bot\]](https://redirect.github.com/apps/dependabot ))
- Fix clippy complaints
[#​6573](https://redirect.github.com/apache/arrow-rs/pull/6573 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
([itsjunetime](https://redirect.github.com/itsjunetime ))
- Use c_char instead of i8 to compile on platforms where c_char = u8
[#​6572](https://redirect.github.com/apache/arrow-rs/pull/6572 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([itsjunetime](https://redirect.github.com/itsjunetime ))
- Bump pyspark from 3.3.1 to 3.3.2 in /parquet/pytest
[#​6564](https://redirect.github.com/apache/arrow-rs/pull/6564 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([dependabot\[bot\]](https://redirect.github.com/apps/dependabot ))
- `unsafe` improvements
[#​6551](https://redirect.github.com/apache/arrow-rs/pull/6551 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([ssbr](https://redirect.github.com/ssbr ))
- Update README.md
[#​6550](https://redirect.github.com/apache/arrow-rs/pull/6550 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
([Abdullahsab3](https://redirect.github.com/Abdullahsab3 ))
- Fix string '0' cast to decimal with scale 0
[#​6547](https://redirect.github.com/apache/arrow-rs/pull/6547 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([findepi](https://redirect.github.com/findepi ))
- Add finish to `AsyncArrowWriter::finish`
[#​6543](https://redirect.github.com/apache/arrow-rs/pull/6543 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([etseidl](https://redirect.github.com/etseidl ))
- Add append_nulls to dictionary builders
[#​6542](https://redirect.github.com/apache/arrow-rs/pull/6542 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([adriangb](https://redirect.github.com/adriangb ))
- Improve UnionArray::is_nullable
[#​6540](https://redirect.github.com/apache/arrow-rs/pull/6540 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([tustvold](https://redirect.github.com/tustvold ))
- Allow to read parquet binary column as UTF8 type
[#​6539](https://redirect.github.com/apache/arrow-rs/pull/6539 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([goldmedal](https://redirect.github.com/goldmedal ))
- Use HashTable instead of raw_entry_mut
[#​6537](https://redirect.github.com/apache/arrow-rs/pull/6537 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([tustvold](https://redirect.github.com/tustvold ))
- Add append_many to dictionary arrays to allow adding repeated values
[#​6534](https://redirect.github.com/apache/arrow-rs/pull/6534 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([adriangb](https://redirect.github.com/adriangb ))
- Adds documentation and example recommending Vec\<ArrayRef> over
ChunkedArray
[#​6527](https://redirect.github.com/apache/arrow-rs/pull/6527 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([efredine](https://redirect.github.com/efredine ))
- Update proc-macro2 requirement from =1.0.86 to =1.0.87
[#​6526](https://redirect.github.com/apache/arrow-rs/pull/6526 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
([dependabot\[bot\]](https://redirect.github.com/apps/dependabot ))
- Add `ColumnChunkMetadataBuilder` clear APIs
[#​6523](https://redirect.github.com/apache/arrow-rs/pull/6523 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([alamb](https://redirect.github.com/alamb ))
- Update sysinfo requirement from 0.31.2 to 0.32.0
[#​6521](https://redirect.github.com/apache/arrow-rs/pull/6521 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([dependabot\[bot\]](https://redirect.github.com/apps/dependabot ))
- Update Tonic to 0.12.3
[#​6517](https://redirect.github.com/apache/arrow-rs/pull/6517 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
([cisaacson](https://redirect.github.com/cisaacson ))
- Detect missing page indexes while reading Parquet metadata
[#​6507](https://redirect.github.com/apache/arrow-rs/pull/6507 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([etseidl](https://redirect.github.com/etseidl ))
- Use ParquetMetaDataReader to load page indexes in
`SerializedFileReader::new_with_options`
[#​6506](https://redirect.github.com/apache/arrow-rs/pull/6506 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([etseidl](https://redirect.github.com/etseidl ))
- Improve parquet `MetadataFetch` and `AsyncFileReader` docs
[#​6505](https://redirect.github.com/apache/arrow-rs/pull/6505 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([alamb](https://redirect.github.com/alamb ))
- fix arrow-json encoding with dictionary including nulls
[#​6503](https://redirect.github.com/apache/arrow-rs/pull/6503 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([samuelcolvin](https://redirect.github.com/samuelcolvin ))
- Update brotli requirement from 6.0 to 7.0
[#​6499](https://redirect.github.com/apache/arrow-rs/pull/6499 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([dependabot\[bot\]](https://redirect.github.com/apps/dependabot ))
- Benchmark both scenarios, with records skipped and without skipping,
for delta-bin-packed primitive arrays with half nulls.
[#​6489](https://redirect.github.com/apache/arrow-rs/pull/6489 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([wiedld](https://redirect.github.com/wiedld ))
- Add round trip tests for reading/writing parquet metadata
[#​6463](https://redirect.github.com/apache/arrow-rs/pull/6463 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([alamb](https://redirect.github.com/alamb ))
\* *This Changelog was automatically generated by
[github_changelog_generator](https://redirect.github.com/github-changelog-generator/github-changelog-generator )*
</details>
<details>
<summary>zesterer/flume (flume)</summary>
###
[`v0.11.1`](https://redirect.github.com/zesterer/flume/blob/HEAD/CHANGELOG.md#0111---2024-10-19 )
##### Added
- `SendSink::sender`
- `SendFut`, `SendSink`, `RecvFut`, `RecvStream`, `WeakSender`, `Iter`,
`TryIter`, and `IntoIter` now implement `Debug`
- Docs now show required features
##### Removed
##### Changed
- `WeakSender` is now `Clone`
- `spin` feature no longer uses `std:🧵 :sleep` for locking except
on Unix-like operating systems and Windows
- Flume is now in [casual maintenance
mode](https://casuallymaintained.tech/ ).
##### Fixed
</details>
<details>
<summary>dtolnay/proc-macro2 (proc-macro2)</summary>
###
[`v1.0.89`](https://redirect.github.com/dtolnay/proc-macro2/releases/tag/1.0.89 )
[Compare
Source](https://redirect.github.com/dtolnay/proc-macro2/compare/1.0.88...1.0.89 )
- Ensure OUT_DIR is left with deterministic contents after build script
execution
([#​474](https://redirect.github.com/dtolnay/proc-macro2/issues/474 ))
###
[`v1.0.88`](https://redirect.github.com/dtolnay/proc-macro2/releases/tag/1.0.88 )
[Compare
Source](https://redirect.github.com/dtolnay/proc-macro2/compare/1.0.87...1.0.88 )
- Return accurate line and column from `Span::start` and `Span::end`
inside proc macros on nightly
([#​472](https://redirect.github.com/dtolnay/proc-macro2/issues/472 ))
</details>
<details>
<summary>pyo3/pyo3 (pyo3)</summary>
###
[`v0.22.5`](https://redirect.github.com/pyo3/pyo3/blob/HEAD/CHANGELOG.md#0225---2024-10-15 )
[Compare
Source](https://redirect.github.com/pyo3/pyo3/compare/v0.22.4...v0.22.5 )
##### Fixed
- Fix regression in 0.22.4 of naming collision in `__clear__` slot and
`clear` method generated code.
[#​4619](https://redirect.github.com/PyO3/pyo3/pull/4619 )
</details>
<details>
<summary>rust-lang/regex (regex)</summary>
###
[`v1.11.1`](https://redirect.github.com/rust-lang/regex/blob/HEAD/CHANGELOG.md#1111-2024-10-24 )
[Compare
Source](https://redirect.github.com/rust-lang/regex/compare/1.11.0...1.11.1 )
\===================
This is a new patch release of `regex` that fixes compilation on nightly
Rust when the unstable `pattern` crate feature is enabled. Users on
nightly
Rust without this feature enabled are unaffected.
Bug fixes:
- [BUG
#​1231](https://redirect.github.com/rust-lang/regex/issues/1231 ):
Fix the `Pattern` trait implementation as a result of nightly API
breakage.
</details>
<details>
<summary>serde-rs/serde (serde)</summary>
###
[`v1.0.214`](https://redirect.github.com/serde-rs/serde/releases/tag/v1.0.214 )
[Compare
Source](https://redirect.github.com/serde-rs/serde/compare/v1.0.213...v1.0.214 )
- Implement IntoDeserializer for all Deserializers in serde:🇩🇪 :value
module
([#​2568](https://redirect.github.com/serde-rs/serde/issues/2568 ),
thanks [@​Mingun](https://redirect.github.com/Mingun ))
###
[`v1.0.213`](https://redirect.github.com/serde-rs/serde/releases/tag/v1.0.213 )
[Compare
Source](https://redirect.github.com/serde-rs/serde/compare/v1.0.212...v1.0.213 )
- Fix support for macro-generated `with` attributes inside a newtype
struct
([#​2847](https://redirect.github.com/serde-rs/serde/issues/2847 ))
###
[`v1.0.212`](https://redirect.github.com/serde-rs/serde/releases/tag/v1.0.212 )
[Compare
Source](https://redirect.github.com/serde-rs/serde/compare/v1.0.211...v1.0.212 )
- Fix hygiene of macro-generated local variable accesses in serde(with)
wrappers
([#​2845](https://redirect.github.com/serde-rs/serde/issues/2845 ))
###
[`v1.0.211`](https://redirect.github.com/serde-rs/serde/releases/tag/v1.0.211 )
[Compare
Source](https://redirect.github.com/serde-rs/serde/compare/v1.0.210...v1.0.211 )
- Improve error reporting about mismatched signature in `with` and
`default` attributes
([#​2558](https://redirect.github.com/serde-rs/serde/issues/2558 ),
thanks [@​Mingun](https://redirect.github.com/Mingun ))
- Show variant aliases in error message when variant deserialization
fails
([#​2566](https://redirect.github.com/serde-rs/serde/issues/2566 ),
thanks [@​Mingun](https://redirect.github.com/Mingun ))
- Improve binary size of untagged enum and internally tagged enum
deserialization by about 12%
([#​2821](https://redirect.github.com/serde-rs/serde/issues/2821 ))
</details>
<details>
<summary>dtolnay/thiserror (thiserror)</summary>
###
[`v1.0.66`](https://redirect.github.com/dtolnay/thiserror/releases/tag/1.0.66 )
[Compare
Source](https://redirect.github.com/dtolnay/thiserror/compare/1.0.65...1.0.66 )
- Improve compile error on malformed format attribute
([#​327](https://redirect.github.com/dtolnay/thiserror/issues/327 ))
###
[`v1.0.65`](https://redirect.github.com/dtolnay/thiserror/releases/tag/1.0.65 )
[Compare
Source](https://redirect.github.com/dtolnay/thiserror/compare/1.0.64...1.0.65 )
- Ensure OUT_DIR is left with deterministic contents after build script
execution
([#​325](https://redirect.github.com/dtolnay/thiserror/issues/325 ))
</details>
<details>
<summary>tokio-rs/tokio (tokio)</summary>
###
[`v1.41.0`](https://redirect.github.com/tokio-rs/tokio/releases/tag/tokio-1.41.0 ):
Tokio v1.41.0
[Compare
Source](https://redirect.github.com/tokio-rs/tokio/compare/tokio-1.40.0...tokio-1.41.0 )
##### 1.41.0 (Oct 22th, 2024)
##### Added
- metrics: stabilize `global_queue_depth` ([#​6854],
[#​6918])
- net: add conversions for unix `SocketAddr` ([#​6868])
- sync: add `watch::Sender::sender_count` ([#​6836])
- sync: add `mpsc::Receiver::blocking_recv_many` ([#​6867])
- task: stabilize `Id` apis ([#​6793], [#​6891])
##### Added (unstable)
- metrics: add H2 Histogram option to improve histogram granularity
([#​6897])
- metrics: rename some histogram apis ([#​6924])
- runtime: add `LocalRuntime` ([#​6808])
##### Changed
- runtime: box futures larger than 16k on release mode ([#​6826])
- sync: add `#[must_use]` to `Notified` ([#​6828])
- sync: make `watch` cooperative ([#​6846])
- sync: make `broadcast::Receiver` cooperative ([#​6870])
- task: add task size to tracing instrumentation ([#​6881])
- wasm: enable `cfg_fs` for `wasi` target ([#​6822])
##### Fixed
- net: fix regression of abstract socket path in unix socket
([#​6838])
##### Documented
- io: recommend `OwnedFd` with `AsyncFd` ([#​6821])
- io: document cancel safety of `AsyncFd` methods ([#​6890])
- macros: render more comprehensible documentation for `join` and
`try_join` ([#​6814], [#​6841])
- net: fix swapped examples for `TcpSocket::set_nodelay` and
`TcpSocket::nodelay` ([#​6840])
- sync: document runtime compatibility ([#​6833])
[#​6793]: https://redirect.github.com/tokio-rs/tokio/pull/6793
[#​6808]: https://redirect.github.com/tokio-rs/tokio/pull/6808
[#​6810]: https://redirect.github.com/tokio-rs/tokio/pull/6810
[#​6814]: https://redirect.github.com/tokio-rs/tokio/pull/6814
[#​6821]: https://redirect.github.com/tokio-rs/tokio/pull/6821
[#​6822]: https://redirect.github.com/tokio-rs/tokio/pull/6822
[#​6826]: https://redirect.github.com/tokio-rs/tokio/pull/6826
[#​6828]: https://redirect.github.com/tokio-rs/tokio/pull/6828
[#​6833]: https://redirect.github.com/tokio-rs/tokio/pull/6833
[#​6836]: https://redirect.github.com/tokio-rs/tokio/pull/6836
[#​6838]: https://redirect.github.com/tokio-rs/tokio/pull/6838
[#​6840]: https://redirect.github.com/tokio-rs/tokio/pull/6840
[#​6841]: https://redirect.github.com/tokio-rs/tokio/pull/6841
[#​6846]: https://redirect.github.com/tokio-rs/tokio/pull/6846
[#​6854]: https://redirect.github.com/tokio-rs/tokio/pull/6854
[#​6867]: https://redirect.github.com/tokio-rs/tokio/pull/6867
[#​6868]: https://redirect.github.com/tokio-rs/tokio/pull/6868
[#​6870]: https://redirect.github.com/tokio-rs/tokio/pull/6870
[#​6881]: https://redirect.github.com/tokio-rs/tokio/pull/6881
[#​6890]: https://redirect.github.com/tokio-rs/tokio/pull/6890
[#​6891]: https://redirect.github.com/tokio-rs/tokio/pull/6891
[#​6897]: https://redirect.github.com/tokio-rs/tokio/pull/6897
[#​6918]: https://redirect.github.com/tokio-rs/tokio/pull/6918
[#​6924]: https://redirect.github.com/tokio-rs/tokio/pull/6924
</details>
<details>
<summary>uuid-rs/uuid (uuid)</summary>
###
[`v1.11.0`](https://redirect.github.com/uuid-rs/uuid/releases/tag/1.11.0 )
[Compare
Source](https://redirect.github.com/uuid-rs/uuid/compare/1.10.0...1.11.0 )
#### What's Changed
- Upgrade zerocopy to 0.8 by
[@​yotamofek](https://redirect.github.com/yotamofek ) in
[https://github.com/uuid-rs/uuid/pull/771 ](https://redirect.github.com/uuid-rs/uuid/pull/771 )
- Prepare for 1.11.0 release by
[@​KodrAus](https://redirect.github.com/KodrAus ) in
[https://github.com/uuid-rs/uuid/pull/772 ](https://redirect.github.com/uuid-rs/uuid/pull/772 )
#### New Contributors
- [@​yotamofek](https://redirect.github.com/yotamofek ) made their
first contribution in
[https://github.com/uuid-rs/uuid/pull/771 ](https://redirect.github.com/uuid-rs/uuid/pull/771 )
**Full Changelog**:
https://github.com/uuid-rs/uuid/compare/1.10.0...1.11.0
</details>
---
### Configuration
📅 **Schedule**: Branch creation - "on monday" (UTC), Automerge - At any
time (no schedule defined).
🚦 **Automerge**: Disabled by config. Please merge this manually once you
are satisfied.
♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.
👻 **Immortal**: This PR will be recreated if closed unmerged. Get
[config
help](https://redirect.github.com/renovatebot/renovate/discussions ) if
that's undesired.
---
- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box
---
This PR was generated by [Mend Renovate](https://mend.io/renovate/ ).
View the [repository job
log](https://developer.mend.io/github/dora-rs/dora ).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzOC4xMjAuMSIsInVwZGF0ZWRJblZlciI6IjM4LjEzNS4yIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6W119-->
1 year ago
haixuanTao
8d90b8177d
Fix CI/CD
1 year ago
renovate[bot]
59802d3b43
Update dependencies
1 year ago
haixuanTao
9ae7467f95
Make pip-release workflow release cli as well
1 year ago
haixuanTao
af2206e02c
Publish 100% rust node on pip to make it easy to install on different machine
1 year ago
Haixuan Xavier Tao
0b488376d4
Fix macos 14 yolo error ( #696 )
This is a quick CI/CD fix from:
- macos 14 version bump
- node-hub no more space error
1 year ago
haixuanTao
4477d71d8c
Pin python version
1 year ago
haixuanTao
8b3c2faf68
Pin Python Version
1 year ago
haixuanTao
9d5d9260c3
Remove python dep from `cargo test` as it creates a dynamic link with python. See: https://github.com/dora-rs/dora/actions/runs/11589598043/job/32265425082?pr=696
1 year ago
haixuanTao
b551f2a549
Downgrade macos 14 that requires pytorch support python 3.13
1 year ago
haixuanTao
4c5ae4e3bc
Add space remover for node hub
1 year ago
haixuanTao
4f2455a1f8
Bump ultralytics version to support macos 14
1 year ago
Philipp Oppermann
c6e70c2295
Update dependencies ( #690 )
This PR contains the following updates:
| Package | Type | Update | Change |
|---|---|---|---|
| [clap](https://redirect.github.com/clap-rs/clap ) | dependencies |
patch | `4.5.19` -> `4.5.20` |
| [pyo3](https://redirect.github.com/pyo3/pyo3 ) | workspace.dependencies
| patch | `0.22.3` -> `0.22.4` |
---
### Release Notes
<details>
<summary>clap-rs/clap (clap)</summary>
###
[`v4.5.20`](https://redirect.github.com/clap-rs/clap/blob/HEAD/CHANGELOG.md#4520---2024-10-08 )
[Compare
Source](https://redirect.github.com/clap-rs/clap/compare/v4.5.19...v4.5.20 )
##### Features
- *(unstable)* Add `CommandExt`
</details>
<details>
<summary>pyo3/pyo3 (pyo3)</summary>
###
[`v0.22.4`](https://redirect.github.com/pyo3/pyo3/blob/HEAD/CHANGELOG.md#0224---2024-10-12 )
[Compare
Source](https://redirect.github.com/pyo3/pyo3/compare/v0.22.3...v0.22.4 )
##### Added
- Add FFI definition `PyWeakref_GetRef` and `compat::PyWeakref_GetRef`.
[#​4528](https://redirect.github.com/PyO3/pyo3/pull/4528 )
##### Changed
- Deprecate `_borrowed` methods on `PyWeakRef` and `PyWeakrefProxy`
(just use the owning forms).
[#​4590](https://redirect.github.com/PyO3/pyo3/pull/4590 )
##### Fixed
- Revert removal of private FFI function `_PyLong_NumBits` on Python
3.13 and later.
[#​4450](https://redirect.github.com/PyO3/pyo3/pull/4450 )
- Fix `__traverse__` functions for base classes not being called by
subclasses created with `#[pyclass(extends = ...)]`.
[#​4563](https://redirect.github.com/PyO3/pyo3/pull/4563 )
- Fix regression in 0.22.3 failing compiles under
`#![forbid(unsafe_code)]`.
[#​4574](https://redirect.github.com/PyO3/pyo3/pull/4574 )
- Workaround possible use-after-free in `_borrowed` methods on
`PyWeakRef` and `PyWeakrefProxy` by leaking their contents.
[#​4590](https://redirect.github.com/PyO3/pyo3/pull/4590 )
- Fix crash calling `PyType_GetSlot` on static types before Python 3.10.
[#​4599](https://redirect.github.com/PyO3/pyo3/pull/4599 )
</details>
---
### Configuration
📅 **Schedule**: Branch creation - "on monday" (UTC), Automerge - At any
time (no schedule defined).
🚦 **Automerge**: Disabled by config. Please merge this manually once you
are satisfied.
♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.
👻 **Immortal**: This PR will be recreated if closed unmerged. Get
[config
help](https://redirect.github.com/renovatebot/renovate/discussions ) if
that's undesired.
---
- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box
---
This PR was generated by [Mend Renovate](https://mend.io/renovate/ ).
View the [repository job
log](https://developer.mend.io/github/dora-rs/dora ).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzOC4xMTUuMSIsInVwZGF0ZWRJblZlciI6IjM4LjExNS4xIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6W119-->
1 year ago
renovate[bot]
ad46759c5f
Update dependencies
1 year ago
Haixuan Xavier Tao
4e51cd8cd1
Add translation example from chinese, french to english ( #681 )
This adds:
- a VAD node to detect voice within an audio to avoid having too much
noise
- Bump distil-whisper to whisper-turbo
- Use Argotranslate and OPUS-MT for translation
- Add example dataflow within the example folder
## Get started
```bash
cd examples/translation
dora up
dora build dataflow_zh_en_terminal.yml
dora start dataflow_zh_en_terminal.yml --detach
python pretty_print.py
```
1 year ago
Haixuan Xavier Tao
4f70121580
Make daemon loop over coordinator connection to make it possible to create a system service awaiting coordinator connection ( #689 )
Loop over trying to connect to the coordinator on first connection to
make it possible to await the coordinator to be ready.
This notably will make it possible to make dora daemon a system service
which can
```bash
sudo tee /etc/systemd/system/dora-daemon.service << EOF
[Unit]
Description=Dora Daemon in Conda Environment
After=network.target
[Service]
Environment="PATH=$PATH"
User=HwHiAiUser
WorkingDirectory=/home/HwHiAiUser
ExecStart=/bin/bash --login -c 'source /home/HwHiAiUser/.bashrc && source $CONDA_PATH/bin/activate base && dora daemon'
Restart=always
RestartSec=3
StartLimitInterval=60
StartLimitBurst=3
[Install]
WantedBy=multi-user.target
EOF
sudo systemctl daemon-reload
sudo systemctl enable dora-daemon.service
sudo systemctl start dora-daemon.service
```
1 year ago
Haixuan Xavier Tao
a90221d70b
Temporary fix qwenvl2 queue error ( #688 )
In order to get the best performance from Qwenvl2, we need to temporary
add this piece of code that is going to unqueue qwenvl queue.
This is directly linked to: https://github.com/dora-rs/dora/pull/652
which is that we currently having a queue issue within nodes for
`queue_size: 1` where the queue is actually pending older data and not
the newest one.
1 year ago
Haixuan Xavier Tao
015208afbd
Bump rerun version to 0.18 ( #686 )
This bump rerun version. This will requires to reinstall rerun with
```bash
cargo install rerun-cli@0.18.2 --locked
```
I might wait for `0.19` release that support video.
1 year ago
haixuanTao
e539c2dbd3
Add modelscope to all language libraries
1 year ago
haixuanTao
847994daf9
Update the readme for making the demo more impactful
1 year ago
haixuanTao
9ebd3dc107
Adding translation example using VAD, OPUS, ArgoTranslate, and a pretty printer for better readibility
1 year ago
Felix.HUANG
a22c6313a3
PR issues? fixed
1 year ago
Felix.HUANG
559bff479d
PR issues(black) fixed
1 year ago
Felix.HUANG
604bfd9310
PR issues fixed
1 year ago
Felix Huang
70dd004659
argostranslate added
1 year ago
haixuanTao
309b40aaf0
Add `modelscope` to qwenvl
1 year ago
haixuanTao
9133406c18
Add `README` section for rerun within the dataflow
1 year ago
haixuanTao
9e495c5dfd
Disable pylint fixme
1 year ago
haixuanTao
9dbaa955c5
Loop over trying to connect to the coordinator on first connection to make it possible to await the coordinator to be ready
1 year ago
haixuanTao
edc1467612
Add next call loop in qwenvl2 to queue fix
1 year ago
Haixuan Xavier Tao
a254d7007c
Enable multiline build for better packaging of dora node. ( #683 )
It is necessary to make build multiline in order to build certain node.
This allow users to do the following:
```bash
nodes:
- id: dora-microphone
build: |
pip install -e ../../node-hub/dora-microphones
pip install -e ../../node-hub/dora-vad
path: dora-microphone
```
or
```bash
nodes:
- id: dora-microphone
build: |
sudo apt install abc
pip install bar
path: dora-microphone
```
1 year ago
Haixuan Xavier Tao
903cb239d2
Enable downloading remote dataflow ( #682 )
This PR makes it possible to start a dataflow from scratch without
having to git clone a repository.
## Example
```bash
dora up
dora build 09f7f2927d/camera.yaml
dora start 09f7f2927d/camera.yaml
```
## Video
[Screencast from 2024-10-09
12-11-57.webm](https://github.com/user-attachments/assets/041ca5a0-7cd2-4dc6-bc34-aa94e6010166 )
## Small breaking change
- This slighlty change the logic of `download_file` function to use the
predefined downloaded file name instead of changing it when downloading.
- It removes the caching of `download_file` as there is now no way to
know if the filename and path is going to be the same before hand. I
think that if users want to have caching, they should link the path
before hand instead of using the url. This can be done in conjunction of
a build `wget` or `curl` command.
1 year ago
Haixuan Xavier Tao
2d8b9ee507
Add jpeg format to qwenvl2 ( #684 )
Small PR to enable jpeg encoded image communication when using qwenvl2.
1 year ago
haixuanTao
3c43f8c744
Add jpeg visualisation within rerun
1 year ago
haixuanTao
f44f779a98
Bump rerun version
1 year ago
LyonRust
4dcf2cf572
Fix small bug for jpeg encoding
1 year ago
Haixuan Xavier Tao
e2b469b82b
Add package flake ( #685 )
This means that someone using nix can add this to their flake inputs:
```nix
dora-rs = {
url = "github:dora-rs/dora";
inputs.nixpkgs.follows = "nixpkgs";
};
```
and that allows them to add dora-cli, v0.3.6, as one of the declared
packages of the system.
This is the first step towards adding dora to the nix package repo.
1 year ago
haixuanTao
254e74d4ac
Skip image that cannot be encoded
1 year ago