haixuantao
21a99ed237
Fix dora message publish
1 year ago
haixuantao
fe335cb8b1
Bump dora to version 0.3.8
1 year ago
haixuantao
34cdbc6fce
fix cargo lock
1 year ago
haixuanTao
73bd73c12a
Add test for queue latency
1 year ago
Leon
12b6ae3b99
feat: change name
Author: Leon <echo_ai@foxmail.com>
1 year ago
Leon
337b66eb6c
feat: Accepts two parameters, one is an array of three f64's and the other is an array of six f64's
- three f64 array [x, w, speed]
- six f64 array [x, y, z, rx, ry, rz] only used x, rz, and the speed is default 0.2
https://docs.ros.org/en/noetic/api/geometry_msgs/html/msg/Twist.html
Author: Leon <echo_ai@foxmail.com>
1 year ago
Leon
ce0629a42f
feat: Add Chongyoucar Control in node-hub
Added a control node for chongyoucar to receive text commands, 'forward' 'left' 'right' 'backward' and 'stop' to control the car's forward turning and backward stopping etc.
Author: Leon <echo_ai@foxmail.com>
1 year ago
haixuanTao
cd9c9ee8af
Bump to v0.3.7
1 year ago
haixuanTao
42a3817a9e
Bump version to v0.3.7-rc2
1 year ago
Haixuan Xavier Tao
d51f8ccb71
Update libraries/extensions/telemetry/metrics/src/lib.rs
Co-authored-by: Philipp Oppermann <dev@phil-opp.com>
bump dora to `0.3.7`
1 year ago
haixuanTao
376ebf81ec
Add peft requirement for custom adapter
Bump dora to 0.3.7-rc1
Minor dependency fix
Fix typo
1 year ago
haixuanTao
f1c497fa46
Bump dora to `0.3.7rc0`
1 year ago
Philipp Oppermann
7c44e7a2e6
Move more types from `dora-core` to `dora-message` to avoid dependency
Make `dora-message` a dependency of `dora-core`, instead of the other way around. This way, we can continue to freely bump the version of `dora-core` with the other workspace crates, without introducing errors such as #708 .
1 year ago
Haixuan Xavier Tao
2f5945fd6f
Add urdf visualization in rerun ( #704 )
Add urdf visualization for rerun by reusing
https://github.com/rerun-io/rerun-loader-python-example-urdf
The urdf loader from rerun has couple of small issues such as not being
on pip and having relative path complexity and so I might fork the
project to work on it from here.
Could be nice to have a bit of testing so I will live it open for now.
1 year ago
haixuanTao
37bfc31da9
Making dora-cli pip installable independantly from python
1 year ago
haixuanTao
6cb643fb5b
Small fix
1 year ago
haixuanTao
716c3e7ab9
Bump rust toolchains to `1.81`
1 year ago
renovate[bot]
59802d3b43
Update dependencies
1 year ago
renovate[bot]
ad46759c5f
Update dependencies
1 year ago
Haixuan Xavier Tao
015208afbd
Bump rerun version to 0.18 ( #686 )
This bump rerun version. This will requires to reinstall rerun with
```bash
cargo install rerun-cli@0.18.2 --locked
```
I might wait for `0.19` release that support video.
1 year ago
haixuanTao
3c43f8c744
Add jpeg visualisation within rerun
1 year ago
haixuanTao
b494a47d85
use `download_file` when calling build or start for a url dataflow
1 year ago
Philipp Oppermann
91a245d5e4
Update Rust crate hyper to v0.14.30 ( #680 )
This PR contains the following updates:
| Package | Type | Update | Change |
|---|---|---|---|
| [hyper](https://hyper.rs )
([source](https://redirect.github.com/hyperium/hyper )) | dependencies |
patch | `0.14.29` -> `0.14.30` |
---
### Release Notes
<details>
<summary>hyperium/hyper (hyper)</summary>
###
[`v0.14.30`](https://redirect.github.com/hyperium/hyper/releases/tag/v0.14.30 )
[Compare
Source](https://redirect.github.com/hyperium/hyper/compare/v0.14.29...v0.14.30 )
#### Bug Fixes
- **http1:** reject final chunked if missing 0
([4a51b2af](4a51b2afef ))
</details>
---
### Configuration
📅 **Schedule**: Branch creation - "on monday" (UTC), Automerge - At any
time (no schedule defined).
🚦 **Automerge**: Disabled by config. Please merge this manually once you
are satisfied.
♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.
🔕 **Ignore**: Close this PR and you won't be reminded about this update
again.
---
- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box
---
This PR was generated by [Mend Renovate](https://mend.io/renovate/ ).
View the [repository job
log](https://developer.mend.io/github/dora-rs/dora ).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzOC45Ny4wIiwidXBkYXRlZEluVmVyIjoiMzguOTcuMCIsInRhcmdldEJyYW5jaCI6Im1haW4iLCJsYWJlbHMiOltdfQ==-->
1 year ago
renovate[bot]
ee419203b1
Update dependencies
1 year ago
Philipp Oppermann
9ef3265611
Update dependencies ( #679 )
This PR contains the following updates:
| Package | Type | Update | Change |
|---|---|---|---|
| [arrow](https://redirect.github.com/apache/arrow-rs ) |
workspace.dependencies | minor | `53.0.0` -> `53.1.0` |
| [arrow-array](https://redirect.github.com/apache/arrow-rs ) |
workspace.dependencies | minor | `53.0.0` -> `53.1.0` |
| [arrow-data](https://redirect.github.com/apache/arrow-rs ) |
workspace.dependencies | minor | `53.0.0` -> `53.1.0` |
| [arrow-schema](https://redirect.github.com/apache/arrow-rs ) |
workspace.dependencies | minor | `53.0.0` -> `53.1.0` |
| [clap](https://redirect.github.com/clap-rs/clap ) | dependencies |
patch | `4.5.18` -> `4.5.19` |
| [futures](https://rust-lang.github.io/futures-rs )
([source](https://redirect.github.com/rust-lang/futures-rs )) |
dependencies | patch | `0.3.30` -> `0.3.31` |
| [futures](https://rust-lang.github.io/futures-rs )
([source](https://redirect.github.com/rust-lang/futures-rs )) |
dev-dependencies | patch | `0.3.30` -> `0.3.31` |
| [once_cell](https://redirect.github.com/matklad/once_cell ) |
dependencies | minor | `1.19.0` -> `1.20.2` |
| [parquet](https://redirect.github.com/apache/arrow-rs ) | dependencies
| minor | `53.0.0` -> `53.1.0` |
| [reqwest](https://redirect.github.com/seanmonstar/reqwest ) |
dependencies | patch | `0.12.7` -> `0.12.8` |
---
### Release Notes
<details>
<summary>apache/arrow-rs (arrow)</summary>
###
[`v53.1.0`](https://redirect.github.com/apache/arrow-rs/blob/HEAD/CHANGELOG.md#5310-2024-10-02 )
[Compare
Source](https://redirect.github.com/apache/arrow-rs/compare/53.0.0...53.1.0 )
[Full
Changelog](https://redirect.github.com/apache/arrow-rs/compare/53.0.0...53.1.0 )
**Implemented enhancements:**
- Write null counts in Parquet statistics when they are known to be zero
[#​6502](https://redirect.github.com/apache/arrow-rs/issues/6502 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
- Make it easier to find / work with `ByteView`
[#​6478](https://redirect.github.com/apache/arrow-rs/issues/6478 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Update lexical-core version due to soundness issues with current
version
[#​6468](https://redirect.github.com/apache/arrow-rs/issues/6468 )
- Add builder style API for manipulating `ParquetMetaData`
[#​6465](https://redirect.github.com/apache/arrow-rs/issues/6465 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
- `ArrayData.align_buffers` should support `Struct` data type / child
data
[#​6461](https://redirect.github.com/apache/arrow-rs/issues/6461 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Add a method to return the number of skipped rows in a `RowSelection`
[#​6428](https://redirect.github.com/apache/arrow-rs/issues/6428 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
- Bump lexical-core to 1.0
[#​6397](https://redirect.github.com/apache/arrow-rs/issues/6397 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Add union_extract kernel
[#​6386](https://redirect.github.com/apache/arrow-rs/issues/6386 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- implement `regexp_is_match_utf8` and `regexp_is_match_utf8_scalar` for
`StringViewArray`
[#​6370](https://redirect.github.com/apache/arrow-rs/issues/6370 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Add support for BinaryView in arrow_string::length
[#​6358](https://redirect.github.com/apache/arrow-rs/issues/6358 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Add `as_union` to `AsArray`
[#​6351](https://redirect.github.com/apache/arrow-rs/issues/6351 )
- Ability to append non contiguous strings to `StringBuilder`
[#​6347](https://redirect.github.com/apache/arrow-rs/issues/6347 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Add Catalog DB Schema subcommands to `flight_sql_client`
[#​6331](https://redirect.github.com/apache/arrow-rs/issues/6331 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
- Add support for Utf8View in arrow_string::length
[#​6305](https://redirect.github.com/apache/arrow-rs/issues/6305 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Reading FIXED_LEN_BYTE_ARRAY columns with nulls is inefficient
[#​6296](https://redirect.github.com/apache/arrow-rs/issues/6296 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
- Optionally verify 32-bit CRC checksum when decoding parquet pages
[#​6289](https://redirect.github.com/apache/arrow-rs/issues/6289 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
- Speed up `pad_nulls` for `FixedLenByteArrayBuffer`
[#​6297](https://redirect.github.com/apache/arrow-rs/pull/6297 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([etseidl](https://redirect.github.com/etseidl ))
- Improve performance of set_bits by avoiding to set individual bits
[#​6288](https://redirect.github.com/apache/arrow-rs/pull/6288 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([kazuyukitanimura](https://redirect.github.com/kazuyukitanimura ))
**Fixed bugs:**
- BitIterator panics when retrieving length
[#​6480](https://redirect.github.com/apache/arrow-rs/issues/6480 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Flight data retrieved via Python client (wrapping C++) cannot be used
by Rust Arrow
[#​6471](https://redirect.github.com/apache/arrow-rs/issues/6471 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- CI integration test failing: Archery test With other arrows
[#​6448](https://redirect.github.com/apache/arrow-rs/issues/6448 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
- IPC not respecting not preserving dict ID
[#​6443](https://redirect.github.com/apache/arrow-rs/issues/6443 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
- Failing CI: Prost requires Rust 1.71.1
[#​6436](https://redirect.github.com/apache/arrow-rs/issues/6436 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
- Invalid struct arrays in IPC data causes panic during read
[#​6416](https://redirect.github.com/apache/arrow-rs/issues/6416 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- REE Dicts cannot be encoded/decoded with streaming IPC
[#​6398](https://redirect.github.com/apache/arrow-rs/issues/6398 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Reading json `map` with non-nullable value schema doesn't error if
values are actually null
[#​6391](https://redirect.github.com/apache/arrow-rs/issues/6391 )
- StringViewBuilder with deduplication does not clear observed values
[#​6384](https://redirect.github.com/apache/arrow-rs/issues/6384 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Cast from Decimal(p, s) to dictionary-encoded Decimal(p, s) loses
precision and scale
[#​6381](https://redirect.github.com/apache/arrow-rs/issues/6381 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- LocalFileSystem `list` operation returns objects in wrong order
[#​6375](https://redirect.github.com/apache/arrow-rs/issues/6375 )
- `compute::binary_mut` returns `Err(PrimitiveArray<T>)` only with
certain arrays
[#​6374](https://redirect.github.com/apache/arrow-rs/issues/6374 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Exporting Binary/Utf8View from arrow-rs to pyarrow fails
[#​6366](https://redirect.github.com/apache/arrow-rs/issues/6366 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- warning: methods `as_any` and `next_batch` are never used in `parquet`
crate
[#​6143](https://redirect.github.com/apache/arrow-rs/issues/6143 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
**Documentation updates:**
- chore: add docs, part of
[#​37](https://redirect.github.com/apache/arrow-rs/issues/37 )
[#​6496](https://redirect.github.com/apache/arrow-rs/pull/6496 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
([ByteBaker](https://redirect.github.com/ByteBaker ))
- Minor: improve `ChunkedReader` docs
[#​6477](https://redirect.github.com/apache/arrow-rs/pull/6477 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([alamb](https://redirect.github.com/alamb ))
- Minor: Add some missing documentation to fix CI errors
[#​6445](https://redirect.github.com/apache/arrow-rs/pull/6445 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([etseidl](https://redirect.github.com/etseidl ))
- Fix doc "bit width" to "byte width"
[#​6434](https://redirect.github.com/apache/arrow-rs/pull/6434 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([kylebarron](https://redirect.github.com/kylebarron ))
- chore: add docs, part of
[#​37](https://redirect.github.com/apache/arrow-rs/issues/37 )
[#​6433](https://redirect.github.com/apache/arrow-rs/pull/6433 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([ByteBaker](https://redirect.github.com/ByteBaker ))
- chore: add docs, part of
[#​37](https://redirect.github.com/apache/arrow-rs/issues/37 )
[#​6424](https://redirect.github.com/apache/arrow-rs/pull/6424 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([ByteBaker](https://redirect.github.com/ByteBaker ))
- Rephrase doc comment
[#​6421](https://redirect.github.com/apache/arrow-rs/pull/6421 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
([waynexia](https://redirect.github.com/waynexia ))
- Remove "NOT YET FULLY SUPPORTED" comment from
DataType::Utf8View/BinaryView
[#​6380](https://redirect.github.com/apache/arrow-rs/pull/6380 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([alamb](https://redirect.github.com/alamb ))
- Improve `GenericStringBuilder` documentation
[#​6372](https://redirect.github.com/apache/arrow-rs/pull/6372 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([alamb](https://redirect.github.com/alamb ))
**Closed issues:**
- Columnar json writer for arrow-json
[#​6411](https://redirect.github.com/apache/arrow-rs/issues/6411 )
- Primitive `binary`/`unary` are not as fast as they could be
[#​6364](https://redirect.github.com/apache/arrow-rs/issues/6364 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
- Different numeric type may be able to compare
[#​6357](https://redirect.github.com/apache/arrow-rs/issues/6357 )
**Merged pull requests:**
- fix: override `size_hint` for `BitIterator` to return the exact
remaining size
[#​6495](https://redirect.github.com/apache/arrow-rs/pull/6495 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([Beihao-Zhou](https://redirect.github.com/Beihao-Zhou ))
- Minor: Fix path in format command in CONTRIBUTING.md
[#​6494](https://redirect.github.com/apache/arrow-rs/pull/6494 )
([etseidl](https://redirect.github.com/etseidl ))
- Write null counts in Parquet statistics when they are known
[#​6490](https://redirect.github.com/apache/arrow-rs/pull/6490 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([etseidl](https://redirect.github.com/etseidl ))
- Add configuration option to `StatisticsConverter` to control
interpretation of missing null counts in Parquet statistics
[#​6485](https://redirect.github.com/apache/arrow-rs/pull/6485 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([etseidl](https://redirect.github.com/etseidl ))
- fix: check overflow numbers while inferring type for csv files
[#​6481](https://redirect.github.com/apache/arrow-rs/pull/6481 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([CookiePieWw](https://redirect.github.com/CookiePieWw ))
- Add better documentation, examples and builer-style API to `ByteView`
[#​6479](https://redirect.github.com/apache/arrow-rs/pull/6479 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([alamb](https://redirect.github.com/alamb ))
- Add take_arrays util for getting entries from 2d arrays
[#​6475](https://redirect.github.com/apache/arrow-rs/pull/6475 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([akurmustafa](https://redirect.github.com/akurmustafa ))
- Deprecate `MetadataLoader`
[#​6474](https://redirect.github.com/apache/arrow-rs/pull/6474 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([etseidl](https://redirect.github.com/etseidl ))
- Update tonic-build requirement from =0.12.2 to =0.12.3
[#​6473](https://redirect.github.com/apache/arrow-rs/pull/6473 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
([dependabot\[bot\]](https://redirect.github.com/apps/dependabot ))
- Align buffers from Python (FFI)
[#​6472](https://redirect.github.com/apache/arrow-rs/pull/6472 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([EnricoMi](https://redirect.github.com/EnricoMi ))
- Add `ParquetMetaDataBuilder`
[#​6466](https://redirect.github.com/apache/arrow-rs/pull/6466 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([alamb](https://redirect.github.com/alamb ))
- Make `ArrayData.align_buffers` align child data buffers recursively
[#​6462](https://redirect.github.com/apache/arrow-rs/pull/6462 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([EnricoMi](https://redirect.github.com/EnricoMi ))
- Minor: Silence compiler warnings for `parquet::file::metadata::reader`
[#​6457](https://redirect.github.com/apache/arrow-rs/pull/6457 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([etseidl](https://redirect.github.com/etseidl ))
- Minor: Error rather than panic for unsupported for dictionary
`cast`ing
[#​6456](https://redirect.github.com/apache/arrow-rs/pull/6456 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([goldmedal](https://redirect.github.com/goldmedal ))
- Support cast between Durations + between Durations all numeric types
[#​6452](https://redirect.github.com/apache/arrow-rs/pull/6452 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([tisonkun](https://redirect.github.com/tisonkun ))
- Deprecate methods from footer.rs in favor of `ParquetMetaDataReader`
[#​6451](https://redirect.github.com/apache/arrow-rs/pull/6451 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([etseidl](https://redirect.github.com/etseidl ))
- Workaround for missing Parquet page indexes in `ParquetMetadaReader`
[#​6450](https://redirect.github.com/apache/arrow-rs/pull/6450 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([etseidl](https://redirect.github.com/etseidl ))
- Fix CI by disabling newly failing rust <> nanoarrow integration test
in CI
[#​6449](https://redirect.github.com/apache/arrow-rs/pull/6449 )
([alamb](https://redirect.github.com/alamb ))
- Add `IpcSchemaEncoder`, deprecate ipc schema functions, Fix IPC not
respecting not preserving dict ID
[#​6444](https://redirect.github.com/apache/arrow-rs/pull/6444 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
([brancz](https://redirect.github.com/brancz ))
- Add additional documentation and builder APIs to `SortOptions`
[#​6441](https://redirect.github.com/apache/arrow-rs/pull/6441 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([alamb](https://redirect.github.com/alamb ))
- Update prost-build requirement from =0.13.2 to =0.13.3
[#​6440](https://redirect.github.com/apache/arrow-rs/pull/6440 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
([dependabot\[bot\]](https://redirect.github.com/apps/dependabot ))
- Bump arrow-flight MSRV to 1.71.1
[#​6437](https://redirect.github.com/apache/arrow-rs/pull/6437 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
([gstvg](https://redirect.github.com/gstvg ))
- Silence warnings that `as_any` and `next_batch` are never used
[#​6432](https://redirect.github.com/apache/arrow-rs/pull/6432 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([etseidl](https://redirect.github.com/etseidl ))
- Add `ParquetMetaDataReader`
[#​6431](https://redirect.github.com/apache/arrow-rs/pull/6431 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([etseidl](https://redirect.github.com/etseidl ))
- Add RowSelection::skipped_row_count
[#​6429](https://redirect.github.com/apache/arrow-rs/pull/6429 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([progval](https://redirect.github.com/progval ))
- perf: Faster decimal precision overflow checks
[#​6419](https://redirect.github.com/apache/arrow-rs/pull/6419 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([andygrove](https://redirect.github.com/andygrove ))
- fix: don't panic in IPC reader if struct child arrays have different
lengths
[#​6417](https://redirect.github.com/apache/arrow-rs/pull/6417 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([alexwilcoxson-rel](https://redirect.github.com/alexwilcoxson-rel ))
- Reduce integration test matrix
[#​6407](https://redirect.github.com/apache/arrow-rs/pull/6407 )
([kou](https://redirect.github.com/kou ))
- Move lifetime of `take_iter` from iterator to its items
[#​6403](https://redirect.github.com/apache/arrow-rs/pull/6403 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([dariocurr](https://redirect.github.com/dariocurr ))
- Update lexical-core requirement from 0.8 to 1.0 (to resolve
RUSTSEC-2023-0086)
[#​6402](https://redirect.github.com/apache/arrow-rs/pull/6402 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([dariocurr](https://redirect.github.com/dariocurr ))
- Fix encoding/decoding REE Dicts when using streaming IPC
[#​6399](https://redirect.github.com/apache/arrow-rs/pull/6399 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([brancz](https://redirect.github.com/brancz ))
- fix: binary_mut should work if only one input array has null buffer
[#​6396](https://redirect.github.com/apache/arrow-rs/pull/6396 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([viirya](https://redirect.github.com/viirya ))
- Add `set_bits` fuzz test
[#​6394](https://redirect.github.com/apache/arrow-rs/pull/6394 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([alamb](https://redirect.github.com/alamb ))
- impl `From<ScalarBuffer<T>>` for `Buffer`
[#​6389](https://redirect.github.com/apache/arrow-rs/pull/6389 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([mbrobbel](https://redirect.github.com/mbrobbel ))
- Add `union_extract` kernel
[#​6387](https://redirect.github.com/apache/arrow-rs/pull/6387 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([gstvg](https://redirect.github.com/gstvg ))
- Clear string-tracking hash table when ByteView deduplication is
enabled
[#​6385](https://redirect.github.com/apache/arrow-rs/pull/6385 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([shanesveller](https://redirect.github.com/shanesveller ))
- fix: Stop losing precision and scale when casting decimal to
dictionary
[#​6383](https://redirect.github.com/apache/arrow-rs/pull/6383 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([andygrove](https://redirect.github.com/andygrove ))
- Add `ARROW_VERSION` const
[#​6379](https://redirect.github.com/apache/arrow-rs/pull/6379 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([samuelcolvin](https://redirect.github.com/samuelcolvin ))
- parquet writer: Raise an error when the row_group_index overflows i16
[#​6378](https://redirect.github.com/apache/arrow-rs/pull/6378 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([progval](https://redirect.github.com/progval ))
- Implement native support StringViewArray for `regexp_is_match` and
`regexp_is_match_scalar` function, deprecate `regexp_is_match_utf8` and
`regexp_is_match_utf8_scalar`
[#​6376](https://redirect.github.com/apache/arrow-rs/pull/6376 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([tlm365](https://redirect.github.com/tlm365 ))
- Update chrono-tz requirement from 0.9 to 0.10
[#​6371](https://redirect.github.com/apache/arrow-rs/pull/6371 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([dependabot\[bot\]](https://redirect.github.com/apps/dependabot ))
- Support StringViewArray interop with python: fix lingering C Data
Interface issues for \*ViewArray
[#​6368](https://redirect.github.com/apache/arrow-rs/pull/6368 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([a10y](https://redirect.github.com/a10y ))
- stop panic in `MetadataLoader` on invalid data
[#​6367](https://redirect.github.com/apache/arrow-rs/pull/6367 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([samuelcolvin](https://redirect.github.com/samuelcolvin ))
- Add support for BinaryView in arrow_string::length
[#​6359](https://redirect.github.com/apache/arrow-rs/pull/6359 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([Omega359](https://redirect.github.com/Omega359 ))
- impl `From<Vec<T>>` for `Buffer`
[#​6355](https://redirect.github.com/apache/arrow-rs/pull/6355 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([mbrobbel](https://redirect.github.com/mbrobbel ))
- Add breaking change from
[#​6043](https://redirect.github.com/apache/arrow-rs/issues/6043 )
to `CHANGELOG`
[#​6354](https://redirect.github.com/apache/arrow-rs/pull/6354 )
([mbrobbel](https://redirect.github.com/mbrobbel ))
- Benchmark for bit_mask (set_bits)
[#​6353](https://redirect.github.com/apache/arrow-rs/pull/6353 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([kazuyukitanimura](https://redirect.github.com/kazuyukitanimura ))
- Update prost-build requirement from =0.13.1 to =0.13.2
[#​6350](https://redirect.github.com/apache/arrow-rs/pull/6350 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
([dependabot\[bot\]](https://redirect.github.com/apps/dependabot ))
- fix: clippy warnings from nightly rust 1.82
[#​6348](https://redirect.github.com/apache/arrow-rs/pull/6348 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([waynexia](https://redirect.github.com/waynexia ))
- Add support for Utf8View in arrow_string::length
[#​6345](https://redirect.github.com/apache/arrow-rs/pull/6345 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([Omega359](https://redirect.github.com/Omega359 ))
- feat: add catalog/schema subcommands to flight_sql_client.
[#​6332](https://redirect.github.com/apache/arrow-rs/pull/6332 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight )]
([nathanielc](https://redirect.github.com/nathanielc ))
- Manually run fmt on all files under parquet
[#​6328](https://redirect.github.com/apache/arrow-rs/pull/6328 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([etseidl](https://redirect.github.com/etseidl ))
- Implement UnionArray logical_nulls
[#​6303](https://redirect.github.com/apache/arrow-rs/pull/6303 )
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow )]
([gstvg](https://redirect.github.com/gstvg ))
- Parquet: Verify 32-bit CRC checksum when decoding pages
[#​6290](https://redirect.github.com/apache/arrow-rs/pull/6290 )
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet )]
([xmakro](https://redirect.github.com/xmakro ))
\* *This Changelog was automatically generated by
[github_changelog_generator](https://redirect.github.com/github-changelog-generator/github-changelog-generator )*
</details>
<details>
<summary>clap-rs/clap (clap)</summary>
###
[`v4.5.19`](https://redirect.github.com/clap-rs/clap/blob/HEAD/CHANGELOG.md#4519---2024-10-01 )
[Compare
Source](https://redirect.github.com/clap-rs/clap/compare/v4.5.18...v4.5.19 )
##### Internal
- Update dependencies
</details>
<details>
<summary>rust-lang/futures-rs (futures)</summary>
###
[`v0.3.31`](https://redirect.github.com/rust-lang/futures-rs/blob/HEAD/CHANGELOG.md#0331---2024-10-05 )
[Compare
Source](https://redirect.github.com/rust-lang/futures-rs/compare/0.3.30...0.3.31 )
- Fix use after free of task in `FuturesUnordered` when dropped future
panics
([#​2886](https://redirect.github.com/rust-lang/futures-rs/issues/2886 ))
- Fix soundness bug in `task::waker_ref`
([#​2830](https://redirect.github.com/rust-lang/futures-rs/issues/2830 ))
This is a breaking change but allowed because it is soundness bug fix.
- Fix bugs in `AsyncBufRead::read_line` and `AsyncBufReadExt::lines`
([#​2884](https://redirect.github.com/rust-lang/futures-rs/issues/2884 ))
- Fix parsing issue in `select!`/`select_biased!`
([#​2832](https://redirect.github.com/rust-lang/futures-rs/issues/2832 ))
This is technically a breaking change as it will now reject a very odd
undocumented syntax that was previously accidentally accepted.
- Work around issue due to upstream `Waker::will_wake` change
([#​2865](https://redirect.github.com/rust-lang/futures-rs/issues/2865 ))
- Add `stream::Iter::{get_ref,get_mut,into_inner}`
([#​2875](https://redirect.github.com/rust-lang/futures-rs/issues/2875 ))
- Add `future::AlwaysReady`
([#​2825](https://redirect.github.com/rust-lang/futures-rs/issues/2825 ))
- Relax trait bound on non-constructor methods of
`io::{BufReader,BufWriter}`
([#​2848](https://redirect.github.com/rust-lang/futures-rs/issues/2848 ))
</details>
<details>
<summary>matklad/once_cell (once_cell)</summary>
###
[`v1.20.2`](https://redirect.github.com/matklad/once_cell/blob/HEAD/CHANGELOG.md#1202 )
[Compare
Source](https://redirect.github.com/matklad/once_cell/compare/v1.20.1...v1.20.2 )
- Remove `portable_atomic` from Cargo.lock if it is not, in fact, used:
[#​267](https://redirect.github.com/matklad/once_cell/pull/267 )
This is a work-around for this cargo
b[https://github.com/rust-lang/cargo/issues/10801 ](https://redirect.github.com/rust-lang/cargo/issues/10801 )0801.
###
[`v1.20.1`](https://redirect.github.com/matklad/once_cell/blob/HEAD/CHANGELOG.md#1201 )
[Compare
Source](https://redirect.github.com/matklad/once_cell/compare/v1.20.0...v1.20.1 )
- Allow using `race` module using just `portable_atomic`, without
`critical_section` and provide
better error messages on targets without atomic CAS instruction,
[#​265](https://redirect.github.com/matklad/once_cell/pull/265 ).
###
[`v1.20.0`](https://redirect.github.com/matklad/once_cell/compare/v1.19.0...v1.20.0 )
[Compare
Source](https://redirect.github.com/matklad/once_cell/compare/v1.19.0...v1.20.0 )
</details>
<details>
<summary>seanmonstar/reqwest (reqwest)</summary>
###
[`v0.12.8`](https://redirect.github.com/seanmonstar/reqwest/blob/HEAD/CHANGELOG.md#v0128 )
[Compare
Source](https://redirect.github.com/seanmonstar/reqwest/compare/v0.12.7...v0.12.8 )
- Add support for SOCKS4 proxies.
- Add `multipart::Form::file()` method for adding files easily.
- Add `Body::wrap()` to wrap any `http_body::Body` type.
- Fix the pool configuration to use a timer to remove expired
connections.
</details>
---
### Configuration
📅 **Schedule**: Branch creation - "on monday" (UTC), Automerge - At any
time (no schedule defined).
🚦 **Automerge**: Disabled by config. Please merge this manually once you
are satisfied.
♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.
👻 **Immortal**: This PR will be recreated if closed unmerged. Get
[config
help](https://redirect.github.com/renovatebot/renovate/discussions ) if
that's undesired.
---
- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box
---
This PR was generated by [Mend Renovate](https://mend.io/renovate/ ).
View the [repository job
log](https://developer.mend.io/github/dora-rs/dora ).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzOC45Ny4wIiwidXBkYXRlZEluVmVyIjoiMzguOTcuMCIsInRhcmdldEJyYW5jaCI6Im1haW4iLCJsYWJlbHMiOltdfQ==-->
1 year ago
renovate[bot]
ea1353520e
Update dependencies
1 year ago
Philipp Oppermann
b7ae767de0
Merge branch 'main' into openai-api-proxy
1 year ago
Philipp Oppermann
d6f766e9bc
Create Rust-based openai api proxy server in node hub
1 year ago
renovate[bot]
9fd4e3550f
Update dependencies
1 year ago
Haixuan Xavier Tao
8c1e81f780
Bump pyo3 and arrow versions ( #667 )
This PR brings later changes from pyo3, and fix incompatibilities.
1 year ago
haixuanTao
dd10bbf85c
Bump `pyo3` version to `0.22`
1 year ago
renovate[bot]
233cebb135
Update dependencies
1 year ago
haixuanTao
416f55b96d
Bump to version `0.3.6`
1 year ago
haixuanTao
8948ae202a
Bump dora version
1 year ago
Haixuan Xavier Tao
881f0418fd
Adding additional node in the node-hub ( #620 )
In order to simplify testing with a terminal, I have added couple of
simple nodes in the node-hub.
To use:
```bash
cd examples/terminal-dataflow
dora build dataflow.yml
dora start dataflow.yml
# Terminal A
terminal-print
# Terminal B
pyarrow-sender
```
Note that there might be issues with stopping the dataflow and you might
need to use `dora destroy`
# Video example
[Screencast from 2024-08-09
12-41-17.webm](https://github.com/user-attachments/assets/04db8e4f-652e-42a9-a42e-6c49d2ff9fae )
1 year ago
Haixuan Xavier Tao
01b561a0aa
Make dora versions compatible by using separate versioning for `dora-message` crate ( #614 )
By versioning the `dora-message` crate individually, we can use the
semver rules to encode which versions are compatible. This way, we can
allow different versions of dora to work together (e.g. CLI version can
be different than node API version), as long as the message formats are
compatible. Breaking message format changes are signaled by a
semver-incompatible release of `dora-message`. For example, 0.4.0 is not
compatible with 0.3.5.
One alternative approach could be to use the main version to signal
compatibility, i.e. the common version that we use for all dora crates.
This has the disadvantage that we might need to bump the minor version
of the main dora crate every time we want to change the message format
in a breaking way. As we still expect semi-regular breaking changes to
the message format in the near future, we want to avoid this churn. Once
we consider the message format more stable, we plan to revisit this
approach.
Fixes https://github.com/dora-rs/dora/issues/504
TODO
- [x] Update release script: We should not try to publish the
`dora-message` crate if there is no new version.
- [x] Relax version checks to only compare major/minor version
(according to semver compatibility rules).
1 year ago
renovate[bot]
9a06cd5e70
Update dependencies
1 year ago
haixuanTao
b29c6b2ec2
Rewrite terminal-print in rust and make it connect to multiple dataflow throughout time
1 year ago
renovate[bot]
3c49fbafc6
Update Rust crate reqwest to v0.12.7
1 year ago
renovate[bot]
fe181cb863
Update dependencies
1 year ago
renovate[bot]
c3fe304da3
Update dependencies
1 year ago
Philipp Oppermann
3469f8068b
Bump dora-message version to 0.4.0
1 year ago
renovate[bot]
8d11e9dbe5
Update Rust crate serde to v1.0.207
1 year ago
Philipp Oppermann
22373b28ac
Version comparison: Check for semver-compatibility instead of exact match
1 year ago
Philipp Oppermann
d6032265a2
Refactor: Move message definitions to `dora-message` crate ( #613 )
First step towards versioning the message definitions indepedently.
1 year ago
renovate[bot]
e2e9f18db6
Update dependencies
1 year ago
Philipp Oppermann
6a3dcecf33
Refactor: Move message definitions to `dora-message` crate
First step towards versioning the message definitions indepedently.
1 year ago
renovate[bot]
863014f3cd
Update dependencies
1 year ago
renovate[bot]
4d79e3ac2d
Update dependencies
1 year ago
Haixuan Xavier Tao
16ef29ab80
Merge pull request #601 from dora-rs/delay-node-drop
Delay dropping of `DoraNode` in Python until all event data is freed
1 year ago