Philipp Oppermann
f6cd2225a1
(empty)
2 years ago
Philipp Oppermann
b89ad660d7
Disable incremental compilation when sccache is used
See https://github.com/mozilla/sccache#rust
2 years ago
Philipp Oppermann
feff4ad4ec
Fix: set the `sscache` env variables for the whole job
2 years ago
Philipp Oppermann
d0c5c1468a
Use `sscache` instead of `rust-cache` for caching on CI
2 years ago
Haixuan Xavier Tao
ccec196234
Merge pull request #235 from dora-rs/prevent-queue-buildup
Wait on events and messages simultaneously to prevent queue buildup
2 years ago
Philipp Oppermann
974d315697
Remove resolved TODO
2 years ago
Haixuan Xavier Tao
d952e805d2
Merge pull request #236 from dora-rs/start-together
Synchronize node and operator start
2 years ago
Philipp Oppermann
07063e4ff9
dora-runtime: Only subscribe to daemon once all operators are ready
2 years ago
Philipp Oppermann
a9582e80d1
Only start timer tasks once dataflow is ready to start
This avoids filling the queue with outdated timer ticks.
2 years ago
Philipp Oppermann
2b0da5350b
Synchronize startup of nodes through subscribe request
2 years ago
Philipp Oppermann
bb005fa1fe
Wait on events and messages simultaneously to prevent queue buildup
Before we only received the events from the queue when the next message arrived from the node. This could result in very large queue lengths when nodes call dora functions infrequently (e.g. when they do a lot of processing). By waiting for both new events and new messages at the same time, we can drop old events directly and avoid this queue buildup.
2 years ago
Philipp Oppermann
d225a54eea
Make `connection` a generic argument instead of a struct field
2 years ago
Haixuan Xavier Tao
f157bb44e1
Merge pull request #231 from dora-rs/configurable-queue-len
Make queue length configurable through the dataflow file
2 years ago
Philipp Oppermann
581f359bed
Consider queue sizes for operator inputs too
2 years ago
Philipp Oppermann
9db09ee930
Enable tracing for dora runtime by default
2 years ago
Philipp Oppermann
ffb62b591b
Rename remaining instances of `max_queue_len` to `queue_sizes`
2 years ago
Haixuan Xavier Tao
68da9bd8e0
Merge pull request #232 from dora-rs/release-v0.2.1
Bump Dora Version Release v0.2.1
2 years ago
haixuanTao
46284733e5
Move internal cli to other
2 years ago
Philipp Oppermann
2d9fcc95b4
Add custom parsing to be backwards compatible
Inputs can now either be a string, which results in a mapping with default values, or an object with additional configuration.
2 years ago
Philipp Oppermann
7d0d4dc9dc
Only log when `>0` inputs were dropped
2 years ago
haixuanTao
eab3c8c27c
Bump Dora version to 0.2.1
* [Make dora-rs publishable on crates.io](https://github.com/dora-rs/dora/pull/211 )
* [Add an internal cli argument to create template with path dependencies](https://github.com/dora-rs/dora/pull/212 )
* [Avoid blocking the daemon main loop by using unbounded queue](https://github.com/dora-rs/dora/pull/230 )
* [Inject YAML declared env variable into the runtime](https://github.com/dora-rs/dora/pull/227 )
* [Use rustls instead of system SSL implementation](https://github.com/dora-rs/dora/pull/216 )
* [Refactor python error](https://github.com/dora-rs/dora/pull/229 )
* [The first letter of rust should be lowercase in the command](https://github.com/dora-rs/dora/pull/226 )
* [Add documentation to the cli within the helper mode](https://github.com/dora-rs/dora/pull/225 )
* [Update to safer-ffi v0.1.0-rc1](https://github.com/dora-rs/dora/pull/218 )
* [remove unused variable: data_bytes](https://github.com/dora-rs/dora/pull/215 )
* [Clean up: Remove workspace path](https://github.com/dora-rs/dora/pull/210 )
* [Decouple opentelemetry from tracing](https://github.com/dora-rs/dora/pull/222 )
* [Remove zenoh dependency from dora node API to speed up build](https://github.com/dora-rs/dora/pull/220 )
* [Update to Rust v1.68](https://github.com/dora-rs/dora/pull/221 )
* [Deny unknown fields to avoid typos](https://github.com/dora-rs/dora/pull/223 )
2 years ago
Philipp Oppermann
7f3041ed6c
Allow configuring queue size per input
2 years ago
haixuanTao
8179e58cf9
Bump to release candidate
2 years ago
Philipp Oppermann
c9ecc87d3b
Rename `max_queue_len` to `queue_size`
2 years ago
Philipp Oppermann
d568613b41
Merge pull request #227 from dora-rs/fix-missing-env-variable
Fix missing env variable
2 years ago
Philipp Oppermann
86599a243c
Merge pull request #229 from dora-rs/refactor-python-error
Refactor python error
2 years ago
Philipp Oppermann
ad4ff0f00a
Merge pull request #230 from dora-rs/dont-wait
Avoid blocking the daemon main loop by using unbounded queue
2 years ago
Philipp Oppermann
e083ec8217
Add context to 'dropping inputs' log message
2 years ago
Philipp Oppermann
8c55397811
Make event queue length configurable
2 years ago
Philipp Oppermann
35b493d7d5
Use unbounded queue between daemon and subscriber tasks
The main loop of the daemon should not be blocked at any time.
2 years ago
Philipp Oppermann
1fcba07836
Don't wait in main event loop
2 years ago
haixuanTao
8ad1a74b7a
Better debugging messages
2 years ago
haixuanTao
4ab7858483
Remove unnecessary typo in traceback
2 years ago
haixuanTao
2a9c9d4fe3
Remove unnecessary `unwrap` that cause a panic
2 years ago
haixuanTao
a04752ac1d
Add env variable in runtime node
2 years ago
Haixuan Xavier Tao
18d2c558c0
Merge pull request #211 from dora-rs/add-rust-api-info
Make `dora-rs` publishable on `crates.io`
2 years ago
haixuanTao
c112b6bd59
make header file const instead of static
2 years ago
haixuanTao
8e58396213
remove header file from template
2 years ago
haixuanTao
a83d5426f9
Reverse `Cargo.lock`
2 years ago
Philipp Oppermann
db82e47f0e
Merge pull request #225 from dora-rs/cli-documentation
Add documentation to the cli within the helper mode.
2 years ago
haixuanTao
f62a92755d
default version to original version after testing
2 years ago
haixuanTao
c4794725aa
Fix API description to use workspace
test new release for github CI/CD
2 years ago
haixuanTao
d8875b9e54
add documentation to crates release process
Bump release candidate
2 years ago
haixuanTao
da6dab04aa
Reorder cargo publish
2 years ago
haixuanTao
c1e11c4500
Add publishable crates with newly pushed crates
Test new version
2 years ago
haixuanTao
69bfd1e8c5
Replace git `raw_sync` with cargo `raw_sync_2` to publish our own crate on `crates.io`
2 years ago
haixuanTao
ad2d08dc97
Copy c header file in template to avoid copying it from outside of
the src code.
This is link to a release issue. See: https://users.rust-lang.org/t/include-str-does-not-work-when-releasing-because-of-changed-pathes/15551
testing new release version
2 years ago
haixuanTao
7a7a20a298
Add missing licenses and centralise license definition
test new crates version release
2 years ago
haixuanTao
e6b34c5f93
Add required tokio `fs` flag
Testing new crates version
2 years ago
haixuanTao
2f6e988cfb
Adding dora-operator-api release as #218 is fixed
test new crates release
2 years ago