Philipp Oppermann
77f9ba903e
Use compact formatting for stdout logs
We now have the full logs in the output file.
1 year ago
Philipp Oppermann
b7f21dbd4a
Log deamon and coordinator output to files
Logs the deamon output to `out/dora-daemon.txt` and the coordinator output to `out/dora-coordinator.txt`.
1 year ago
Philipp Oppermann
0e2858ccd6
Add `--quiet` flag to daemon and coordinator
Suppresses all log messages to stdout.
1 year ago
Philipp Oppermann
4f39c50a1c
Merge pull request #537 from dora-rs/improve-logging
Small logging improvements
1 year ago
Philipp Oppermann
e7d30e2da5
Merge pull request #543 from dora-rs/renovate/dependencies
chore(deps): update dependencies
1 year ago
renovate[bot]
9ccbe65b27
chore(deps): update dependencies
1 year ago
Haixuan Xavier Tao
d7be6a49e3
Merge pull request #472 from Michael-J-Ward/pyo3-bounds
Update Pyo3 bounds
1 year ago
Haixuan Xavier Tao
685b01e8fe
Merge pull request #539 from EricLBuehler/typos
Fix some typos and add automatic typos check to CI
1 year ago
Michael-J-Ward
bf088fc1eb
lint: fix clippy lint
1 year ago
Michael-J-Ward
af332c18f7
remove deprecated `py::new_pool`
The deprecation warning states:
> code not using the `GIL Refs` API can safely remove the use of `Py::new_pool`
All GIL Refs usage have been removed, so this should be fine.
2 years ago
Michael-J-Ward
25884b658a
update pyo3 to new bounds api
2 years ago
Michael-J-Ward
95de42a649
dora-record: remove 0 buffer argument to parquet AsyncArrowWriter
The argument was removed.
See: https://github.com/apache/arrow-rs/pull/5485
2 years ago
Michael-J-Ward
cd8ed19620
deps: upgrade pyo3 and arrow deps
Arrow needs to be upgraded alongside pyo3 because they both link to python.
NOTE: Arrow marked `ffi::from_ffi` unsafe.
https://github.com/apache/arrow-rs/pull/5080
2 years ago
EricLBuehler
8adb6e0cf4
Add typos check to ci
1 year ago
EricLBuehler
6c62246e53
Fix typos
1 year ago
Philipp Oppermann
80671c8133
Add more details when dropping node inputs
1 year ago
Philipp Oppermann
3e891601dd
Reduce log level for node output
1 year ago
Haixuan Xavier Tao
d4ff5868c5
Merge pull request #520 from dora-rs/improve-coordinator-port-config
Improve coordinator port config
1 year ago
Philipp Oppermann
d89ba3b920
Merge pull request #529 from dora-rs/renovate/dependencies
chore(deps): update dependencies
1 year ago
renovate[bot]
1be61b0c87
chore(deps): update dependencies
1 year ago
Philipp Oppermann
f25aad060a
Improve renovate group name
1 year ago
Philipp Oppermann
c7f159f950
Renovate: group all dependency updates in single PR (2nd try)
1 year ago
Philipp Oppermann
427f02960f
Merge pull request #524 from dora-rs/renovate-fix
Renovate: group all dependency updates in single PR
1 year ago
Philipp Oppermann
7a76f9b019
Renovate: group all dependency updates in single PR
1 year ago
Philipp Oppermann
89b97d75f2
Add `LOCALHOST` and `LISTEN_WILDCARD` constants to simplify code
1 year ago
Philipp Oppermann
02b5c7d443
Remove `coordinator_addr` and `coordinator_port` arguments from `dora up`
The `dora up` command always starts a coordinator and daemon in local mode using the default config. For non-standard config and for remote setups, users need to use `dora coordinator` and `dora daemon` directly.
1 year ago
Philipp Oppermann
8aa1303445
Merge branch 'main' into improve-coordinator-port-config
1 year ago
Haixuan Xavier Tao
7a940b86e6
Merge pull request #519 from dora-rs/cli-help
Provide help messages for CLI
1 year ago
Philipp Oppermann
142d218610
Add support for custom coordinator control port numbers in CLI
1 year ago
Philipp Oppermann
d037303373
Provide help messages for CLI
1 year ago
Philipp Oppermann
88d43d8b0c
Set default in CLI parsing
This way, the default address is shown as part of the `--help` output.
1 year ago
Philipp Oppermann
2ccba2b953
Allow setting custom control port in coordinator
1 year ago
Haixuan Xavier Tao
f50478b1a7
Merge pull request #513 from Gege-Wang/multiple-daemon
Make dora cli connect to remote coordinator
1 year ago
Gege-Wang
21f29091cc
fix: add check command
1 year ago
Gege-Wang
49e6994cda
fix: add dora coordinator control port
1 year ago
Gege-Wang
ce2b02fb05
fix: change the SocketAddr to IpAddr
1 year ago
Haixuan Xavier Tao
ec6af9705d
Merge pull request #510 from dora-rs/non-fatal-stdout
Make non-UTF8 stdout/stderr from nodes non-fatal
1 year ago
Haixuan Xavier Tao
105e04a807
Merge pull request #509 from dora-rs/renovate/configure
Configure Renovate
1 year ago
Haixuan Xavier Tao
e7858a61a9
Merge pull request #478 from dora-rs/dataflow-parsing
Allow top-level fields in node declaration
1 year ago
Gege-Wang
717c5d0639
test: change ip to localhost
1 year ago
Gege-Wang
d9ddeff87c
test: add coordinator-addr CI test
1 year ago
Miyamo
c75928239e
Make dora cli connect to remote coordinator
Signed-off-by: Gege-Wang <2891067867@qq.com>
fix: localhost to control_socket_addr()
1 year ago
Philipp Oppermann
a832b53a1a
Make non-UTF8 stdout/stderr from nodes non-fatal
Log a warning instead and do a lossy conversion to String. This ensures that `stdout`/`stderr` stay open, which avoids a `SIGPIPE` exit of the node on the next println.
1 year ago
Philipp Oppermann
8e1d000e6f
Disable dependabot again, which does not seem to work
Dependabot always times out, probably because we have too many dependencies in this repo.
1 year ago
Philipp Oppermann
dccf87c3f2
Change range strategy
1 year ago
Philipp Oppermann
e0a7ace455
Group lockfile updates into single PR
1 year ago
Philipp Oppermann
bfb01e08c6
Update renovate to only do lock file maintainance
1 year ago
Philipp Oppermann
c26ba1497e
Move `renovate.json` to `.github` folder
1 year ago
renovate[bot]
5bb5ee0e61
Add renovate.json
1 year ago
Philipp Oppermann
73648603f5
Regenerate dataflow JSON schemas
1 year ago