Philipp Oppermann
64a2dc9c19
Wip
7 months ago
Philipp Oppermann
d8615c74be
Wip
7 months ago
Philipp Oppermann
94b1d02ca7
Wip
7 months ago
Philipp Oppermann
389059fd85
Wip
7 months ago
Philipp Oppermann
0abd3a0280
Wip
7 months ago
Philipp Oppermann
83baae6ccb
Wip
7 months ago
Philipp Oppermann
b22e8a1411
Wip
7 months ago
Philipp Oppermann
3adb413202
Wip
7 months ago
Philipp Oppermann
1d55ffb6b5
Wip
7 months ago
Philipp Oppermann
c7473182ad
Wip
7 months ago
Philipp Oppermann
ed224d62e7
Wip
7 months ago
Philipp Oppermann
baa163f335
Wip
7 months ago
Philipp Oppermann
695c454473
Wip
7 months ago
Philipp Oppermann
e583d4d23b
Wip
7 months ago
Philipp Oppermann
effff21173
Wip
7 months ago
Philipp Oppermann
e897f78024
Add extra error cause when node fails to spawn
for better error messages
8 months ago
Philipp Oppermann
c9a720d7ae
Error if coordinator doesn't reply properly
Instead of sending `CoordinatorStopped`.
This should make it easier to debug when a reply is not sent as expected.
9 months ago
Philipp Oppermann
90733aabeb
Send build output to CLI
The coordinator now sends an immediate `DataflowStartTriggered` reply when receiving a `DataflowStart` command. This enables the CLI to directly attach to the dataflow and observe the build output.
To wait until the build/spawning is done, this commit introduces a new `WaitForSpawn` command, to which the coordinator replies with a `DataflowSpawned` message once the node has been started. We use this command for the `dora build` command.
9 months ago
Philipp Oppermann
3b00466e3b
Skip path check for operators with build commands
9 months ago
Philipp Oppermann
ead79013c8
Skip path checks for nodes with build command
9 months ago
Philipp Oppermann
bcb861932c
Make `dora build` command behave like `dora start` without spawning
Instead of running all the build commands directly, run them on their intended target machines through the coordinator.
This commit is a breaking change because a coordinator connection is now required for `dora build`.
9 months ago
Philipp Oppermann
49b87daeae
Handle dataflow spawn asynchronously in coordinator too
9 months ago
Philipp Oppermann
c0ac912fc2
Simplify UNC working directory paths on Windows
Fixes the tests/examples of this repo. A UNC path as working directory doesn't work because the build commands of our examples invoke `cargo` on the dora repo. The dora repo uses wildcards in the member list in the top-level Cargo.toml, which are ignored in UNC-paths. Thus, `failed to load manifest for workspace member` errors occur.
9 months ago
Philipp Oppermann
e31b2a3489
Remove needless cloning of node `env` field for building
9 months ago
Philipp Oppermann
6998964cda
Merge branch 'main' into git-source
9 months ago
Shar-jeel-Sajid
4647ee23c8
using context in error handling
10 months ago
Shar-jeel-Sajid
c655d1f103
formatting
10 months ago
Shar-jeel-Sajid
755c5b452a
Made conversion generic
10 months ago
haixuanTao
26c3917470
Fix GPU Memory not displayed
10 months ago
haixuanTao
48cb5ae709
Use current tokio threadpool and update otlp to latest version
10 months ago
Philipp Oppermann
e8d7bb02fb
Add support for git repo sources for nodes
10 months ago
Shar-jeel-Sajid
a88196e331
linting and renaming
10 months ago
Shar-jeel-Sajid
0bb576008f
cast_values for f64
10 months ago
Shar-jeel-Sajid
0e4bcddb24
Added f16 type conversion
10 months ago
Shar-jeel-Sajid
524eaa0dec
Very small typo
Co-authored-by: Haixuan Xavier Tao <tao.xavier@outlook.com>
10 months ago
Shar-jeel-Sajid
ee5426565b
Combining macros
10 months ago
Shar-jeel-Sajid
77532746ff
procedural macros in from_impls file
10 months ago
Shar-jeel-Sajid
f89c2638ef
procedural macros in into_impls file
10 months ago
Haroon Tahir
7ceffa6d5c
Changed String conversion in from to simplify the code and handle edge cases removed arrow-convert crate from cargo.toml as well since it is not being used
10 months ago
Haroon Tahir
7872ef2483
Removed conversion for &String since &str covers that use case
10 months ago
Shar-jeel-Sajid
a25be9df0b
Now support conversion for chrono::NaiveDateTime
10 months ago
Shar-jeel-Sajid
a2ce18ae2b
Now support Date32,Date64,Tim32second,Time32millisecond,Time64microsecond,Time64nanosecond
10 months ago
Shar-jeel-Sajid
39a7bd25f7
Resolved issues
10 months ago
Shar-jeel-Sajid
fbba2ecd93
Added Datatype NaiveDate and NaiveTime
10 months ago
Haroon Tahir
9530603944
fixed string conversion to use reference
10 months ago
Haroon Tahir
90ab326504
Added missing types in from_impl.rs that were previously present in to_impl.rs and added in mutable string type conversion in both
10 months ago
Shar-jeel-Sajid
fef99c4c4e
Adding String DataType
10 months ago
Shar-jeel-Sajid
1e585b0fc1
Added TestCases
10 months ago
Shar-jeel-Sajid
48c3bb5b4a
Removing Deprecation
10 months ago
Mati-ur-rehman-017
3332c0a1ce
Fixed D100 issues
10 months ago