You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+107-1Lines changed: 107 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -19,7 +19,7 @@
19
19
20
20
**Laygo** is the lightweight Python library for data pipelines that I wish existed when I first started. It's designed from the ground up to make data engineering simpler, cleaner, and more intuitive, letting you build resilient, in-memory data workflows with an elegant, fluent API.
21
21
22
-
It's built to grow with you. Scale seamlessly from a single local script to thousands of concurrent serverless functions with minimal operational overhead.
22
+
It's built to grow with you. Scale seamlessly from a single local script to thousands of concurrent serverless functions with minimal operational overhead. Process data in parallel, branch into multiple analysis paths, and handle errors gracefully - all with the same clean, chainable syntax.
23
23
24
24
**Key Features:**
25
25
@@ -31,6 +31,8 @@ It's built to grow with you. Scale seamlessly from a single local script to thou
-**Fan-out Processing**: Split pipelines into multiple concurrent branches for parallel analysis of the same dataset.
35
+
34
36
-**Distributed by Design**: Your pipeline script is both the manager and the worker. When deployed as a serverless function or a container, this design allows you to scale out massively by simply running more instances of the same code. Your logic scales the same way on a thousand cores as it does on one.
35
37
36
38
-**Powerful Context Management**: Share state and configuration across your entire pipeline for advanced, stateful processing.
@@ -197,6 +199,110 @@ results = (
197
199
)
198
200
```
199
201
202
+
### Pipeline Branching (Fan-out Processing)
203
+
204
+
```python
205
+
from laygo import Pipeline
206
+
from laygo.transformers.transformer import createTransformer
Copy file name to clipboardExpand all lines: wiki/Home.md
+107-1Lines changed: 107 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -19,7 +19,7 @@
19
19
20
20
**Laygo** is the lightweight Python library for data pipelines that I wish existed when I first started. It's designed from the ground up to make data engineering simpler, cleaner, and more intuitive, letting you build resilient, in-memory data workflows with an elegant, fluent API.
21
21
22
-
It's built to grow with you. Scale seamlessly from a single local script to thousands of concurrent serverless functions with minimal operational overhead.
22
+
It's built to grow with you. Scale seamlessly from a single local script to thousands of concurrent serverless functions with minimal operational overhead. Process data in parallel, branch into multiple analysis paths, and handle errors gracefully - all with the same clean, chainable syntax.
23
23
24
24
**Key Features:**
25
25
@@ -31,6 +31,8 @@ It's built to grow with you. Scale seamlessly from a single local script to thou
-**Fan-out Processing**: Split pipelines into multiple concurrent branches for parallel analysis of the same dataset.
35
+
34
36
-**Distributed by Design**: Your pipeline script is both the manager and the worker. When deployed as a serverless function or a container, this design allows you to scale out massively by simply running more instances of the same code. Your logic scales the same way on a thousand cores as it does on one.
35
37
36
38
-**Powerful Context Management**: Share state and configuration across your entire pipeline for advanced, stateful processing.
@@ -197,6 +199,110 @@ results = (
197
199
)
198
200
```
199
201
202
+
### Pipeline Branching (Fan-out Processing)
203
+
204
+
```python
205
+
from laygo import Pipeline
206
+
from laygo.transformers.transformer import createTransformer
0 commit comments