Conversation
Signed-off-by: kohlisid <sidhant.kohli@gmail.com>
Signed-off-by: kohlisid <sidhant.kohli@gmail.com>
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #351 +/- ##
=======================================
Coverage 92.65% 92.65%
=======================================
Files 67 67
Lines 3514 3514
Branches 229 229
=======================================
Hits 3256 3256
Misses 193 193
Partials 65 65 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
packages/pynumaflow/README.md
Outdated
| | Functionality | Server Class(es) | | ||
| |---|---| | ||
| | [**UDSource**](https://github.com/numaproj/numaflow-python/tree/main/packages/pynumaflow/examples/source) | [SourceAsyncServer](https://github.com/numaproj/numaflow-python/blob/main/packages/pynumaflow/examples/source/simple_source/example.py) | | ||
| | [**UDSink**](https://github.com/numaproj/numaflow-python/tree/main/packages/pynumaflow/examples/sink) | [SinkServer](https://github.com/numaproj/numaflow-python/blob/main/packages/pynumaflow/examples/sink/log/example.py), [SinkAsyncServer](https://github.com/numaproj/numaflow-python/blob/main/packages/pynumaflow/examples/sink/async_log/example.py) | | ||
| | [**Side Input**](https://github.com/numaproj/numaflow-python/tree/main/packages/pynumaflow/examples/sideinput) | [SideInputServer](https://github.com/numaproj/numaflow-python/blob/main/packages/pynumaflow/examples/sideinput/simple_sideinput/example.py) | | ||
| | [**Map**](https://github.com/numaproj/numaflow-python/tree/main/packages/pynumaflow/examples/map) | [MapServer](https://github.com/numaproj/numaflow-python/blob/main/packages/pynumaflow/examples/map/even_odd/example.py), [MapAsyncServer](https://github.com/numaproj/numaflow-python/blob/main/packages/pynumaflow/examples/map/async_forward_message/example.py), [MapMultiprocServer](https://github.com/numaproj/numaflow-python/blob/main/packages/pynumaflow/examples/map/multiproc_map/example.py) | | ||
| | [**Reduce**](https://github.com/numaproj/numaflow-python/tree/main/packages/pynumaflow/examples/reduce) | [ReduceAsyncServer](https://github.com/numaproj/numaflow-python/blob/main/packages/pynumaflow/examples/reduce/counter/example.py) | | ||
| | [**Reduce Stream**](https://github.com/numaproj/numaflow-python/tree/main/packages/pynumaflow/examples/reducestream) | [ReduceStreamAsyncServer](https://github.com/numaproj/numaflow-python/blob/main/packages/pynumaflow/examples/reducestream/counter/example.py) | | ||
| | [**Map Stream**](https://github.com/numaproj/numaflow-python/tree/main/packages/pynumaflow/examples/mapstream) | [MapStreamAsyncServer](https://github.com/numaproj/numaflow-python/blob/main/packages/pynumaflow/examples/mapstream/flatmap_stream/example.py) | | ||
| | [**Batch Map**](https://github.com/numaproj/numaflow-python/tree/main/packages/pynumaflow/examples/batchmap) | [BatchMapAsyncServer](https://github.com/numaproj/numaflow-python/blob/main/packages/pynumaflow/examples/batchmap/flatmap/example.py) | | ||
| | [**Accumulator**](https://github.com/numaproj/numaflow-python/tree/main/packages/pynumaflow/examples/accumulator) | [AccumulatorAsyncServer](https://github.com/numaproj/numaflow-python/blob/main/packages/pynumaflow/examples/accumulator/streamsorter/example.py) | | ||
| | [**Source Transform**](https://github.com/numaproj/numaflow-python/tree/main/packages/pynumaflow/examples/sourcetransform) | [SourceTransformServer](https://github.com/numaproj/numaflow-python/blob/main/packages/pynumaflow/examples/sourcetransform/event_time_filter/example.py), [SourceTransformAsyncServer](https://github.com/numaproj/numaflow-python/blob/main/packages/pynumaflow/examples/sourcetransform/async_event_time_filter/example.py), SourceTransformMultiProcServer | |
There was a problem hiding this comment.
should we point to https://numaproj.io/numaflow-python/latest/api/, WDYT?
There was a problem hiding this comment.
Prefer to keep the table and point to the modules under the api? Or remove altogether
There was a problem hiding this comment.
keep the table and point to API? @BulkBeing any thoughts?
packages/pynumaflow/README.md
Outdated
| > [!IMPORTANT] | ||
| > MultiProcess forks N independent gRPC servers within the same container. The `server_count` parameter is required: `MapMultiprocServer(handler, server_count=2)`. |
There was a problem hiding this comment.
Multiprocess does not work, so we can ignore this callout? Details - numaproj/numaflow#2903 (comment)
There was a problem hiding this comment.
Yeah! Actually, I wanted to incorporate that detail as well.
As we aren't deprecating it, should we rather callout that currently multiproc works only with golang dataplane. Or we do not want to endorse that completely?
There was a problem hiding this comment.
let's remove it from the doc because we do not know when we are going to support. Golang dataplane is EOL :)
There was a problem hiding this comment.
+1 on removing all references for now then!
Signed-off-by: kohlisid <sidhant.kohli@gmail.com>
Kindly explain what this PR does.