Explain Apache Beam python syntax
Operators in Python can be overloaded. In Beam, |
is a synonym for apply
, which applies a PTransform
to a PCollection
to produce a new PCollection
. >>
allows you to name a step for easier display in various UIs -- the string between the |
and the >>
is only used for these display purposes and identifying that particular application.
See https://beam.apache.org/documentation/programming-guide/#transforms