Fluvio SmartModules support the following in-line data transformation patterns:
A Filter SmartModule takes an input record and allows you to check if the record value meets certain criteria.
If false, the record is discarded, and if true, the record is saved, and continues downstream.
Checkout filter section for an example.
A Map SmartModule takes an input record allows you to apply any data transformations to the record before it continues downstream.
“Map” refers to the programming language term, which simply is a function that is applied to all input data.
Checkout map section for an example.
A FilterMap SmartModule takes one input record and returns zero or one output record.
As the name may imply, FilterMap is the combination of filter and map
You can check for conditions in the data and if met, apply transformations. Or if the conditions are not met, discard the record.
Checkout filter-map section for an example.
An ArrayMap SmartModule takes one input record and returns zero or many output records.
The Array in ArrayMap refers to a JSON array.
Given a single record that is a JSON array, you may flatten the single input array. The result is the creation of several individual records, which you may additionally apply transformations before returning.
Checkout array-map section for an example.
