Fluvio SmartModules support the following in-line data transformation patterns:
A Filter SmartModule takes an input record and allows you to check if the record value meets certain criteria.
false, the record is discarded, and if
true, the record is saved, and continues downstream.
filter section for an example.
A Map SmartModule takes an input record allows you to apply any data transformations to the record before it continues downstream.
“Map” refers to the programming language term, which simply is a function that is applied to all input data.
map section for an example.
A FilterMap SmartModule takes one input record and returns zero or one output record.
You can check for conditions in the data and if met, apply transformations. Or if the conditions are not met, discard the record.
filter-map section for an example.
An ArrayMap SmartModule takes one input record and returns zero or many output records.
The Array in ArrayMap refers to a JSON array.
Given a single record that is a JSON array, you may flatten the single input array. The result is the creation of several individual records, which you may additionally apply transformations before returning.
array-map section for an example.