The Dynamodb Sink Connector is a sink connector which reads events from a fluvio topic, deserializes them as json and inserts those key value pairs based on the columns in the config.
# dynamodb-connector.yml version: 0.2.0 name: dynamodb-connector type: dynamodb-sink topic: dynamodb-test create_topic: true parameters: table-name: dynamodb-test column-names: col_1,col_2,col_3 column-types: N,N,S secrets: AWS_REGION: "us-west-2" AWS_ACCESS_KEY_ID: "" AWS_SECRET_ACCESS_KEY: ""
table-name- The name of the dynamodb table name
column-names- A comma separated list of the keys. The first key is the partition key
column-types- A comma separated list of the attribute types of the keys. These are
Sfor String, and
These keys are used for table creation. The incoming json is converted to the Dynamodb data types on insert.
AWS_REGION- The AWS Region
AWS_ACCESS_KEY_ID- The AWS Access Key Id
AWS_SECRET_ACCESS_KEY- The AWS Secret Access Key
This configuration file is used together with the
fluvio connector create command, like so:
$ fluvio connector create --config=./dynamodb-connector.yml
Input events are assumed to be JSON. If the data is not JSON deserializable, the record is ignored.