Link Search Menu Expand Document


Raw Data Storage


As the name implies, Raw Data Storage (RDS), can be used to store all raw data received by connectors. It receives messages containing raw, untransformed, and unformatted data to store their payload inside a database

API Reference Implementation

How it works

This service is optional and may be used to extract tenant specific raw data at later time, i.e. for later data transformations if OIH Data Hub data models should change. To enable this feature, set the following flag for any connector in the corresponding nodeSettings

cfg.nodeSettings.storeRawRecord = true

The Ferryman will recognize the flag and automatically emit the raw data to RDS where it will be stored with an uuid reference. The transformed data stored in the DataHub will also store this uuid as a backreference to the raw data record.