Raw Data Storage
Introduction
As the name implies, Raw Data Storage (RDS), can be used to store all raw data received by connectors. It receives messages containing raw, untransformed, and unformatted data to store their payload inside a database
How it works
This service is optional and may be used to extract tenant specific raw data at later time, i.e. for later data transformations if OIH Data Hub data models should change. To enable this feature, set the following flag for any connector in the corresponding nodeSettings
cfg.nodeSettings.storeRawRecord = true
The Ferryman will recognize the flag and automatically emit the raw data to RDS where it will be stored with an uuid reference. The transformed data stored in the DataHub will also store this uuid as a backreference to the raw data record.