Files: Convert Format
This article provides a starter solution related to converting the format of a file.
What Does This Article Cover?
Some files contain data organized in an unconventional format. It might be beneficial to structure the data in a common format so that it can be processed by a downstream system. This article provides design considerations related to converting the format of a file and provides an example of converting to a file to a CSV format.
Intelligence Hub design considerations for converting file format
These considerations pertain to obtaining converting the format of a file.
- Intelligence Hub can be used to convert from one file format to another creating a new file. Alternatively, consider the ultimate destination system and create an Intelligence Hub solution that exchanges data directly with that system. For example, if the desired destination is Snowflake data warehouse, Intelligence Hub can be used to create a solution that parses a file and writes directly to a Snowflake table.
- An Intelligence Hub Pipeline Parse stage can be used to convert a file's format. It might also be necessary to use JavaScript in a Pipeline Transform Stage.
- Make sure to consider the amount and complexity of the JavaScript code and what is appropriate for an Intelligence Hub solution.
- A project file may be downloaded [here].
Additional Resources