Data integration is the combination of technical and business processes used to combine data from disparate sources into meaningful and valuable information. Today, some systems may store data in a denormalized form — and data integration tools are able to handle those. In this post, Talend will be used to showcase handling simple denormalized dataset files.

For example, the system stores state data with the following schema: [filed1];[[filed2.1],[filed2.2]] Schema is mapping [StateID];[[StateName],[PostCode]]. Here is the sample file states.csv:

StateID;StateName,PostCode
1;Alabama,009234
2;Alaska,009235
3;Arizona,009236
4;Arkansas,009237
5;California,009244
6;Colorado,009245
7;Connecticut,009214
8;Delaware,009278
9;Florida,0092897
10;Georgia,009247

Start Development in Talend Studio

1. Drop the following components from the Palette onto the design workspace: tFileInputFullRow, tExtractDelimitedFields, and tLogRow.
2. Connect them using the Row Main links.

Configuring the Components

1. Double-click the tExtractDelimitedFields component to open its Basic settings view. Add the file path and skip the header line.

   

   Update the schema as shown below:

   

2. Double-click the tFileInputFullRow component to open its Basic settings view. Edit the schema.

   

3. Double-click the tLogRow component to open its Basic settings view. Edit the schema.

   

Running

1. Save it and press F6:

And that's it!