Importing Data from a Microsoft Excel file

In the Factory, you can import MS Excel files, specifying the data sheet you want to import.

  • Dragging the Excel file directly onto the Stage, automatically creating an Import from Excel task;

  • Dragging an Import from Excel task onto the Stage. This operation allows you to make a more precise import operation, as you can:

    • Import a single file, choosing the specific datasheets to import;

    • Import multiple files together, concatenating them into a single dataset. For this operation, it is important that the Excel files have the same structure.

Rulex's technical documentation does not and cannot provide comprehensive guidelines on the use of third-party software, beyond how Rulex integrates with this software. Please consult the technical documentation of the third-party software itself for up to date information.


Prerequisites

  • You must have created a flow;

  • If you are importing multiple files, they need to have the same structure.


Procedure

  1. Drag an Import from Excel File task onto the stage.

  2. Double click the task and open it.

  3. Select whether you want to use a Saved source or a Custom source.

  4. Choose from the drop down list if you want to import the file from your computer (Local) or from a Remote Filesystem.

    1. If you are importing from a Remote Filesystem, choose it from the list and then click on the pencil button to set the connection information required (only if you are using a Custom source). The tables are loaded in the Files tab.

    2. If you are using a Local Filesystem, click on the Select button and choose the path where the file is stored.

  5. Click on the Add new path button, located next to the Select button, to add new paths where other files to be imported are stored. You can add as many paths as you want.

  6. Click on the X button, located next to the Select button, to cancel the corresponding path.

  7. Click on the Delete all paths button, located under the Add new path button, to cancel all the inserted paths.

  8. Choose the resources to import by clicking the Select button in the Path 1 section.

  9. Click on the Add new path button, located next to the Select button, to add a new path for a new resource. You can add as many paths as you want.

  10. Click on the X button, located next to the Select button, to cancel the corresponding path.

  11. Click on the Delete all paths button, located under the Add new path button, to cancel all the inserted paths.

  12. In the Sheets tab, select the sheets you want to import and the Sheet Import mode (Import selected sheets, Import all but the selected sheets, Import all sheets)

  13. In the Concatenation type box, select either:

    1. Detach to keep the imported files, or sheets from the same file, separate, or

    2. Concatenate if you want to merge them. You must then specify the concatenation type:
      - Inner concatenation includes only attributes that exist in both tables.
      - Outer concatenation final table includes all the attributes, filling in any missing values if necessary.

  14. Select if you want the columns to be matched by their Name or Position in the the Match Column by box.

  15. Click on the Excel Configuration tab and set the Parsing options and the Import options, as displayed in the table below.

  16. Save and compute the task.


Parsing and import options

Settings options

Description

Parsing options

Here you can set:

  • Missing string: enter the word that represents missing values in the dataset, for example “N/A”, “missing”. These words will be removed from the dataset, effectively leaving an empty cell.

Import options

  • Start importing from line: the number of the line from which the importing operations will start.

  • Stop importing at line: the number of the line where the importing operations will end. Leave the value 0 if you want the whole dataset to be imported.

  • Get names from line: the number of the line from which the column’s names will be taken.

  • Get types from line: the number of the line from which the attributes' types will be taken.

  • Remove empty rows: select the checkbox if you want to remove the empty rows from the imported dataset.

  • Remove empty columns: select the checkbox if you want to remove the empty columns from the imported dataset.

  • Case sensitive: select the checkbox if you want the upper cases to be considered different from lower cases. Read below all the consequences on your data if this checkbox is selected.

  • Strip spaces: select this option if you want to remove spaces surrounding strings. For example, the string “ class “ will be imported as “class”.

  • Add an attribute containing:

    • Filename, to add a column with the file name.

    • Sheetname, to add a column with the sheet name.

    • Both, to add two columns, one with the file name and one with the sheet name.

  • Use old computation data if source file is not available: if selected, data from the previous computations will be used if the source table is not available.

  • Continue the execution if the file is missing: if selected, computation of the task continues, even if the selected source files are not available.

  • Turn off smart type recognition: if selected, prevents automatic recognition of data types, leaving the generic nominal type. This option is useful when manual identification is preferable, for example when there is the risk of a code being misinterpreted as a date.

    However, if data types have been specifically defined in incoming MS Excel files, these data types will be maintained, even when the Turn off smart type recognition option has been selected.

  • Wait until the target file is present: if selected, Rulex polls the target file with the frequency specified (sleeptime) until it is available.


Focus on the Case Sensitive checkbox

We encourage you not to select the Case Sensitive checkbox, as it has a significant impact on the data analysis.

If the Case Sensitive checkbox is selected, the number of distinct values in a column can increase, causing a slight difference in the data analysis.

In fact, if we have two strings, 'Word' and 'word', they will be considered as two distinct values. This means that, if you write a function valid for the string 'word', it won't be valid for the string 'Word' too.

It might cause consequences also on attributes, because if we want to apply a function to the $"Word" attribute and we type $"word" in the formula bar, an error occurs during the computation process.