Whem integrating data from big Excel or CSV files, it would be desirable to have a pre-checking of their data validation. This way it would be easier and faster to detect errors defore the integration task is executed.
This pre-checking could be at the Excel/CSV provider. Its conditions could be:
- Avoid empty headers
- Avoid empty cells
- Ensure a valid number format for certain columns
- Ensure a regular expression for certain columns
As well, at the job execution log, it would be nice to know the line and data of the execition error, as it is not always displayed.