1. Data cleansing – Certain special characters are occurring in Name column needs to be removed.
2. Data cleansing – Office address has 10 spaces at the end, needs to be removed
3. Data Transformation – Office address needs to be split in to address, city, zip columns
4. Data Transformation – Columns have to be converted in to VARCHAR data types
5. Data Transformation – Business rule - Parent AGENT_MASTER needs to be applied.
6. Data Transformation – Business rule - IND needs to be derived from the city
7. Data Loading – Check for duplicates and discard them
8. Data Loading – Determine if the record is INSERT or UPDATE
9. Data Loading – If update then update the dates