Many people don't know or misunderstand the meaning of ETL developer. In this post I will try to explain.
E for Extract
All business data is stored in one place — the Data Source Layer. At the same time, all this data is divided between numerous software and structured in various formats.
T for Transform
Once data collection starts, all data needs to be stored in the place called Staging Area.
L for Loading
It’s a final frontier of all ETL processes. All the data collected and transformed previously is loaded into the Warehouse Layer.
Among other ETL developer responsibilities are the following:
- ETL process management
- Data modeling
- Warehouse architecture modeling
- Data pipeline creation
- ETL tools development
- Testing (QA, ETL)