Responsibilities
- Create and manage data processing pipelines using Azure Databricks
- Develop and tune data transformation workflows with PySpark and SQL in Databricks
- Set up and manage Lakehouse environments using Delta Lake
- Build ETL and ELT workflows coordinated through Azure Data Factory
- Bring together data from diverse sources into unified data platforms and analytics layers
- Construct and oversee data models and warehouse schemas for analytical use
- Maintain high data quality, system scalability, and efficient processing performance
- Work with BI teams to enable Power BI and other reporting tools
- Maintain and enhance existing SQL Server platforms and SSIS-based ETL processes as needed
- Assist in shaping modern, cloud-native data architecture designs
