Responsibilities
- Design and manage ETL workflows using Python and PySpark in Azure Synapse Analytics environments, including Notebooks and Pipelines, to streamline data ingestion, transformation, and storage.
- Leverage data warehousing expertise to construct efficient storage models using star schema designs, fact tables, and dimension tables within Massively Parallel Processing SQL Pools.
- Pull data from diverse sources such as REST APIs, SQL databases, and CSV files for integration into analytics platforms.
- Apply advanced knowledge of Azure Synapse Analytics to build scalable and high-performance data pipelines and notebooks.
- Support the adoption of modern data fabric components including data lakes, lakehouses, delta lakes, and data cataloging systems to improve data organization and accessibility.
- Partner with data architects to develop data models and schemas that reflect business needs and analytical goals.
- Establish data validation rules and quality checks to ensure data integrity and consistency across systems.
- Troubleshoot and resolve performance issues in ETL processes to meet service level agreements and operational targets.
- Monitor execution of ETL jobs, identify failures or delays, and apply fixes to maintain pipeline stability.
- Document data engineering workflows, transformation logic, and data movement patterns thoroughly.
- Engage with cross-functional teams to gather data requirements and support data-driven projects.
- Enforce data security practices and adhere to governance and privacy regulations in all data operations.
Work Arrangement
Remote (Worldwide) — Latin America
Other
- This position is fully remote and tailored for candidates located in Latin America.
- Engineers have the chance to contribute to multiple client projects, fostering rapid professional development.
- Team members work with cutting-edge data technologies and collaborate with experienced industry experts.
- Projects deliver meaningful, measurable outcomes for client organizations.
- The team operates as a flexible, inclusive group with members across the United States and Central and South America.
