Data Engineer Role Overview
We are seeking a detail-oriented Data Engineer to strengthen our data infrastructure. In this role, you will design, implement, and maintain data pipelines that support scalable data processing and analytics across the organization. Your work will directly impact how data is collected, stored, and accessed, enabling better insights and operational efficiency.
Key Responsibilities
- Build and manage scalable ETL pipelines to streamline data integration from diverse sources.
- Aggregate and structure complex datasets that align with business and technical requirements.
- Partner with data architects, analysts, and scientists to refine data needs and enhance workflow efficiency.
- Use monitoring tools such as Grafana and AWS CloudWatch to track system performance and resolve data pipeline issues.
- Ensure data integrity, availability, and security through governance and access controls.
- Design and maintain data storage systems, including data warehouses and data lakes.
- Automate data workflows to improve scalability and reduce manual intervention.
- Continuously monitor data infrastructure to maintain optimal performance and reliability.
- Stay current with advancements in data engineering technologies and best practices.
- Document data processes, pipelines, and standards to support team collaboration and knowledge sharing.
- Optimize database configurations for faster query performance and efficient storage management.