About the Role
The individual in this position will be responsible for developing and managing data pipelines, ensuring data accuracy, and supporting analytics initiatives across multiple platforms.
Responsibilities
- Design and implement robust data pipelines for structured and unstructured data sources.
- Develop and maintain ETL workflows to ensure reliable data integration.
- Optimize data storage and retrieval processes for performance and scalability.
- Collaborate with analysts and data scientists to understand reporting requirements.
- Ensure data quality through validation, cleansing, and monitoring procedures.
- Support cloud-based data platforms with infrastructure as code practices.
- Troubleshoot data-related issues and resolve system inefficiencies.
- Document data architectures, workflows, and system dependencies.
- Work with relational and non-relational databases to organize information effectively.
- Integrate data from disparate systems into centralized repositories.
- Apply version control to data engineering code and configuration files.
- Participate in agile development cycles and team planning sessions.
- Monitor data pipeline health and implement alerting mechanisms.
- Contribute to data governance and security standards.
- Assist in the migration of on-premise systems to cloud environments.
- Evaluate new tools and technologies for potential adoption in data workflows.
- Ensure compliance with data privacy regulations and internal policies.
- Support real-time and batch data processing needs.
- Collaborate with cross-functional teams to deliver end-to-end data solutions.
- Provide technical guidance during project scoping and estimation phases.
- Maintain awareness of industry trends in data engineering and cloud platforms.
- Assist in onboarding team members to data systems and tools.
- Improve data accessibility for business users through semantic layer development.
- Automate repetitive data tasks to increase team efficiency.
- Contribute to post-implementation reviews and system audits.
Compensation
Competitive salary and benefits package offered based on experience and location.
Work Arrangement
Hybrid work model with flexibility for remote and in-office collaboration.
Team
Collaborative team environment focused on delivering data solutions for diverse clients.
Why Join Us
- Opportunities for professional growth through hands-on projects and mentorship.
- Support for continuing education, certifications, and conference attendance.
Technology Stack
AWS, Snowflake, Tableau, Python, SQL, Git, Docker, Apache Airflow.
Sponsorship available for qualified candidates requiring work authorization.
