About the Role
The role involves building and maintaining big data platforms using modern cloud technologies, enabling efficient data processing and analytics for enterprise clients.
Responsibilities
- Design and implement data pipelines for large-scale data processing
- Develop and manage cloud-based data storage solutions
- Optimize data workflows for performance and reliability
- Collaborate with data scientists and analysts to meet project needs
- Ensure data integrity and consistency across systems
- Monitor and troubleshoot data infrastructure issues
- Support the integration of diverse data sources
- Maintain documentation for data architectures and processes
- Work with distributed computing frameworks
- Implement data transformation and aggregation logic
- Contribute to system scalability and fault tolerance
- Assist in defining data governance practices
- Participate in code and design reviews
- Stay current with evolving big data technologies
- Support deployment and configuration of data platforms
Nice to Have
- Experience with real-time data processing frameworks
- Knowledge of machine learning pipelines
- Familiarity with data visualization tools
- Certifications in cloud platforms
- Experience in agile development environments
Compensation
Competitive salary based on experience
Work Arrangement
Hybrid work model with flexible scheduling
Team
Collaborative team focused on data innovation and engineering excellence
Technologies We Use
Azure Data Lake, Databricks, Apache Spark, Kafka, Delta Lake, Azure Synapse, Power BI
Professional Development
- Access to training programs, certifications, and conferences
- Internal knowledge-sharing sessions and technical mentorship
Available for qualified candidates
