Responsibilities
- Design and lead the implementation of data flows to connect operational systems and capture data for analytic and business intelligence systems.
- Recognize opportunities to re-use existing data flows.
- Lead the building of data streaming systems.
- Optimize the code to ensure processes perform optimally.
- Lead routine work on database management.
- Understand information security and the types of security controls that can be used to mitigate security threats within solutions and services.
- Effectively translate and accurately communicate across technical and non-technical stakeholders, as well as facilitate discussions within a multidisciplinary team, with potentially difficult dynamics.
- Advocate for the team externally and manage differing perspectives.
- Undertake data profiling and source system analysis and present clear insights to colleagues to support the end use of the data.
- Participate in the design, building and testing of data products; work with teams to complete data integration services.
- Assist with selecting and implementing the appropriate technologies to deliver resilient, scalable and future-proof data solutions.
- Understand the concepts and principles of data modeling and produce relevant data models across multiple subject areas; reverse engineer data models from a live system.
- Understand industry recognized data modeling patterns and standards and when to apply them; compare and align different data models.
- Understand the impact on the organization of emerging trends in data tools, analysis techniques and data usage.
- Design an appropriate metadata repository and present changes to existing metadata repositories; understand a range of tools for storing and working with metadata; provide oversight and advice to more inexperienced members of the team.
- Own an issue until a new owner has been found or the problem has been mitigated and / or resolved.
- Initiate and monitor actions to investigate patterns and trends to resolve problems, including consulting specialists where required; determine the appropriate remedy and assists with implementation of these as well as preventative measures.
- Use agreed upon standard and tool to design, code, test, correct and document moderate to complex programs and scripts from agreed specifications and subsequent iterations; collaborate with others to review specifications where appropriate.
- Take inputs and establish coherent frameworks that work.
- Understand core technical concepts related to their role and apply them with guidance.
- Review requirements, specifications and define test conditions; identify issues and risks associated with work whilst being able to analyze and report test activities and results.
Requirements
- Bachelor of Science Degree in Computer Science, or a Bachelor of Arts Degree in a related technical field, 5-10 years related work experience in data engineering or similar role
- Or any equivalent combination of experience and training/certification in platform maintenance and development
- Experience building and optimizing big data pipeline architectures and data sets
- Experience with object oriented/object function scripting languages such as Scala and/or Python
- Experience with public cloud technologies in Google (preferred), AWS and Azure
- Experience with relational and NoSQL databases such as SQL Server, Postgres, Cassandra, etc.
- Working knowledge of message queuing, stream processing and highly scalable big data stores
- Experience with financial/ERP systems such as Oracle Cloud ERP
- Experience with big data applications such as Hadoop, Spark, Kafka, etc.
- You have built processes that support data transformation, data structures, metadata, dependency and workload management
- A successful history of manipulation, processing and extracting value from data sets
- Familiarity with Agile methodologies and development processes
- You have performed root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
- Experience supporting and working with cross-functional teams in a dynamic environment
- Experience with data pipeline and workflow management tools such as Airflow
Compensation
The hiring range for this position is: 94,160.00 - 141,240.00 USD Annual
Additional Information
- Eligibility for some benefits may depend on your job classification and length of employment.
- Benefits are subject to change and may be governed by specific plan or program terms.
- The final offer may vary based on factors such as geographic location, job-related skills, education, certifications, work experience, and other relevant considerations.
- Depending on the job level and role, it may include: Annual discretionary bonuses through our Core Company Performance Bonus Plan Equity grants, sign-on bonuses, and other tailored incentive opportunities Additional discretionary compensation, such as: Growing Revenue Incentives Safety Bonuses Deferred compensation opportunities
- The actual annualized salary offered at the time of hire will be communicated in the candidate’s offer letter.
- We remain committed to fairness and transparency across all locations.
- Where required, including for remote-eligible roles, local pay ranges are disclosed in accordance with applicable laws and regulations.
- Candidates must have authorization to work in the U.S. without the need for employer sponsorship now or in the future.
- This position is not eligible for student visa sponsorship, including F-1 OPT or CPT.
