United States Remote (Global)

Tiger Analytics is hiring a Data Engineer - Azure (Scala/Kafka)

Tiger Analytics is looking for a Senior Azure Data Engineer to develop bespoke AI and analytics solutions for Fortune 100 companies. In this role, you will combine data from different sources and align data systems directly with business goals.

What You'll Do

  • Develop bespoke solutions powered by data and technology.
  • Combine data from different sources.
  • Strive for efficiency by aligning data systems with business goals.
  • Build data pipelines using Azure stack.
  • Harmonize raw data into a consumer-friendly format using Azure Databricks.
  • Extract, query, and join large data sets at scale.
  • Build data ingestion pipelines using Azure Data Factory to ingest structured and unstructured data.

What We're Looking For

  • Bachelor’s degree in Computer Science or a similar field.
  • 8+ years of experience in Data Engineering plus several years in the Analytics space.
  • Strong proficiency in Scala—coding experience is a must.
  • Strong proficiency in Kafka and ADF (Azure Data Factory) for data pipelines and migration experience is a must.
  • Experience with real-time streaming, Kafka, and API Integration.
  • Experience in PySpark.
  • Strong proficiency in Python programming.
  • Strong proficiency in SQL queries.
  • Experience building data pipelines using the Azure stack.
  • Experience using Apache Spark.
  • Good working experience on Delta Lake and ETL processing.
  • Prior experience working in a Unix environment.
  • Experience harmonizing raw data into a consumer-friendly format using Azure Databricks.
  • Experience extracting, querying, and joining large data sets at scale.
  • Experience building data ingestion pipelines using Azure Data Factory to ingest structured and unstructured data.
  • Strong communication and organizational skills.

Nice to Have

  • Experience in data wrangling and advanced analytic modeling is preferred.

Technical Stack

  • Scala
  • Kafka
  • ADF (Azure Data Factory)
  • Azure Synapses
  • PySpark
  • Python
  • SQL
  • Azure stack
  • Apache Spark
  • Delta Lake
  • Unix
  • Azure Databricks

Team & Environment

You will be part of our Data Engineering practice.

Benefits & Compensation

  • Excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.

Work Mode

This role operates in a global context and is open to candidates based in the USA.

Tiger Analytics is an equal opportunity employer.

Required Skills
ScalaKafkaAzure Data FactoryAzure Synapse AnalyticsPySparkPythonSQLApache SparkDelta LakeAzureData EngineeringETLData PipelinesBig DataCloud Computing
Scaling your freelance income?

Invoice multiple clients effortlessly

Managing 3+ international clients? Glopay streamlines everything. One EU company, unlimited invoices, automatic compliance. You just send and get paid.

Unlimited clients & invoices
Multi-currency support
Automated tax compliance
Client portal for easy payments
Scale with Glopay
Trusted by 10,000+ freelancers
About company
Tiger Analytics
Pioneers in AI and analytics solutions for Fortune 100 companies. Develops bespoke solutions powered by data and technology.
All jobs at Tiger Analytics Visit website
Job Details
Category data
Posted 8 months ago