Rockefeller Philanthropy Advisors is hiring a Senior AI Engineer - Data & Infrastructure for Multimodal Models. You will design and implement scalable, high-throughput data pipelines to support cutting-edge multimodal AI research, collaborating closely with model researchers.
What You'll Do
- Build and scale data infrastructure optimized for large-scale video and multimodal content processing across GPU clusters.
- Design preprocessing algorithms for video, audio, text, and image modalities to enable efficient extraction, synchronization, and normalization.
- Develop automated pipelines for large-scale video dataset acquisition, managing diverse formats, annotations, and embedded audio.
- Architect systems for scalable evaluation, including prompt-based scoring, perceptual metrics, caption generation, and retrieval diagnostics.
- Collaborate with research teams to co-design model architectures and training schedules across pretraining and fine-tuning stages.
- Optimize distributed data loading and pipeline throughput for training at scale, ensuring robustness across model variants.
- Manage infrastructure for experiment tracking, model versioning, and deployment workflows integrated with production and research platforms.
- Support backend engineering for seamless integration of data and model workflows from prototyping to inference.
What We're Looking For
- Proficient in Python with strong programming skills in backend, infrastructure, and data tooling.
- Minimum 2+ years experience building and maintaining petabyte-scale data pipelines and distributed systems across thousands of GPUs.
- Hands-on expertise in orchestration frameworks such as Kubernetes and SLURM for high-throughput workloads.
- Proven ability to architect and maintain large-scale distributed data processing and delivery systems.
- Experience collaborating with AI researchers and understanding model training requirements.
- Strong problem-solving, analytical, and debugging skills in complex infrastructure environments.
Nice to Have
- Familiarity with multimodal datasets (video, image, audio, text) and processing pipelines.
- Experience in building video foundation infrastructure in collaboration with LLM or video AI teams.
Technical Stack
- Python
- Kubernetes
- SLURM
Team & Environment
You will collaborate directly with research teams in a collaborative, high-performing, and innovation-driven team culture.
Benefits & Compensation
- Competitive salary and performance-based incentives.
- Flexible working environment with remote options.
- Opportunities to work on AI research with global impact.
- Access to state-of-the-art infrastructure and GPU clusters.
- Professional growth and career development in AI and infrastructure engineering.
- Collaborative, high-performing, and innovation-driven team culture.
Work Mode
This is a remote position based in the United Kingdom.
Rockefeller Philanthropy Advisors is an equal opportunity employer.
