Software Engineer Data Infrastructure

New

Skills

Airflow BigQuery Go Java Python Spark Terraform

Job Overview

This position requires a seasoned Staff+ Software Engineer to work on data governance, financial data infrastructure, cloud storage reliability, and data platform/tooling.

Responsibilities
  • Design access control, IAM policies, and audit logs for data governance.
  • Build pipelines and warehouses for financial data infrastructure.
  • Ensure cloud storage reliability through DR, backups, and replication.
  • Scale infrastructure using BigQuery, BigTable, Airflow, dbt, and Spark.
  • Collaborate with data scientists, analysts, and stakeholders to drive impact.
Requirements & Qualifications
  • 10+ years of experience in software engineering for data infrastructure, storage, or distributed systems.
  • 3+ years leading large-scale projects or teams as an engineer or tech lead.
  • Ability to set technical direction for a team.
  • Strong proficiency in Python, Go, Java, or similar languages.
  • Experience with infrastructure-as-code (Terraform, Pulumi) and cloud platforms (GCP, AWS).

Job Type: Remote

Salary: Not Disclosed

Experience: Entry

Duration: 12 Months

Share this job:

Similar Jobs

Senior Data Engineer, Infrastructure

New

Design and implement IAM policies, audit logging, and scalable access for data governance.

Build and ensure data integrity for financial data infrastructure.

Airflow BigQuery Python Spark

Senior DevOps Engineer II

New

Own critical infrastructure supporting engineering teams

Design, deploy, and operate Kubernetes platforms

Airflow AWS Bash Gcp

Senior Data Science Manager

New

Lead data science and ML initiatives

Build and lead a team for predictive modeling and experimentation

Airflow AWS Gcp Python

Senior Data Analyst, Product Analytics

New

Design, build, and maintain analytical data models for brokerage and ledger

Own datasets for client metrics, ops decisions, and regulatory reporting

Ai Tools Airflow Data Engineering Data Modeling

Senior Data Scientist

New

Lead autonomous data projects

Use SQL for analysis

Airflow Amplitude Datadog Etl

Senior Data Scientist, Analytics

New

Lead data projects to enhance analytics capabilities.

Query data warehouses efficiently using SQL.

Airflow Amplitude Business administration Datadog

Data Scientist Project

New

Run large-scale data warehouses with efficient SQL

Define ETL models with Airflow

Airflow Data Analysis Data Visualization Etl

Analytics Engineer

New

Design, build, and maintain production data models

Collaborate with Data Engineering

Airflow BigQuery Git Looker

Analytics Engineer

New

Design and maintain production data models for incentives, promotions, and analytics.

Partner with Data Eng to model source data and implement auditable ELT.

Airflow BigQuery Git Looker

Data Platform Engineer

Posted 3 days ago

Build and maintain data infrastructure processing petabytes of data

Write clean, well-tested code for data ingestion, transformation, and serving

Airflow Go Java Kafka

Forward Deployed Software Engineer

Posted 7 days ago

Lead technical implementation & optimization of Altimate AI platform

Translate customer needs into technical requirements

Airflow AWS Azure Databricks

Developer Advocate

Posted 9 days ago

Empower developers through technical communication and content creation

Engage with technical communities to promote DataHub

Airflow Apache Kafka Communication Content Creation

Python & Kubernetes Software Engineer

Posted 10 days ago

Hiring Python and Kubernetes Specialist Engineers for Data, AI/ML & Analytics Solutions

Building open source solutions for public cloud and private infrastructure

Airflow Analytics Data Analytics Docker

Backend Engineer - Data

Posted 16 days ago

Building APIs and backend systems for products

Integrating with third-party systems

Agile Ai Tools Airflow Api Development

Principal Solution Architect

Posted 31 days ago

Propose, design, and provision cloud-native data solutions.

Lead a technical team operating modern data platforms.

Airflow AWS Azure Cloud

Developer Advocate

Posted 41 days ago

Empowering developers through technical content and engagement

Promoting DataHub and metadata management ecosystem through events

Airflow Apache Kafka Communication Community engagement

Python Kubernetes Engineer

Posted 42 days ago

Hiring Python and Kubernetes Engineers for Data, Workflows, AI/ML, and Analytics solutions

Collaborating on end-to-end data analytics using open-source tools

Airflow Analytics Engineer Kubernetes

Developer Advocate

Posted 61 days ago

Engaging with technical communities and fostering positive interactions.

Creating technical content to educate users about DataHub's features and best practices.

Airflow Apache Kafka Communication Community engagement

Senior Analytics Engineer

Posted 64 days ago

Deliver insights and analytics to drive strategic opportunities

Turn messy data into reliable, analysis-ready datasets

Airflow Analytics BigQuery Data Modeling

Forward Deployed Software Engineer

Posted 71 days ago

Lead technical implementation and optimization of data platform

Serve as primary technical contact for key accounts

Airflow AWS Azure Databricks

Staff Software Engineer

Posted 73 days ago

Implement data ingestion routines

Develop a workflow orchestration platform

Airflow AWS Ci/cd pipeline Json

Python & Kubernetes Engineer

Posted 73 days ago

Hiring Python and Kubernetes Specialist Engineers focused on Data, Workflows, AI/ML, and Analytics Solutions

Developing end-to-end data analytics and MLOps solutions with open-source tools

Airflow Analytics Engineer Kubernetes

Developer Advocate

Posted 91 days ago

Support developers in the DataHub Slack community.

Create compelling technical content to educate users about DataHub.

Airflow Apache Kafka Communication Community engagement

Developer Advocate

Posted 91 days ago

Empower developers through technical communication and content creation.

Engage actively in the DataHub community to support users.

Airflow Apache Kafka Communication Community engagement

Lead Data Engineer Role

Posted 95 days ago

Architect scalable, secure data platforms.

Implement modern software engineering practices.

Airflow Devops Docker Engineer

Python Kubernetes Engineer

Posted 106 days ago

Build open source AI/ML and analytics solutions

Develop and maintain scalable data platforms

Airflow Analytics Docker Engineer

Crypto Data Engineer Platform

Posted 108 days ago

Architect scalable data pipelines and infrastructure.

Enable real-time, reliable, and high-quality data access.

Airflow Big Data Engineer Kafka

Senior Solutions Architect Role

Posted 114 days ago

Design and implement scalable data architectures

Lead and mentor engineering teams

Airflow AWS Azure Databricks

Developer Advocate, DataHub

Posted 125 days ago

Empower and support DataHub developers

Create educational technical content

Airflow Apache Kafka Communication Community engagement

Senior Solutions Architect Role

Posted 127 days ago

Design and implement scalable data solutions

Lead and mentor engineering teams

Airflow Azure Databricks Hadoop

Senior Solutions Architect Role

Posted 128 days ago

Architect and deliver scalable data solutions

Lead and mentor engineering teams

Airflow AWS Databricks Hadoop

Senior Data Engineer Role

Posted 129 days ago

Architect scalable and reliable data infrastructure

Empower data-driven decision making and analytics

Airflow AWS Big Data Engineer

Lead Data Engineer Role

Posted 129 days ago

Architect scalable data platforms and pipelines

Drive innovation in cloud-native product development

Airflow Aws glue Docker Engineer

Data Governance Engineering Lead

Posted 131 days ago

Lead data governance strategy and execution

Build and manage governance-aware data pipelines

Airflow Architecture Computer science Databricks

AI Platform Lead Engineer

Posted 139 days ago

Design scalable AI data platforms

Optimize ML pipeline efficiency and resource allocation

Airflow BigQuery Dataflow Pyspark

Generative ML Engineer Role

Posted 139 days ago

Design and scale generative AI infrastructure

Develop and fine-tune generative video and visual models

Airflow Engineer Machine Learning Prompt Engineering

Data Engineer Crypto Platform

Posted 139 days ago

Design scalable data infrastructure

Build and maintain high-quality data pipelines

Airflow Big Data Engineer Kafka

Data Engineer, Solar Solutions

Posted 141 days ago

Enable data-informed decision-making organization-wide

Design and implement scalable cloud-based ETL/ELT solutions

Airflow Lambda NoSQL Pyspark

Remote Staff Data Engineer

Posted 142 days ago

Hire a remote data engineer

Build automated communication systems

Airflow AWS Data Data Warehousing

Data Governance Engineering Lead

Posted 148 days ago

Lead global data governance strategy and execution

Build and maintain governance-aware data pipelines

Airflow Architecture Databricks Infosec

Wikimedia Data Engineer Role

Posted 149 days ago

Design and maintain scalable data pipelines

Ensure data quality and reliability

Airflow CI/CD Hadoop hive

Senior ML Engineer, Ads

Posted 151 days ago

Lead end-to-end ML ad targeting product development

Drive technical research and strategic roadmap

Airflow BigQuery Deep Learning Machine Learning

Compliance Data Analyst Role

Posted 158 days ago

Develop and automate compliance dashboards and reports

Support regulatory reporting and audit readiness

Airflow AWS Data Analysis Data Analyst

BI Analyst – Sporty Group

Posted 159 days ago

Deliver actionable business insights

Develop and optimize data pipelines

A/b Testing Ab testing Airflow AWS

Senior Solutions Architect Role

Posted 160 days ago

Design and implement scalable data solutions

Lead and mentor engineering teams

Airflow AWS Azure Hadoop

Senior Data Engineer Role

Posted 171 days ago

Design and build scalable data architectures

Lead customer-facing technical engagements

Airflow Big Data Engineer Google Cloud Platform

Senior Data Engineer Role

Posted 172 days ago

Architect scalable and reliable data pipelines

Develop and launch self-serve analytics products

Airflow AWS Databricks Engineer

Senior Data Engineer Wikimedia

Posted 175 days ago

Design and maintain scalable data pipelines

Ensure data quality and governance

Airflow Docker Hadoop hive

Senior Data Engineer Wikimedia

Posted 175 days ago

Develop and maintain scalable data pipelines

Ensure data quality and robust monitoring

Airflow Docker Engineer Hadoop

Senior Data Engineer Wikimedia

Posted 175 days ago

Design and build scalable data pipelines

Ensure data quality and system reliability

Airflow Docker Engineer Hadoop
overtime