Backend Engineer, Data Centers

New

Skills

CI/CD Go Kafka Modeling Postgresql Python

Job Overview

As a Backend Engineer specializing in Data Centers, you will be responsible for ensuring backward compatibility across evolving schemas, building scalable data pipelines across Kafka, PostgreSQL, and ClickHouse, creating CI/CD workflows aligning API changes with schemas, enabling fine-grained querying of historical and real-time data, enforcing "smart data, dumb functions" to keep logic in the data layer, and collaborating with modelers on reproducible training/eval pipelines.

Responsibilities
  • Ensure backward compatibility across evolving schemas
  • Build scalable data pipelines across Kafka, PostgreSQL, and ClickHouse
  • Create CI/CD workflows aligning API changes with schemas
  • Enable fine-grained querying of historical and real-time data
  • Collaborate with modelers on reproducible training/eval pipelines
Requirements & Qualifications
  • Proficient in Go and Python
  • Built data pipelines with Kafka, PostgreSQL, ClickHouse
  • Experience with API versioning and backward compatibility
  • Familiar with evolving data schemas
  • Strong CI/CD experience

Job Type: Remote

Salary: Not Disclosed

Experience: Entry

Duration: 12 Months

Share this job:

Similar Jobs

Senior SDET for Vehicle Software

New

Develop and own scalable automation frameworks for vehicle software.

Build automated integration and end-to-end tests for SITL/HITL.

C++ CI/CD Docker Grafana

AI Productivity Engineer

New

Boost AI agent productivity through infrastructure and tooling

Develop server integrations for AI agents

Ai agents CI/CD CircleCI Cloud infrastructure

Flight Software Engineer

New

Architect core flight software to meet performance requirements

Integrate algorithms with the GNC team for ascent/descent

Algorithms Bug Tracking C++ CI/CD

IT Systems Manager

New

Define requirements, research vendors, and design/implement solutions

Drive standardized solutions across SpaceX

CI/CD Docker Firewalls Grafana

CI/CD Engineer - DevOps

New

Design and implement high-speed CI/CD pipelines

Lead Python packaging and Conda environments

Ansible CI/CD Devops Github Actions

CI/CD DevOps Engineer

New

Design, develop, and maintain CI/CD pipelines

Collaborate with software developers and cloud engineers

Ansible CI/CD Devops Github Actions

Cloud Platform Engineer

Posted 3 days ago

Architect and scale a multi-tenant hybrid-cloud Kubernetes platform

Develop custom Kubernetes operators and self-service abstractions

AWS CI/CD Cloudformation Gcp

Staff Engineer - Technical Lead

Posted 3 days ago

Lead technical projects and manage deliverables effectively

Architect scalable systems linked to data science platforms

AWS CI/CD Cloudformation Nist

Site Reliability Engineer II

Posted 3 days ago

Build foundational platforms and tools for rapid, secure, and cost-effective service provisioning.

Exemplify cloud-native site reliability best practices.

AWS Azure C# CI/CD

Senior Engineering Manager, Client Platform

Posted 3 days ago

Lead Frontend and Mobile Platform teams

Define client platform strategy across platforms

Automation CI/CD Design Systems Mobile Development

Sr. Manager-TAM Team Lead

Posted 3 days ago

Lead and scale a TAM team for customer adoption and value realization

Develop scalable processes and playbooks for enterprise customers

CI/CD Communication Skills Customer Success Management Devops

Director of Engineering, DevOps Project

Posted 3 days ago

Lead and manage Dev Tooling and SRE teams effectively

Improve communication and processes across teams

CI/CD Enterprise saas Mlops

Software Engineer II

Posted 3 days ago

Develop front-end and back-end solutions with automated tests

Collaborate with product managers and engineers on high-impact projects

Angular Automated Testing CI/CD Data Modeling

Senior Infrastructure & Security Engineer

Posted 3 days ago

Lead platform reliability, security, and operational maturity

Design and manage Terraform-based GCP infrastructure

CI/CD Github Actions Google Cloud Platform Redis

Senior Manager, Software Engineering

Posted 3 days ago

Lead and scale infrastructure and core platform domain

Enable AI-first delivery with LLM workloads and data pipelines

Ai/ml CI/CD Cloud Computing Data Pipelines

Engineering Manager

Posted 3 days ago

Setting and driving modern engineering standards

Providing hands-on technical leadership

Agile Architecture CI/CD Devops

TPM - Acquisition Integration

Posted 4 days ago

Own end-to-end delivery for programs

Build program structures and roadmaps

AWS CI/CD Cloud infrastructure

Lead Platform Engineer

Posted 4 days ago

Lead software teams towards production

Provide future-proof plans for engineers

CI/CD Design Patterns Github Actions Gitlab

Senior Infrastructure Engineer

Posted 4 days ago

Lead the reliability and security of a distributed platform on Google Cloud

Implement infrastructure as code and cloud architecture design

CI/CD Cloud Security Github Actions Google Cloud Platform

DevOps Software Developer

Posted 4 days ago

Architect and maintain cloud infrastructures

Lead containerization and orchestration with Docker and Kubernetes

AWS Azure CI/CD devsecops

ML Platform Engineer

Posted 5 days ago

Define long-term architecture for ML platform

Establish standards for code quality and testing

CI/CD Cloud Architecture Databricks Distributed systems

Cloud Engineer I

Posted 5 days ago

Design, deploy, and configure cloud services for migrations and AD

Implement security architectures for managed services offerings

Ansible AWS CI/CD Devops

Cloud Platform Manager

Posted 5 days ago

Lead a Cloud Platform Engineering team

Architect scalable infrastructure on AWS

CI/CD Github Actions Iam Observability

Security Engineer

Posted 5 days ago

Collaborate with engineering to integrate security tooling

Automate security checks and feedback loops

Bash Scripting CI/CD Github Actions Go

Engineering Manager, Infrastructure Platforms

Posted 5 days ago

Lead & support high-performing Infrastructure Platforms team.

Guide security, reliability, performance, and scalability of core platform components.

CI/CD Go infrastructure Kubernetes

Senior Infra & Sec Engineer

Posted 5 days ago

Design and manage Google Cloud infrastructure efficiently

Enhance security measures across network and application layers

CI/CD Distributed systems Github Actions Google Cloud Platform

Cloud Security Engineer

Posted 6 days ago

Build and operate detection and response pipelines in the cloud environment

Implement controls to counter threats and enhance security measures

AWS Azure CI/CD Cloudformation

Data Platform Software Engineer

Posted 6 days ago

Build a high-performance cloud-native data platform

Create self-service data tooling for loading and testing

BigQuery CI/CD Docker Grafana

Lead QA Engineer (Remote)

Posted 6 days ago

Lead QA strategy across Maximus applications

Build and manage a high-performing QA team

CI/CD Leadership React

Backend Developer

Posted 6 days ago

Design, develop, and maintain a secure and scalable backend on Drupal PHP

Ensure platform stability across high-traffic sites and portals

CI/CD Mysql Next.js Php

Lead QA Engineer (Remote)

Posted 6 days ago

Lead QA strategy and team effectively

Design and implement automated testing solutions

API Testing CI/CD Leadership Quality Assurance

Senior Software Engineer

Posted 6 days ago

Build and maintain Fever services

Focus on performance, reliability, scalability

CI/CD Django Flask Performance

Backend Engineer, Music Mission

Posted 6 days ago

Collaborate on backend services and Pubsubs

Partner with Product to track performance and artists' needs

AWS CI/CD Data Engineering Data Structures

Lead Software Engineer, Marketplace

Posted 6 days ago

Lead technical direction and improve platform stability.

Build scalable APIs and microservices.

Ai Api Development AWS CI/CD

Senior SRE Director

Posted 6 days ago

Lead and mentor globally distributed SRE & Infra teams

Define and execute SRE/infrastructure strategy

Automation AWS CI/CD Cloud infrastructure

Infra Security Engineer

Posted 6 days ago

Take ownership of the platform's reliability, security, and operational maturity

Define roadmaps, make architectural decisions, and build systems to keep the platform running smoothly

CI/CD Github Actions Google Cloud Platform Linux

QA Engineer (Manual), iOS

Posted 6 days ago

Develop and execute test plans for iOS app.

Collaborate with development team to identify issues.

Agile Appium CI/CD CircleCI

Eng. Manager, Infrastructure Platforms

Posted 7 days ago

Lead and support a high-performing team

Connect business goals with engineering

CI/CD Continuous improvement Go Kubernetes

Security Engineer - Cloud & Application

Posted 7 days ago

Build and run anomaly detection rules using Python

Secure GCP cloud networking and Kubernetes

CI/CD Gcp Github Kubernetes

Senior Infrastructure Engineer

Posted 7 days ago

Lead infrastructure design and maintenance for a distributed platform on Google Cloud

Ensure high performance, security, and scalability of the platform

CI/CD Cloud Security Github Actions Google Cloud Platform

Senior Infrastructure

Posted 8 days ago

Design and maintain infrastructure as code on GCP

Ensure reliability and observability of platform

CI/CD Github Actions Google Cloud Platform Linux

Senior Software Engineer, Analytics

Posted 9 days ago

Translate ideas into engineering solutions

Own end-to-end project delivery

Automated Testing AWS CI/CD Javascript

Senior Salesforce Developer

Posted 9 days ago

Lead migration to Apex-based services

Design scalable systems with AI-driven workflows

Apex CI/CD Github Rest Apis

Senior Platform Engineer

Posted 9 days ago

Design and maintain cloud infrastructure with AWS/Azure/GCP

Automate provisioning using Terraform

AWS Azure CI/CD Gcp

Lead Software Architect

Posted 9 days ago

Define architecture for large-scale lab automation systems

Lead architectural direction from concept to production

CI/CD Infrastructure As Code (iac) Java Kafka

Senior Data Engineer

Posted 9 days ago

Design and build scalable data pipelines for clinical RWD

Implement Python/SQL ETL/ELT with AWS services

Agile Airflow CI/CD Git

Technical Architect for GitLab Projects

Posted 9 days ago

Lead technical architecture for GitLab projects

Guide and collaborate with customers

Ai Ansible CI/CD Devops

Senior Software Engineer

Posted 9 days ago

Design and build scalable backend systems and APIs

Enable audience creation, segmentation, and activation on Twilio's data platform

AWS CI/CD Go Java

Ruby Software Engineer

Posted 9 days ago

Design, develop, and maintain Ruby on Rails web apps.

Translate product requirements into scalable technical solutions.

Agile Methodologies AWS CI/CD Postgresql

Staff Software Engineer

Posted 9 days ago

Define technical strategy and roadmap

Design and build scalable infrastructure

CI/CD Developer Tooling Distributed systems Go
overtime