Data Engineer III

New

Skills

Docker Kubernetes Postgresql Python Sql

Job Overview

As a Data Engineer III, you will be responsible for designing and optimizing ETL/ELT pipelines with dbt for the data warehouse. Additionally, you will build and maintain data transformation infrastructure using Azure Event Hub/Grid, PostgreSQL, and Cosmos DB. Your role will also involve managing Data Lakes with Apache Iceberg for scalable storage and processing, utilizing Trino for distributed SQL queries, and developing Python-based data manipulation and automation. Containerization and orchestration of workloads with Docker and Kubernetes will also be part of your responsibilities.

Responsibilities
  • Design and optimize ETL/ELT pipelines
  • Build and maintain data transformation infrastructure
  • Manage Data Lakes for scalable storage and processing
  • Utilize Trino for distributed SQL queries
  • Develop Python-based data manipulation and automation
Requirements & Qualifications
  • 5+ years of relevant data engineering experience
  • Bachelor’s degree in a related field
  • Expert-level SQL with PostgreSQL schema design and optimization
  • Deep proficiency in dbt for ETL/ELT pipelines
  • Advanced Python skills with pandas and polars
  • Experience with Azure Event Hub/Grid and Azure Cosmos DB

Job Type: Remote

Salary: Not Disclosed

Experience: Entry

Duration: 12 Months

Share this job:

Similar Jobs

AI Model Serving Engineer

New

Develop backend solutions using Python

Deploy applications on GCP and other cloud providers

AWS Azure Backend Development Docker

Principal AI Engineer

New

Lead design and development of Java-based backend services

Optimize platform components for high throughput and low latency

AWS Docker Elasticsearch Java

Senior TAM - Cloud Value Maximizer

New

Maximize cloud value for key business customers

Lead technical engagements and architecture design

Ansible AWS Azure Docker

Senior Security Architect

New

Perform security architecture reviews and recommendations

Conduct periodic security testing and assessments

Docker Github Actions Kubernetes Terraform

Senior Backend Engineer

New

Design, build, and maintain scalable backend systems

Shape product decisions with product and engineering peers

AWS Docker Golang Kubernetes

AI Model Serving Engineer

New

Develop and deploy AI model serving solutions

Implement backend development using Python

AWS Azure Backend Development Docker

Geo-backend Systems Engineer

New

Building and operating geo-localized backend services

Ensuring privacy and compliance for services

API Design AWS Docker Kafka

AI Model Serving Engineer

New

Develop state-of-the-art voice cloning technologies

Implement low latency and cost-effective text-to-speech solutions

AWS Azure Backend Development Cloud Computing

Senior Software Engineer - Backend

New

Develop and maintain backend systems for web applications

Collaborate with front-end engineers to design APIs

Aws Services Docker Git Javascript

Senior Backend Engineer

New

Design, build, and maintain scalable distributed backend systems

Collaborate with product and engineering teams to shape product decisions

AWS Docker Golang Grafana

AI Model Serving

New

Implement state-of-the-art voice cloning

Ensure low latency and cost-effective text to speech functionality

Ai AWS Azure Backend Development

Senior Backend Engineer

New

Design, build, and maintain scalable distributed backend systems

Own backend services end-to-end

AWS Docker Golang Grafana

Senior Software Engineer - Backend

New

Develop and maintain backend systems for Foodsmart web app

Collaborate with front-end engineers for API design and implementation

AWS Docker Git Javascript

AI Model Serving Engineer

New

Develop and maintain state of the art voice cloning systems.

Implement low latency and cost-effective text to speech solutions.

AWS Azure Backend Development Cloud Services

Automation Engineer

New

Design and develop scalable automation frameworks

Collaborate with QA, developers, and stakeholders

AWS Cypress Docker Git

AI Platform Lead Engineer

New

Lead design and development of core Java services for a multi-tenant platform

Optimize platform components for high-performance and fault tolerance

AWS Docker Java Kubernetes

Senior Backend Engineer

New

Develop and maintain backend systems for Foodsmart web application

Collaborate with front-end engineers

Aws Services Docker Git Javascript

AI Model Serving Engineer

New

Develop low latency, cost-effective text-to-speech solutions

Prioritize tasks based on urgency and impact

AWS Azure Backend Development Docker

AI Model Serving Engineer

Posted 3 days ago

Develop backend applications using Python

Utilize cloud services like GCP, AWS, and Azure

AWS Azure Backend Development Cloud Services

Senior Backend Software Engineer

Posted 3 days ago

Develop and maintain backend systems for the Foodsmart web application

Collaborate with front-end engineers to design and implement APIs

Aws Services Docker Javascript Kubernetes

Senior Backend Engineer

Posted 3 days ago

Design, build, and maintain scalable backend systems

Collaborate with product and engineering teams

AWS Docker Golang Grafana

Senior SDET for Vehicle Software

Posted 3 days ago

Develop and own scalable automation frameworks for vehicle software.

Build automated integration and end-to-end tests for SITL/HITL.

C++ CI/CD Docker Grafana

Senior SRE Engineer

Posted 3 days ago

Drive SRE practices across services

Design/maintain end-to-end observability

AWS Datadog Docker Kubernetes

IT Systems Manager

Posted 3 days ago

Define requirements, research vendors, and design/implement solutions

Drive standardized solutions across SpaceX

CI/CD Docker Firewalls Grafana

Senior Backend Software Engineer

Posted 3 days ago

Develop and maintain backend systems for Foodsmart web application

Collaborate with front-end engineers to design efficient APIs

Aws Services Docker Git Javascript

Senior Backend Engineer

Posted 3 days ago

Design, build, and maintain scalable distributed backend systems

Own backend services end-to-end

AWS Docker Golang Grafana

AI Model Serving Engineer

Posted 3 days ago

Develop cutting-edge voice cloning technology

Implement low latency and cost-effective text-to-speech solutions

AWS Azure Backend Development Docker

Sr. Team Lead, Software Dev

Posted 3 days ago

Lead software development projects effectively

Collaborate with cross-functional teams

Angular Docker Html/css Javascript

Backend Engineer - Geospatial Automation

Posted 3 days ago

Build backend services for geospatial processing and automation

Develop APIs, proxies, and integration services

Docker Java Kubernetes Node.js

AI Model Serving Engineer

Posted 4 days ago

Develop AI model serving solutions using Python.

Work on backend development and deployment on cloud platforms like GCP and Kubernetes.

AWS Azure Backend Development Docker

Senior Solutions Architect

Posted 4 days ago

Managing complex deployments across multiple cloud platforms

Partnering with customer engineers for service provisioning and monitoring

AWS Azure Cloud Services Docker

AI Model Serving Engineer

Posted 4 days ago

Contribute to voice cloning and text-to-speech projects

Develop and deploy high availability applications

AWS Azure Backend Development Docker

Senior Backend Engineer

Posted 4 days ago

Design, build, and maintain scalable distributed backend systems

Work closely with product and engineering peers to shape product decisions

AWS Docker Golang Kubernetes

Senior Backend Engineer

Posted 4 days ago

Develop and maintain backend systems for Foodsmart web application

Collaborate with front-end engineers to design and implement APIs

Aws Services Docker Git Javascript

Staff Software Engineer Role

Posted 4 days ago

Architectural leadership in designing large-scale distributed systems

Defining technical strategies for boosting velocity and reliability

AWS Azure Docker Gcp

Logistics API Developer

Posted 4 days ago

Design and implement scalable API services

Improve data consumption/storage for routing data

AWS Docker Kubernetes Rust

Principal AI Engineer

Posted 5 days ago

Lead design and development of Java-based backend services.

Architect and optimize platform components for high-throughput.

AWS Devops Docker Java

Senior Backend Engineer

Posted 5 days ago

Develop and maintain backend systems for a web application

Collaborate with front-end engineers on API design

Aws Services Docker Git Javascript

Senior Backend Engineer

Posted 5 days ago

Design, build, and maintain scalable backend systems

Collaborate with product and engineering teams

AWS Docker Golang Grafana

AI Model Serving Engineer

Posted 5 days ago

Develop and deploy AI models for voice cloning

Ensure low latency and cost-effective text-to-speech solutions

AWS Azure Backend Development Docker

Site Reliability Engineer

Posted 5 days ago

Drive SRE practices across services

Design end-to-end observability solutions

AWS Docker Kubernetes Node.js

Site Reliability Engineer

Posted 5 days ago

Drive and refine SRE practices across services

Design and maintain end-to-end observability

AWS Docker Kubernetes Node.js

Senior AI Software Engineer

Posted 5 days ago

Develop cutting-edge voice cloning technology

Implement low latency and cost-effective text-to-speech solutions

AWS Azure Backend Development Docker

Senior Backend Engineer

Posted 5 days ago

Design, build, and maintain scalable distributed backend systems

Work closely with product and engineering peers to shape product decisions

Docker Golang Grafana Kubernetes

DevOps Software Developer

Posted 5 days ago

Architect and maintain cloud infrastructures

Lead containerization and orchestration with Docker and Kubernetes

AWS Azure CI/CD devsecops

Agent Services Engineer

Posted 5 days ago

Designing and maintaining agent-driven services

Developing high-throughput APIs for agents

Ai Models Cloud Platforms Distributed systems Docker

Forward Deployed Engineer

Posted 5 days ago

Deploy, maintain, and support containerized apps in Kubernetes

Provide tech support for CI/CD pipelines and orchestration tools

Ci/cd Pipelines Docker Github Actions Jenkins

Senior AI Software Engineer

Posted 6 days ago

Implementing voice cloning and text-to-speech technologies

Developing low latency and cost-effective solutions

AWS Azure Backend Development Docker

Senior Backend Engineer

Posted 6 days ago

Design, build, and maintain distributed backend systems

Work closely with product and engineering teams

AWS Docker Golang Grafana

Senior Software Engineer

Posted 6 days ago

Build next-gen crypto-forward products and features

Solve large-scale, complex problems across web-scale apps and blockchain

Docker Ethereum Go Mongodb
overtime