AI Data Engineering Pipelines

New

Skills

AWS Lambda LangChain Pandas Python Step Functions Vector Databases

Arrow Global Group seeks a Data Engineer to help build and scale the data infrastructure powering our AI-driven products. You will collaborate closely with AI and product teams to design robust, scalable pipelines that do more than just move data—they clean, enrich, and understand it, leveraging the latest in AI and automation to transform complex, semi-structured data into valuable insights. This hands-on role is ideal for candidates passionate about data quality, automation, and innovative AI applications in the financial and real estate sectors.

Job Overview
  • Drive the development of reliable and transparent data pipelines supporting cutting-edge AI solutions.
  • Collaborate with cross-functional teams to deliver high-quality, actionable data for fast-moving prototypes and products.
  • Leverage large language models and AI agents to automate complex data cleansing, enrichment, and research tasks.
Key Responsibilities
  • Design, build, and maintain scalable data pipelines in Python, ensuring robustness and transparency.
  • Utilize LLMs and AI agents for data cleansing, enrichment, classification, and structured data extraction.
  • Work with product and AI engineering teams to ensure trustworthy data feeds into prototypes.
  • Transform noisy, semi-structured data into actionable insights for research and decision-making.
  • Support experimentation, rapid iteration, and continuous improvement of data workflows.
Required Skills & Qualifications
  • Strong proficiency in Python and pandas (or Polars) for data engineering tasks.
  • Experience with common data formats such as JSON, XML, and CSV.
  • Familiarity with AWS cloud services, especially Lambda and Step Functions.
  • Knowledge or interest in leveraging LLMs for data enrichment and transformation.
  • Track record of delivering robust, debuggable, and scalable data systems.
  • Experience with modern AI tools (e.g., LangChain, Haystack, Pandas AI, vector databases) is a plus.
  • Curiosity and motivation to automate research and discovery using AI.

Job Type: Remote

Salary: Not Disclosed

Experience: Entry

Duration: 12 Months

Share this job:

Similar Jobs

Senior Full-stack Engineer

New

Develop scalable full-stack applications

Ensure PCI-DSS compliance and security

AWS Azure Data Security Google Cloud Platform

Senior Angular Developer

New

Develop and maintain Angular applications

Integrate frontend with backend services

Agile Methodologies Angular AWS Azure

Senior TypeScript Fullstack Developer

New

Modernize Groupon’s deal management platform using TypeScript and scalable frameworks.

Refactor legacy systems to improve maintainability and performance.

AWS Docker Git GraphQL

Engineering Manager (NodeJS/TS)

New

Lead and mentor engineering teams

Drive hands-on technical contributions

AWS Distributed systems GraphQL Javascript

Databricks Data Engineer Role

New

Deliver secure and scalable data solutions

Build and optimize data processing pipelines

AWS Azure data factory Azure Data Lake Azure Synapse

Remote Health Tech Careers

New

Deliver advanced digital health solutions

Provide personalized health recommendations

Agile Methodologies Apis AWS Data Security

Principal Software Engineer Role

New

Lead architecture and technical direction for scalable platforms

Integrate AI capabilities into product offerings

AWS Azure CI/CD Distributed systems

Senior NodeJS Backend Engineer

New

Build innovative cloud applications

Develop scalable backend services

Agile Methodologies AWS Full-stack Development Javascript

Fullstack JavaScript Engineer

New

Build and scale backend infrastructure

Develop and maintain server-side JavaScript applications

API Design AWS Backend Development Google Cloud

Senior React Native Engineer

New

Develop innovative fintech features using React Native

Mentor and collaborate within a remote engineering team

AWS Postgresql Python React

Senior Fullstack Engineer Role

New

Design and build scalable e-commerce software

Lead architectural and technical decision-making

AWS CI/CD GraphQL Javascript

Senior NodeJS Backend Engineer

New

Develop scalable backend microservices

Enhance data security and performance

Apache Kafka AWS Docker Git

Datavail Remote IT Careers

New

Deliver comprehensive IT solutions

Enhance client data management

AWS Azure Data Analytics Google Cloud

AI Software Engineering Manager

New

Lead and mentor software engineering teams

Deliver scalable AI-driven web applications

Agile Methodologies AWS CI/CD Cloud

Senior Snowflake Consultant

New

Design and optimize Snowflake data solutions

Drive actionable business insights from data

AWS Azure Braze Cloud

Senior NodeJS Backend Developer

New

Develop scalable backend applications

Design and manage databases

AWS Docker GraphQL JWT

Backend Software Designer Role

Posted 3 days ago

Develop robust backend systems for satellite operations

Ensure system performance, security, and availability

Ansible AWS Cloud Platforms Devops

Cloud Software Engineer II

Posted 3 days ago

Design and develop cloud-based SaaS products

Collaborate with cross-functional teams

Agile Methodologies AWS Engineer Javascript

Staff Software Engineer, AI Backend

Posted 3 days ago

Design and build scalable AI-driven backend systems

Integrate advanced language models into data workflows

AWS Azure Docker FastAPI

Node.js Backend Developer

Posted 4 days ago

Hire experienced Node.js backend developers

Promote remote, flexible work culture

AWS Docker Elasticsearch Git

Senior SRE, GitLab Runway

Posted 4 days ago

Build and maintain robust cloud infrastructure

Enable self-service development and deployment

AWS Cloud Devops Engineer

Backend Engineer Node.js EMEA

Posted 4 days ago

Develop and optimize backend systems

Collaborate in cross-functional remote teams

Api Development AWS Javascript JWT

Engineering Manager Frontend CMS

Posted 4 days ago

Lead and mentor a remote frontend engineering team

Develop scalable web applications using React and headless CMS

Agile Methodologies AWS Headless cms Javascript

Senior Node.js Backend Developer

Posted 4 days ago

Develop and scale backend services for a mental health platform

Design and implement robust APIs and data models

AWS CI/CD Google Cloud Platform GraphQL

Senior Node.js Backend Developer

Posted 4 days ago

Develop scalable backend systems

Lead architectural and API design

AWS CI/CD Google Cloud Platform GraphQL

Engineering Manager Frontend CMS

Posted 4 days ago

Lead and mentor a remote frontend engineering team

Deliver scalable web applications using React/Next.js and headless CMS

Agile Methodologies AWS Javascript Next.js

Backend Engineer Node.js EMEA

Posted 4 days ago

Develop and enhance scalable backend systems

Collaborate with cross-functional remote teams

Api Development AWS Design Patterns Javascript

Backend Engineer Node.js EMEA

Posted 4 days ago

Develop scalable backend systems

Collaborate in cross-functional remote teams

Api Development AWS Javascript Node.js

Backend Engineer Node.js EMEA

Posted 4 days ago

Develop and optimize scalable backend systems

Collaborate in remote, cross-functional teams

Api Development AWS Javascript JWT

Backend Engineer Node.js EMEA

Posted 4 days ago

Develop scalable backend systems

Enhance and secure APIs

Api Development AWS Javascript Node.js

Data Platform Program Manager

Posted 4 days ago

Lead enterprise-wide data platform migration programs

Ensure compliance with healthcare data regulations

Architecture AWS Azure Databricks

Senior Angular Micro Frontend

Posted 4 days ago

Develop and maintain Angular micro front-ends

Ensure code quality and best practices

Agile Methodologies AWS Design system Jest

Node.js Software Engineer

Posted 4 days ago

Develop scalable backend features with Node.js

Collaborate in agile, cross-functional teams

AWS CI/CD Javascript Kubernetes

Frontend Engineer JavaScript SDK

Posted 4 days ago

Enhance JavaScript SDK integration and usability

Deliver reliable, secure authentication experiences

AWS Go Javascript Kotlin

Senior Node.js React Engineer

Posted 4 days ago

Deliver robust Node.js and React solutions

Drive client engagement and communication

AWS Docker Express Gcp

Senior Fullstack Engineer TypeScript

Posted 4 days ago

Build scalable customer support platforms

Implement secure and compliant client solutions

AWS Kotlin Nestjs Next.js

Principal Data Solutions Architect

Posted 4 days ago

Design and implement enterprise data architecture

Ensure data quality, integrity, and consistency

AWS Etl Kafka Python

Director, Platform Operations

Posted 5 days ago

Lead and mature platform operations strategy

Drive adoption of modern infrastructure and cloud technologies

AWS Azure Docker Infrastructure as code

DevSecOps Engineer Opportunity

Posted 5 days ago

Maintain and secure infrastructure

Automate deployment and DevOps pipelines

Ansible AWS Docker Jenkins

Senior Data Engineer Africa

Posted 5 days ago

Ensure high-quality, reliable data management.

Automate data quality assurance processes.

Airflow AWS Lambda Postgresql

Junior Data Scientist Role

Posted 5 days ago

Develop and deploy machine learning models

Translate business needs into data-driven solutions

AWS Azure Data Visualization Git

Senior Support Engineer Blockchain

Posted 6 days ago

Deliver exceptional enterprise customer support

Maintain high availability and reliability of blockchain infrastructure

AWS Blockchain Customer Experience Datadog

Remote Finance Tech Careers

Posted 6 days ago

Democratize financial market access

Simplify complex financial processes

Agile Methodologies AWS Data Analysis Devops

Cloud Platform Software Engineer

Posted 7 days ago

Design and develop scalable cloud platforms

Implement modern agile and quality practices

AWS Engineer Golang Java

Senior React Full-Stack Developer

Posted 7 days ago

Offer remote full-stack developer roles

Match candidates with startup projects based on skills

AWS Django Full-stack Development Javascript

Technical Project Manager Role

Posted 7 days ago

Oversee and manage technical project delivery

Facilitate agile processes and team productivity

Agile Methodologies Architecture AWS Cloud infrastructure

AI Support Engineer Tier I

Posted 7 days ago

Provide prompt and effective technical support to AI/ML users

Collaborate with internal teams to resolve user issues

AWS Docker Engineer Keras

Senior Analytics Consultant Role

Posted 7 days ago

Deliver advanced analytics solutions to clients

Collaborate with cross-functional and client teams

Analytics AWS Cloud Technologies Data Analytics

Senior TypeScript Engineer

Posted 7 days ago

Develop scalable backend integrations

Ensure reliable financial data synchronization

AWS Docker GraphQL JWT

Senior TypeScript Backend Engineer

Posted 7 days ago

Hire a senior backend engineer

Scale and optimize backend systems

AWS Database Optimization Gcp Node.js
overtime