AI Language Model Evaluation

New

Skills

Conversational AI English French Natural Language Processing

Mercor partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. This project focuses on evaluating and improving general chat behavior in large language models (LLMs). You will assess model-generated responses across diverse topics, provide high-quality human feedback, and help ensure AI systems communicate in accurate, well-reasoned ways aligned with human expectations.

Key Responsibilities
  • Evaluate model-generated responses
  • Provide high-quality human feedback
  • Ensure AI systems communicate accurately
Requirements & Qualifications
  • Proficiency in English & French
  • Experience with conversational AI systems
  • Ability to assess and provide feedback on AI responses

Job Type: Remote

Salary: Not Disclosed

Experience: Entry

Duration: 12 Months

Share this job:

Similar Jobs

Generalist - English & German

New

Improve general chat behavior in large language models

Assess and provide feedback on model-generated responses

Ai Systems Conversational AI Data Analysis Language Models

Data Scientist/AI Trainer

New

Develop and maintain Python code for data analysis, model evaluation, and AI workflow automation.

Design and refine prompts for LLMs to optimize conversational performance.

Conversational AI Data Analysis Data Science Machine Learning

AI Architect, Engineer

Posted 3 days ago

Architect and build next-generation Conversational AI products

Lead and mentor engineering teams

Cloud Platforms Conversational AI Full-stack Development Java

Health AI Agent Development

Posted 11 days ago

Designing AI agents for health improvement

Developing multi-agent systems for member experience

AI Development Conversational AI Cross-functional Collaboration Prompt Engineering

AI Architect, Principal Engineer

Posted 12 days ago

Architect and build next-generation Conversational AI products

Lead and mentor engineering teams

Cloud Platforms Conversational AI Java Node.js

Product Manager, Agent Lifecycle

Posted 17 days ago

Launch enterprise AI Agents reflecting brand identity

Innovate with new tools for building agents

Apis Conversational AI React Typescript

Remote Senior Product Manager

Posted 18 days ago

Lead product development and strategy for Rasa's open source conversational AI

Collaborate with cross-functional teams to drive product initiatives

Communication Skills Conversational AI Leadership Market Research

Account Executive

Posted 38 days ago

Drive revenue growth through enterprise account management.

Identify new business opportunities aligned with product offerings.

Account Executive Account manager Ai technology Analytical Skills

Rasa ML Engineer

Posted 45 days ago

Develop and enhance conversational AI models.

Optimize chatbot functionality through machine learning algorithms.

Chatbot Development Collaboration Conversational AI Engineer

Senior PM (Platform)

Posted 90 days ago

Manage product roadmap and strategy

Collaborate with cross-functional teams

Agile Methodologies Ai technologies Conversational AI Cross-functional Collaboration

Senior Voice Product Manager

Posted 135 days ago

Lead product strategy for voice AI

Manage remote, cross-functional teams

Agile Methodologies Conversational AI Product Product Management

Account Executive Audio AI

Posted 182 days ago

Expand enterprise adoption of Audio AI

Generate and close high-value sales opportunities

Account Executive Account manager Analytical Skills Business Development

Senior Account Executive AI

Posted 201 days ago

Drive enterprise adoption of Audio AI

Build and manage key customer accounts

Account Executive Account management Account manager Analytical Skills

Senior Account Executive India

Posted 233 days ago

Drive enterprise account growth in AI

Identify and close new business opportunities

Account Executive Account management Account manager Business Development

Co-Pilot Studio AI Specialist

Posted 292 days ago

Design and customize conversational AI experiences

Integrate AI with backend systems and APIs

AI Agent Development Api Integration Azure Conversational AI

AI Solutions Specialist

Posted 326 days ago

Identifying target accounts and their needs through research

Crafting personalized outreach messaging

Ai technology B2b B2b Environment Chatbot Development

AI Engineer

Posted 371 days ago

Develop and improve AI systems, Build APIs and backends, Design features for AI products, Train

ls from scratch, Ensure AI

Conversational AI FastAPI Machine learning models Python
overtime