Brazilian Portuguese - AI Model Rater in Brazil at Jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Brazilian Portuguese - AI Model Rater based in Brazil.

This is a flexible, fully remote contract opportunity for a Brazilian Portuguese speaker interested in helping shape the next generation of generative AI.
You will interact directly with AI chatbots and language models, evaluating their responses, capabilities, safety, and usefulness.
Your linguistic expertise and feedback will help improve how AI systems understand and communicate in Brazilian Portuguese.
Depending on the project, you may work through written conversations, voice interactions, recordings, ratings, or structured written evaluations.
The work is task-based and project-driven, allowing you to choose assignments and manage your own schedule.
Projects are delivered in batches, meaning availability may fluctuate and pauses between assignments are possible.
This is a strong opportunity for language-focused professionals who want practical experience contributing to AI development while maintaining maximum flexibility.

• Test and evaluate AI chatbots and language models through structured conversations using assigned goals, prompts, and evaluation criteria.
• Assess AI-generated responses for quality, relevance, helpfulness, safety, linguistic accuracy, and overall effectiveness.
• Interact with AI systems in Brazilian Portuguese and provide insights that can help improve their ability to understand and communicate naturally in the language.
• Participate in voice-based AI evaluation projects when required, including recorded sessions that may be shared with project clients as part of the deliverables.
• Submit accurate project deliverables such as written evaluations, ratings, screenshots, audio recordings, or other materials specified in the applicable project instructions.
• Ask thoughtful follow-up questions and probe AI models effectively to evaluate their capabilities and limitations.
• Follow project-specific guidelines and Statements of Work (SOWs) carefully while maintaining consistent evaluation standards.
• Communicate promptly with project teams and complete assigned tasks within required timelines.
• Adapt to different AI evaluation projects as assignments become available, including projects involving written, voice, or video-based interactions.

• Native or expert-level proficiency in Brazilian Portuguese, equivalent to approximately C2 level under the CEFR.
• Strong English reading, writing, and communication skills, with an assessment potentially required during the selection process.
• At least 18 years of age.
• Hands-on experience using AI models, generative AI tools, or large language models.
• Comfortable communicating through both written and spoken interactions, with the ability to ask clear, precise, and insightful follow-up questions.
• Strong attention to detail and the ability to evaluate language and AI responses objectively against defined criteria.
• Comfortable using web-based tools and completing structured digital tasks independently.
• Access to your own smartphone, computer or laptop, and reliable internet connection.
• Willingness to complete language proficiency assessments and an AI evaluation task as part of the onboarding process.
• Strong responsiveness and communication skills, particularly when receiving project or onboarding updates.
• Ability to begin work within approximately 48 hours of being contacted.
• Comfortable completing tasks that may involve voice or short video recordings, depending on project requirements.
• Ability to successfully complete required identity verification before engagement.

• $14 USD per hour for completed project work.
• Fully remote work that can be performed from Brazil or another eligible location outside the United States.
• Flexible scheduling, allowing you to choose which tasks to accept and when to work.
• Independent contractor engagement with the freedom to work with other clients simultaneously.
• Task-based and project-based assignments without ongoing day-to-day micromanagement.
• Opportunity to apply your Brazilian Portuguese language expertise to real-world AI development projects.
• Potential access to future projects after completing the initial application and onboarding process.
• Practical experience evaluating and improving generative AI systems.
• Clear project specifications and task requirements provided before work begins.
• Work with international teams on projects focused on language, AI evaluation, and data quality.
• Project-based flexibility, with work typically delivered in batches and the possibility of pauses between assignments.
• Equal opportunity environment welcoming contributors from diverse backgrounds and abilities.