Brazilian Portuguese - AI Product Evaluator in Brazil at Jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Brazilian Portuguese - AI Product Evaluator based in Brazil.

This is a flexible, project-based opportunity for Brazilian Portuguese speakers interested in helping shape the next generation of generative AI.
You’ll interact directly with AI chatbots and language models, evaluating their quality, safety, usefulness, and ability to communicate naturally in Portuguese.
Your feedback and structured evaluations will contribute to improving AI systems and how they understand Brazilian Portuguese.
The work is task-based, allowing you to choose assignments and manage your own schedule around other professional commitments.
Projects are delivered in batches, meaning workloads may vary and pauses can occur between assignments.
Depending on the project, you may work with written conversations, voice interactions, recordings, screenshots, ratings, or written assessments.
This is an excellent opportunity to gain practical experience in AI evaluation while working remotely with flexible hours.

• Interact with AI chatbots and language models through structured conversations, following assigned objectives, prompts, and evaluation criteria.
• Assess AI-generated responses for factors such as accuracy, helpfulness, naturalness, safety, and overall quality.
• Ask relevant follow-up questions and identify weaknesses, inconsistencies, or opportunities for improvement in AI responses.
• Participate in voice-based AI evaluations when required, following project-specific recording guidelines.
• Submit task deliverables such as ratings, written feedback, screenshots, audio recordings, or other materials specified in the project Statement of Work.
• Apply project instructions and evaluation frameworks consistently across assigned tasks.
• Provide clear, thoughtful feedback that can help improve AI model performance and understanding of Brazilian Portuguese.
• Complete assigned tasks reliably and communicate promptly throughout the project and onboarding process.
• Participate in additional evaluation formats, including potential video-based tasks, when required by a specific project.

• Native or expert-level proficiency in Brazilian Portuguese, equivalent to C2 CEFR proficiency.
• Strong English reading, writing, and communication skills; an English assessment may be required.
• Hands-on experience using AI models, generative AI tools, or large language models (LLMs).
• Comfortable communicating through both written and voice-based interactions.
• Strong ability to ask precise follow-up questions and critically evaluate AI responses.
• 18 years of age or older.
• Ability to successfully complete required language proficiency and technical literacy assessments.
• Own smartphone, computer/laptop, and reliable internet connection suitable for web-based work.
• Comfortable using online platforms and digital collaboration tools.
• Ability to start within 48 hours of being selected.
• Responsive and reliable communication during onboarding and active project periods.
• Comfortable completing tasks that may involve audio or video recording, depending on project requirements.
• Ability to successfully complete identity verification before engagement.
• Previous experience in AI projects, transcription, translation, localization, or voice recording is valuable but not necessarily required.

• $14 USD per hour for completed project work.
• Fully remote work that can be performed from Brazil.
• Flexible, task-based schedule where you choose which assignments to accept and when to work.
• Freedom to work with other clients or maintain other professional commitments.
• No fixed ongoing workload; projects are delivered in batches and may include pauses between assignments.
• Clear task specifications provided through project-specific Statements of Work.
• Minimal supervision and no micromanagement, with a focus on completing defined deliverables.
• Opportunity to build practical experience in AI evaluation and generative AI development.
• Opportunity to contribute directly to improving how AI understands and communicates in Brazilian Portuguese.
• Potential to be considered for future projects requiring Portuguese language expertise after applying once.