Gujarati - AI Product Evaluator in India at Jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Gujarati - AI Product Evaluator based in India.

This flexible, project-based opportunity is ideal for native or expert Gujarati speakers interested in helping shape the future of generative AI. As an AI Product Evaluator, you will interact directly with AI chatbots and language models to assess their quality, helpfulness, safety, and understanding of Gujarati. Your feedback will provide valuable insights that contribute to improving AI models and their ability to communicate naturally in your language. Depending on the project, you may complete written evaluations, voice interactions, or other structured testing activities. You will have the freedom to select available tasks and manage your own schedule. Projects are delivered in batches, allowing you to participate flexibly alongside other professional or personal commitments.

• Test and evaluate AI chatbots and language models through structured conversations based on assigned goals, prompts, and evaluation criteria.
• Assess AI-generated responses for quality, accuracy, relevance, helpfulness, safety, and naturalness in Gujarati.
• Interact with AI systems in Gujarati and ask clear, thoughtful follow-up questions to test their capabilities and identify areas for improvement.
• Participate in voice-based AI evaluations when required, using clear and natural Gujarati pronunciation; sessions may be recorded and shared with the project client as part of the evaluation deliverables.
• Complete project-specific tasks according to the instructions and requirements outlined in the applicable Statement of Work (SOW).
• Submit accurate and complete deliverables, which may include written feedback, ratings, screenshots, audio recordings, or other specified materials.
• Follow project guidelines, quality standards, technical instructions, and confidentiality requirements throughout each assignment.
• Communicate promptly with the project team and complete onboarding requirements and assigned tasks within the required timelines.
• Remain available for future AI evaluation projects where your Gujarati language expertise and experience are relevant.

• Native or expert-level fluency in Gujarati as spoken in India, with proficiency equivalent to approximately C2 level under the CEFR.
• Strong English reading, writing, and communication skills; an English proficiency assessment may be required.
• Must be 18 years of age or older.
• Hands-on experience using generative AI tools, AI chatbots, or large language models.
• Comfortable with both written and voice-based conversations and able to formulate precise, insightful follow-up questions.
• Strong critical-thinking and analytical skills, with the ability to evaluate AI-generated content objectively and consistently.
• Excellent attention to detail and the ability to follow structured evaluation criteria accurately.
• Own smartphone and computer/laptop with a reliable internet connection.
• Comfortable using web-based platforms and digital tools for completing project tasks.
• Ability to successfully complete required language proficiency and technical literacy assessments.
• Responsive communication style, particularly during onboarding and active project periods.
• Ability to begin within 48 hours of selection.
• Comfortable completing tasks that may involve short video recordings, including recordings that may show your face or objects, depending on project requirements.
• Professional voice recording experience or experience requiring clear, neutral pronunciation is an advantage.
• Previous experience in AI projects, transcription, translation, localization, linguistic analysis, or related language-focused work is a plus.
• Willingness to complete identity verification, which may require providing a photograph and an image of an identity document.
• Existing Upwork account or willingness to create one if required for the engagement.

• $8 USD per hour for completed project work.
• Flexible, task-based independent contractor engagement.
• Choose which available tasks to accept and determine your own working hours.
• Work remotely from anywhere in India.
• Freedom to work alongside other clients, employment, or professional commitments.
• Apply once and remain in consideration for future projects that match your Gujarati language expertise.
• No fixed ongoing schedule or micromanagement, with clear task specifications provided for each project.
• Opportunity to gain practical experience working on generative AI evaluation and language technology projects.
• Directly contribute to improving how AI systems understand and communicate in Gujarati.
• Exposure to projects involving AI evaluation, linguistic analysis, voice interactions, and language data.
• Project work is delivered in batches, providing flexibility around periods of higher or lower activity.
• Opportunity to contribute to technology that supports greater representation of regional languages and cultures in AI.