Data Annotation Specialist, Data Science in Canada Creek, Nova Scotia at Jobgether
Explore Related Opportunities
Job Description
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Data Annotation Specialist, Data Science based in Canada.
This role sits at the intersection of data science, software engineering, and AI model evaluation, contributing directly to the improvement of cutting-edge foundation models. You will work on analyzing coding tasks, debugging outputs, and assessing the logical consistency of AI-generated responses. The position is highly detail-oriented, requiring strong analytical judgment and a solid understanding of data science workflows. You’ll evaluate model behavior across coding, visualization, and structured data tasks, helping refine how AI systems reason and execute technical instructions. Working remotely within Canada, you’ll join a global, fast-moving environment where quality feedback directly shapes model performance. This is a contract-based opportunity designed for professionals who enjoy hands-on technical evaluation work and iterative problem-solving.
In this role, you will be responsible for assessing and improving the quality of AI-generated technical outputs, ensuring accuracy in coding and data science reasoning tasks:
- Evaluate AI model responses to coding, data manipulation, and workflow-based prompts, identifying errors in logic, syntax, and execution.
- Review and analyze agent trajectories, debugging outputs, and structured problem-solving steps across data science and software engineering tasks.
- Label, proofread, and refine both machine-generated and human-written code-related content for clarity, correctness, and consistency.
- Assess outputs involving data visualization, tabular analysis, and statistical workflows, ensuring technical and logical integrity.
- Contribute feedback on model performance trends and document recurring issues in AI behavior across assigned tasks.
Candidates should bring strong technical expertise in data science and programming, along with excellent analytical and evaluation skills:
- 3+ years of professional experience in data science, analytics, or related technical roles involving real-world data pipelines.
- Strong proficiency in Python and data science libraries such as NumPy, pandas, matplotlib, and related tools.
- Solid understanding of SQL and experience working with structured and unstructured data formats (JSON, XML, YAML, HTML, Markdown).
- Experience reviewing, debugging, or improving code quality in production or research environments.
- Strong analytical thinking and attention to detail, with the ability to evaluate complex technical outputs critically.
- Familiarity with AI coding agents or model evaluation workflows is considered an advantage.
This is a flexible independent contractor role offering competitive compensation and remote autonomy:
- Contract rate of approximately 40 CAD/hour.
- Remote work arrangement within Canada.
- Minimum commitment of 16 hours per week with flexible scheduling.
- 12-month contract with potential variability in workload based on project needs.
- Performance-based incentives may be available depending on assignment outcomes.
- Opportunity to contribute directly to frontier AI model development and evaluation work.