Senior Product Manager in Sachseln, Obwalden at Jobgether
Explore Related Opportunities
Job Description
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Product Manager based in Switzerland.
Lead the product strategy for evaluating and improving the quality of AI-generated advertising creative at scale.
You’ll own the full Evals & Quality product area, from defining what “good” means to building reliable systems that measure it.
The role combines product discovery, measurement methodology, human and automated evaluation, and customer-facing commercial enablement.
You’ll work closely with AI and agent teams to make quality metrics an integral part of how new capabilities are developed and launched.
A key focus will be creating scalable evaluation loops, representative datasets, and judging frameworks for a highly subjective creative domain.
You’ll also translate quality evidence into customer-facing assets, helping demonstrate product capabilities through RFPs, enablement materials, and public evaluations.
This is a remote opportunity for an experienced product leader who enjoys ambiguity, measurable outcomes, fast iteration, and AI-powered products.
- Own the overall charter for Evals & Quality, defining the long-term problem, success metrics, priorities, and clear scope boundaries.
- Define and improve core quality metrics, including first-pass-right performance, evaluation coverage, and regression detection.
- Own the methodology for evaluating creative quality, including quality rubrics and calibration processes that maintain alignment between automated judges and human reviewers.
- Design and manage scalable human quality-control processes, determining where human review adds value and how those judgments can improve automated evaluation systems.
- Own the golden dataset, including its curation, representativeness across formats and client contexts, versioning, and ongoing maintenance.
- Build reusable evaluation loops that enable product and engineering teams to evaluate new capabilities independently.
- Manage the public evaluation experience as a product, maintaining a high standard of usability, credibility, and design quality.
- Provide quality evidence for commercial activities, including client RFP responses and creative enablement materials.
- Partner with Agent Architects to establish client-specific quality standards through configurable rubrics and methodologies rather than bespoke evaluation code.
- Lead the complete product lifecycle, from discovery and hypothesis definition through launch and post-launch review.
- Establish a consistent practice of documenting hypotheses before releases and reviewing outcomes approximately 14 days after launch.
- Use customer evidence and product data to influence decisions beyond the immediate product team and continuously improve evaluation practices.
- Demonstrated experience owning a quality, evaluation, experimentation, or ML measurement product with its own roadmap, users, and measurable outcomes.
- Proven experience defining and measuring quality in a subjective or complex domain where there is no single objectively correct answer.
- Hands-on understanding of golden datasets, evaluation rubrics, judge calibration, human review processes, and inter-rater reliability.
- Ability to identify weaknesses in measurement systems and develop practical approaches to improve the reliability and scalability of evaluation signals.
- Strong product discovery skills, including the ability to understand customer needs, learn unfamiliar domains, test hypotheses, and make evidence-based product decisions before committing to solutions.
- Experience owning metrics that have influenced decisions outside your immediate team or function.
- Comfortable working directly with clients, including presenting methodologies, explaining evidence, and responding to questions from buyers and stakeholders.
- Strong product lifecycle management skills, from discovery and prioritization through launch, measurement, and post-launch learning.
- Ability to work effectively with technical, AI, data, design, and customer-facing teams in a fast-moving environment.
- Strong ownership mindset, with a focus on measurable outcomes rather than simply delivering features or outputs.
- Comfortable making decisions with incomplete information, iterating quickly, and simplifying complex problems into reusable product patterns.
- Empathetic approach to users and colleagues, with a strong focus on usability, workflow quality, and attention to detail.
- Genuine interest in AI-powered products, creative technology, measurement, and the evolving challenges of evaluating generative AI outputs.
- Paid time off: 25 days of PTO plus public holidays, within a flexible time-off framework.
- Healthcare: Health insurance and private medical coverage.
- Wellness and development: Monthly stipend supporting wellness, fitness, and learning and development.
- Remote work: Work remotely from anywhere within your home country.
- Flexible hours: Flexible working hours designed to support different working styles and schedules.
- Parental support: Enhanced parental leave policies covering birth, adoption, and surrogacy.
- Office access: Access to a London office location for eligible UK-based employees.
- AI and product exposure: Work on an AI-powered product focused on generative AI, creative technology, evaluation, and advertising.
- International environment: Collaborate with multidisciplinary teams and customers across global markets.