AI Analyst II at McCarthy Building Companies, Inc. – St. Louis, Missouri

McCarthy Building Companies, Inc.

Position SummaryAs an AI Analyst, you will play a foundational role in McCarthys AI journey. Working closely with our AI Architect and AI Engineers, you will support the development, testing, and governance of AI systems that power our construction business. This role is hands-on with data and AI workflows, but also emphasizes documentation, validation, and translation of technical results into business insights. This is a unique opportunity for an early-career professional to learn the inner workings of enterprise AI while contributing directly to responsible, value-driven outcomes. Key Responsibilities

• Take ownership of assigned projects or components, moving ideas from concept to execution while tracking progress, stakeholders, and changes under guidance from senior team members.
• Participate in mapping out and documenting processes for the deployment, scaling, and ongoing improvement of AI platforms used across business units
• Prepare and share meeting notes, research summaries, process documentation, and action items with teams in a timely and accessible manner
• Contribute to a collaborative, feedback-driven work culture that encourages continuous improvement and learning
• Assist in maintaining and validating data models and shared definitions that help align analytics, AI outputs, and business concepts across teams.
• Supports data preparation, documentation, and testing activities.
• Run exploratory analyses to identify trends, anomalies, and insights in construction and project data.
• Assist in testing and evaluating AI/ML model outputs and generative AI prompts for accuracy, relevance, and compliance.
• Track key metrics for AI solutions (accuracy, bias, adoption, governance checkpoints).
• Support the development of dashboards, reports, and visualizations to communicate AI outcomes to business stakeholders.
• Contribute to prompt lifecycle management by organizing, testing, and versioning prompts.
• Document workflows, test results, and decision points to ensure auditability and transparency.
• Collaborate with engineers, architects, and business teams to align analytical tasks with real-world project needs.

Qualifications

• Bachelor’s degree in Data Science, Computer Science, Statistics, Business Analytics, Engineering, or a related field (or equivalent project experience).
• 3 – 5 years of professional experience or strong academic/project experience in data/AI, analytics, data science, or business intelligence.
• Execute well-defined analytical tasks with guidance and assist in model monitoring, data quality checks, and prompt testing.
• Strong analytical skills with comfort in SQL, Excel, and Python (pandas, matplotlib, scikit-learn basics).
• Familiarity with cloud data environments AWS, Azure, GCP and willingness to learn MLOps/PromptOps tools.
• Strong understanding of AI/ML concepts and interest in generative AI systems.
• Strong attention to detail and a passion for data quality and governance.
• Excellent communication skills—able to summarize technical results for nontechnical audiences.
• Growth mindset: eager to learn AI governance, prompt engineering, and agentic AI concepts on the job.

McCarthy is proud to be an equal opportunity employer, including disability and protected veteran status.