Senior Software Engineer, AI at North Cloud – Dumbo, New York

About North Cloud

The public cloud is home to $200B+ in annual technology spend, yet 95% of it is still managed with credit cards and spreadsheets. With AI accelerating cloud growth towards $1T by 2030, businesses need better tools to manage, optimize, and scale their cloud investments.

At North, we’re building the next-generation cloud spend management platform, giving companies clarity, control, and automation over their cloud finances. Our mission is to help organizations take charge of their cloud costs and maximize efficiency in the AI-driven era.

Backed by top-tier investors and trusted by leading customers like Brave, StayNTouch, and DataBiologics, we’re assembling a world-class team to redefine how businesses manage cloud spend. If you’re looking for impact, growth, and the opportunity to shape the future of cloud finance, North is the place to be.

We’re looking for a Sr. Software Engineer, AI to join our team and play a key role in leading the machine learning and AI efforts by developing, deploying, and optimizing current and future features. You’ll work directly with our CTO to define and build AI-powered features that will shape Agent North, our customer-facing AI assistant, as well as drive advancements in cost and usage forecasting, financial modeling, and multi-service provider rightsizing.

This is a hands-on, senior-level role—perfect for someone who thrives in a fast-moving startup environment, has built ML-powered products before, and is comfortable taking a project from 0 to 1. If you’re a high-energy, motivated engineer passionate about LLMs, cloud infrastructure, and deploying AI systems at scale, we want to hear from you.

• Design, build, and deploy ML models for cloud automation and optimization
• Work with LLMs, fine-tuning, optimizing, and integrating them into our platform
• Develop AI chatbots and customer-facing AI solutions to automate and enhance cloud finance management.
• Ensure security and compliance in AI model deployment, implementing best practices for secure AI infrastructure.
• Set up and maintain ML infrastructure across GCP, AWS, and Azure, optimizing for scale and efficiency.
• Drive ML project development from 0 to 1, making key decisions on architecture, tooling, and implementation.
• Collaborate with engineering, product, and leadership teams to align AI development with business goals.
• Experiment with and implement cutting-edge ML techniques, including prompt engineering, model security, continuous evaluation, and monitoring frameworks.
• Provide thought leadership, driving AI strategy and identifying opportunities to improve and expand North’s AI capabilities.

• 5+ years of hands-on experience in ML, AI model development, and infrastructure deployment.
• Experience deploying ML models at scale on AWS (cloud-based, distributed systems, or edge deployments).
• Strong programming skills with Python and SQL with demonstrated ability to write production-quality code
• Proficiency with ML frameworks and determining when and where to use them based on data-complexity.
• Ability to move fast and iterate, taking ideas from concept to production.
• Comfortable with Git.
• Excellent communication skills, with the ability to clearly convey progress, methodology, solution approach, and results.
• Strong analytical background, capable of sifting through complex cost patterns and making sense of intricate financial cloud modeling.

• Experience working in a startup
• Experience working with financial cloud data across GCP, AWS, or Azure or complex large financial and logging datasets
• Experience deploying models in Amazon Bedrock or on AWS
• Experience deploying infrastructure with Terraform
• AWS technical certification (or equivalent cloud certification)

This is a hybrid role in our New York office (in Dumbo, Brooklyn). You will work part of the time in the office and part of the time remote / work-from-home.

• Unlimited PTO.
• NYC office access—work in West Village as desired.
• 16-week fully paid parental leave (mothers can extend to 20 weeks at 50% pay).
• Mandatory company-wide breaks: last week of August & Dec 23–Jan 3.
• Healthcare: Anthem BlueCross Gold PPO, 75% employer-covered.
• 30-day sabbatical every 4 years.
• Ramp credit card for approved expenses.

The base pay for this role is: $200-250k per year. Actual compensation may vary and will be based on a candidate's qualifications, skills, experience, and location.

If you’re a ML engineer who loves building AI-powered products, deploying at scale, and shaping the future of cloud financial automation, we’d love to hear from you. Apply today.