Senior AI Engineer in New York at Jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior AI Engineer based in United States.

The Senior AI Engineer will play a key role in designing and delivering production-grade Generative AI solutions for real-world business challenges.
You will own the full lifecycle of AI features, from early prototypes through scalable, reliable production services.
The role focuses heavily on document intelligence, Retrieval-Augmented Generation, semantic search, and agentic workflows.
You will combine deep expertise in LLM technologies with strong software engineering practices to build maintainable and high-performing systems.
Working directly with clients, you will translate complex business requirements into practical AI architectures and innovative solutions.
You will also address critical production considerations such as latency, reliability, monitoring, error handling, and cost optimization.
This is an opportunity to work in a highly technical, fast-moving environment where continuous learning and responsible AI development are strongly valued.

• Architect and build end-to-end Generative AI applications using Python, LangChain, LlamaIndex, and Google Cloud technologies.
• Design and implement advanced Retrieval-Augmented Generation pipelines and semantic search solutions using technologies such as Google Cloud Vector Search, Vertex AI Vector Search, Pinecone, or pgvector.
• Lead LLM and embedding fine-tuning initiatives to improve performance for specialized business domains and use cases.
• Develop and manage agentic workflows capable of automating complex, multi-step reasoning and business processes.
• Collaborate directly with clients to understand business requirements, recommend innovative AI capabilities, and translate technical concepts into practical solutions.
• Take AI features from prototype through production, applying disciplined software engineering practices throughout the development lifecycle.
• Apply MLOps practices to deploy, monitor, maintain, and continuously improve AI models and services.
• Engineer solutions for production constraints including latency, scalability, reliability, error handling, observability, and cost efficiency.
• Write clean, maintainable, well-structured code and contribute to robust development, testing, deployment, and operational practices.
• Stay current with rapidly evolving AI technologies, frameworks, models, and engineering techniques.
• Promote responsible AI development, data privacy, and ethical practices throughout the design and implementation of AI solutions.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical discipline.
• 5+ years of professional experience in AI/ML engineering or a closely related field.
• Proven experience deploying Generative AI products or features into production environments.
• Advanced proficiency in Python and shell scripting.
• Extensive hands-on experience with LLM technologies such as Google Gemini, GPT-4, LLaMA, or comparable models.
• Strong knowledge of prompt engineering, LLM fine-tuning, and embedding optimization.
• Deep experience with vector databases and semantic search technologies, including Vertex AI Vector Search, pgvector, Pinecone, or similar platforms.
• Hands-on experience with Google Cloud and Vertex AI, including designing scalable cloud-based software architectures.
• Proficiency with LangChain, LlamaIndex, or comparable AI orchestration frameworks.
• Strong understanding of software engineering principles, clean code, maintainability, testing, and the full software development lifecycle.
• Knowledge of data engineering concepts and SQL.
• Experience with traditional machine learning, including neural networks, model training, and tuning, is a strong plus.
• Strong ownership mentality with the ability to take projects from initial concept through deployment and ongoing improvement.
• High curiosity and commitment to continuous learning in a rapidly evolving AI landscape.
• Consultative approach with the ability to engage with clients and translate technical complexity into clear business value.
• Strong commitment to responsible AI, data privacy, and ethical technology development.

Benefits

• Competitive salary and comprehensive benefits package.
• Comprehensive health insurance.
• Paid vacation and Paid Time Off.
• Paid holidays.
• Sick leave.
• Parental leave.
• Bereavement leave.
• 401(k) plan with employer matching.
• Employee referral bonuses.
• Opportunities to work on advanced Generative AI, document intelligence, RAG, semantic search, and agentic AI initiatives.
• Client-facing opportunities that provide exposure to diverse business challenges and innovative technology solutions.
• Professional growth in a fast-paced, engineering-focused environment centered on continuous learning and innovation.
• Standard hiring verification practices may include background checks, employment verification, and other relevant checks.
• Equal opportunity workplace with reasonable accommodations available throughout the selection process.