Senior Software Engineer - AI in Canada Creek, Nova Scotia at Jobgether

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior Software Engineer - AI in Canada.

This is an exciting opportunity for an experienced backend engineer passionate about AI systems, scalable architectures, and modern cloud-native development. In this role, you will help build the core infrastructure powering advanced AI-driven products used at scale by millions of users. You will design high-performance APIs, develop intelligent multi-agent workflows, and integrate cutting-edge LLM technologies into production-ready services. The position offers a highly collaborative remote environment where innovation, experimentation, and engineering excellence are encouraged. You’ll work closely with talented teams focused on performance, reliability, and continuous improvement while leveraging the latest AI-assisted development tools and frameworks. This role is ideal for someone who enjoys solving complex technical challenges and shaping the future of AI-powered platforms.

• Design, develop, and scale asynchronous REST and WebSocket APIs using Python, FastAPI, and modern backend architecture principles.
• Build and optimize multi-agent AI workflows capable of orchestrating specialized LLM agents across different execution patterns.
• Integrate multiple LLM providers through flexible, provider-agnostic systems that support performance optimization and cost-aware routing.
• Develop Retrieval-Augmented Generation (RAG) solutions using vector databases and search technologies to improve AI response quality and contextual relevance.
• Implement AI-powered tools and assistants capable of advanced data analysis and file-processing functionalities.
• Manage database schemas, migrations, and high-concurrency PostgreSQL environments while ensuring performance and reliability.
• Maintain and improve CI/CD pipelines, automated testing, containerization, and deployment workflows.
• Monitor application performance through observability tools, structured logging, tracing, and latency optimization.
• Promote engineering best practices and contribute to a collaborative culture focused on innovation and AI-assisted development.

• 5+ years of experience developing production-grade backend APIs with Python.
• At least 2 years of hands-on experience with FastAPI or similar asynchronous Python frameworks.
• Strong expertise in asynchronous programming, dependency injection, Pydantic, and backend observability practices.
• Practical experience with AI agent frameworks such as Semantic Kernel or equivalent technologies.
• Proven experience building RAG pipelines using vector search technologies such as Azure AI Search, pgvector, or Chroma.
• Solid knowledge of PostgreSQL, SQLModel, SQLAlchemy, and database migration tools such as Alembic.
• Experience integrating LLM APIs including OpenAI and Gemini, with an understanding of structured outputs and AI workflows.
• Familiarity with dependency management tools, containerized environments, and CI/CD ownership from development to deployment.
• Excellent analytical thinking, troubleshooting, and problem-solving skills.
• Comfortable working in a fully remote environment with regular collaboration during EST overlap hours.
• Additional experience with message queues, observability platforms, or AI cost governance tools is considered a plus.

• Fully remote work opportunity within Canada.
• Competitive compensation package.
• Opportunity to work on cutting-edge AI and LLM technologies at scale.
• Exposure to modern cloud-native architectures and advanced backend systems.
• Collaborative and innovation-driven engineering culture.
• Flexible and autonomous work environment.
• Professional growth opportunities in a rapidly evolving AI-focused ecosystem.
• Access to modern development tools and AI-assisted engineering workflows.