Senior Software Engineer, Backend - Data Streaming in Canada Creek, Nova Scotia at Jobgether
Explore Related Opportunities
Job Description
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer, Backend – Data Streaming based in Canada.
The Senior Software Engineer will join a newly formed team building a foundational data-streaming architecture from the ground up.
You’ll design systems that allow process data to be continuously and reliably consumed without depending on the live execution engine.
The role combines distributed systems, durable storage, event streaming, and customer-facing integrations in a highly technical environment.
You’ll have significant ownership over architectural decisions, consistency and durability guarantees, and the evolution of the platform.
Your work will also help reshape how analytics and other data consumers access process information at scale.
You’ll collaborate closely with Product, Data Layer, Distributed Systems, QA, Support, and SRE teams in a remote-first environment.
This is an opportunity to tackle complex infrastructure challenges while helping define both a new product capability and the direction of a growing engineering team.
- Design and build core streaming infrastructure that separates process-data access from the live execution engine and is backed by durable, cost-efficient storage.
- Develop customer-facing data-streaming capabilities, including reliable integrations with technologies such as Kafka, enabling customers to move process data into their own systems.
- Help evolve analytics capabilities by creating scalable data-consumption patterns that operate independently of the engine’s critical path.
- Make foundational architectural decisions within a small, high-ownership team, particularly around distributed processing, consistency, durability, and reliability.
- Develop reliable and idempotent data-ingestion and storage mechanisms for object-storage environments.
- Drive significant engineering initiatives from solution design and planning through implementation, cross-team coordination, and predictable delivery.
- Work closely with Product Management to translate customer and product requirements into actionable technical solutions.
- Collaborate with Data Layer, Distributed Systems, QA, Support, and SRE teams to deliver robust production systems.
- Participate in L3 support and on-call rotations, investigating production data-layer issues and using operational learnings to improve the platform.
- Contribute to code reviews, technical discussions, and engineering practices while providing and receiving clear, constructive feedback.
- Help shape the technical direction and scope of a greenfield platform as its architecture and capabilities mature.
- 7+ years of professional backend engineering experience, with strong expertise in Java and a focus on distributed or data-intensive systems.
- Hands-on experience working with object-storage technologies such as Amazon S3, Google Cloud Storage, Azure Blob Storage, or similar platforms.
- Experience designing reliable, idempotent upload and commit protocols for object-storage systems.
- Practical experience with Kafka or a comparable streaming or event-log platform.
- Strong understanding of distributed-systems fundamentals, including consistency, durability, fault tolerance, and scalable data processing.
- Demonstrated ability to operate effectively in ambiguous environments where architecture and requirements are still being defined.
- Proven experience leading medium-to-large engineering initiatives lasting three months or longer, from solution design and planning through cross-team execution and delivery.
- Strong backend development skills and a track record of building, operating, and improving production-grade systems.
- Excellent communication and collaboration skills, particularly within remote-first and cross-functional environments.
- Ability to translate product requirements into clear technical work and collaborate effectively with Product and engineering stakeholders.
- Willingness to use and understand the product you help build.
- Experience with Apache Iceberg, Parquet, or broader data-lake/lakehouse architectures is a plus.
- Familiarity with embedded state stores such as RocksDB for projection or checkpointing workloads is advantageous.
- Experience with stream-processing frameworks such as Apache Flink, particularly stateful processing, local state backends, and checkpointing, is desirable.
- Familiarity with object-storage-native streaming architectures is an additional advantage.
- Compensation: C$152,700–C$251,200 in annual total target cash, with the range varying by Canadian market and final offers based on skills, experience, and location.
- Equity: Eligibility for equity through a Virtual Stock Option Plan, where applicable.
- Remote work: Fully remote and flexible working environment.
- Home-office support: Home-office budget and coworking-space support to help create an effective work environment wherever you work.
- Flexible time off: Flexible paid time off designed to support rest, wellbeing, and sustainable performance.
- Health & wellbeing: Locally tailored healthcare benefits, global mental-wellbeing support, and a flexible lifestyle spending benefit.
- Financial security: Retirement or pension programs, often with employer contributions, plus life and disability insurance where applicable.
- Professional development: Up to $/€/£1,000 annually for self-directed learning, including courses, certifications, and books.
- Global connection: Annual company gatherings, team offsites, local meetups, and budgets that support meaningful in-person connections.
- Collaborative culture: Work alongside an international engineering organization that values inclusion, diverse perspectives, direct feedback, and strong cross-functional collaboration.
- High ownership: Significant opportunity to influence greenfield architecture, technical direction, and the evolution of a new data-streaming capability.