Sr. Lead Software Engineer, Data Platform at Jobgether – United States
Explore Related Opportunities
About This Position
This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Sr. Lead Software Engineer, Data Platform in the United States.
This role is a senior individual contributor position focused on building and scaling a next-generation, cloud-native data platform that powers analytics and customer-facing insights at massive scale. You will help design and evolve a centralized data lake architecture built on modern technologies such as Apache Iceberg, supporting both high-throughput batch ingestion and real-time streaming pipelines. Operating in a highly technical, production-facing environment, you will tackle complex data challenges involving performance, reliability, and low-latency access to large-scale datasets. This position offers deep ownership over core platform components and the opportunity to directly influence architectural direction across a multi-cloud ecosystem. You will collaborate closely with senior engineers across data, platform, and analytics teams to ensure data is accurate, accessible, and optimized for downstream consumption. This is a high-impact role for an experienced engineer who enjoys solving foundational data infrastructure problems at scale.
- Design and implement scalable data ingestion systems supporting high-volume batch and streaming (CDC) pipelines across diverse data sources.
- Build and enhance core data platform components including ingestion, validation, orchestration, lineage, and data quality frameworks.
- Develop and evolve a centralized data lake architecture using Apache Iceberg or similar lakehouse technologies.
- Architect and implement cloud-agnostic data processing solutions across AWS, GCP, and Azure environments.
- Contribute to the semantic layer to ensure data is consumable for analytics, BI, and downstream applications.
- Define and promote engineering standards for observability, testing, performance, and operational excellence across the data platform.
- Partner with cross-functional teams to align data modeling, storage, and consumption strategies.
- Provide technical leadership through design reviews, mentorship, and hands-on engineering contributions.
The ideal candidate brings 8–10+ years of experience in software engineering or data platform engineering, with a strong focus on building scalable distributed data systems. You have deep expertise in data ingestion patterns, including CDC, and strong knowledge of how data is modeled and optimized within lakehouse architectures. You are highly proficient in Python and SQL, with a track record of delivering production-grade, maintainable, and testable code. Hands-on experience with cloud data services across AWS, GCP, or Azure is required, along with familiarity with modern data warehouses such as Snowflake, BigQuery, or Databricks. You understand large-scale data pipeline design and have worked with query engines like Trino or Presto for analytics at scale. Experience with Apache Iceberg or Delta Lake, along with data governance, metadata, and lineage practices, is highly valued. You are a strong communicator with a collaborative mindset and the ability to influence technical direction while staying deeply hands-on.
Benefits:- Competitive compensation package aligned with experience and location
- Remote-first work environment with flexibility
- Opportunity to work on large-scale, multi-cloud data platforms
- High-impact role with direct influence on customer-facing analytics products
- Exposure to modern data technologies including Iceberg, lakehouse architectures, and distributed query engines
- Collaborative engineering culture with strong mentorship and technical ownership
- Inclusive workplace environment focused on transparency and innovation
- Opportunity to work on complex, real-world data challenges at scale