Senior Data Engineer SQL in New York at Jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer SQL based in United States.

This is an opportunity for an experienced data engineer to build and support sophisticated data pipelines in a cloud-based environment.
You’ll work extensively with Databricks, Azure, SQL, Python, and distributed data technologies to power reliable data solutions.
The role combines hands-on engineering with technical leadership, consultation, and complex problem-solving.
You’ll design highly available, fault-tolerant, and self-healing pipelines across both batch and real-time workloads.
Your expertise will be critical to optimizing queries and computational processes operating across billions of data rows.
You’ll collaborate across technical and business teams while documenting systems and driving permanent solutions to complex issues.
This is a remote-friendly position offering meaningful technical challenges, professional development, and opportunities to work with modern data technologies.

• Design, build, and support non-interactive batch, distributed, and real-time data pipelines that are highly available, accurate, and scalable.
• Develop fault-tolerant, self-healing, and adaptive data processing and computational pipelines.
• Apply deep data engineering expertise to complex technical programs, providing consultation and leading implementation efforts.
• Develop, maintain, and continuously improve documentation for assigned systems, data solutions, and projects.
• Optimize and tune SQL queries operating over billions of rows within distributed query environments.
• Perform root cause analysis on software and business-process issues and implement sustainable, permanent resolutions.
• Work across data engineering, analytics, and data science initiatives to translate technical requirements into reliable production solutions.
• Use automation, cloud services, and infrastructure-as-code practices to improve the reliability and maintainability of data platforms.

• 1+ years of relevant industry experience in data engineering, analytics, data science, or a closely related discipline, or a Bachelor's/Master's degree in Engineering, Mathematics, Statistics, Computer Science, or another quantitative field.
• Strong hands-on SQL Server expertise, particularly T-SQL and query-intensive workloads, with an emphasis on direct SQL rather than ORM-based development.
• Working knowledge of PostgreSQL, including the ability to read data from replicated environments.
• Proficiency in Python and FastAPI for developing data-oriented applications and services.
• Experience with scikit-learn, including techniques such as percentile calculations and outlier detection.
• Understanding of acceptance and likelihood models, including carrier-acceptance-probability logic and related analytical approaches.
• Experience consuming data from Kafka, without necessarily requiring experience building Kafka infrastructure.
• Ability to read and understand C# code sufficiently to extract business and application logic.
• Familiarity with AWS services such as S3, RDS, Secrets Manager, and CloudWatch.
• Working knowledge of Terraform and the ability to confidently navigate infrastructure-as-code configurations.
• Strong understanding of data management, distributed processing, cloud technologies, automation, and data pipeline architecture.
• Ability to troubleshoot complex systems, conduct structured root cause analysis, and communicate technical concepts clearly.
• Strong analytical thinking, attention to detail, and the ability to work independently while collaborating effectively with technical and business stakeholders.
• Candidates who do not meet every listed qualification are still encouraged to apply, particularly those who bring transferable experience, strong learning agility, and diverse perspectives.

• $110,000–$155,000 annual salary, depending on experience and geographic location.
• Full-time position based in the United States.
• Remote and hybrid work options, depending on location.
• Career advancement opportunities and international mobility programs.
• Professional development and ongoing learning opportunities.
• Access to modern tools, training, and industry experts.
• Benefits tailored to the employee's location, with full details provided during the hiring process.
• An inclusive and collaborative workplace focused on creativity, autonomy, professional growth, and meaningful impact.
• Reasonable accommodations are available throughout the application and interview process.