Senior Data Engineer in New York at Jobgether
Job Description
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer based in the United States.
The Senior Data Engineer will lead the design, development, and optimization of enterprise data architectures and business intelligence solutions.
This role combines advanced data engineering, cloud infrastructure expertise, and database administration to support complex analytical environments.
You will oversee data models, repositories, metadata, and integration processes while ensuring data quality, reliability, and performance.
Working with modern AWS technologies and automation tools, you will drive infrastructure improvements and scalable data solutions.
In close collaboration with Agile teams and business stakeholders, you will translate technical and operational requirements into effective engineering designs.
This is an opportunity to contribute to digital transformation initiatives across highly regulated industries, including financial services, healthcare, and the public sector.
As Senior Data Engineer, you will oversee the architecture, implementation, and maintenance of complex data environments while ensuring that business intelligence capabilities meet organizational and technical requirements.
Lead complex data architecture, database design, metadata development, repository creation, management, and administration.
Configure database parameters, allocate resources, and validate data loads to ensure accuracy and consistency.
Oversee troubleshooting, application support, data requirements analysis, and maintenance of database schemas and processing architectures.
Establish and maintain data definitions, underlying data models, and quality standards while monitoring and auditing data integrity.
Identify and implement improvements to infrastructure efficiency, automation processes, and overall system performance.
Develop advanced analytical data models, ad hoc queries, and reports for audit teams and business management, using SQL to analyze existing metrics and define new ones.
Lead software testing activities, including unit testing, ETL validation, SQL and reporting tool testing, and the development of moderately complex scripts.
Collaborate within Agile teams to design and implement data-driven capabilities, dashboards, reporting solutions, metadata and metrics collection processes, and data governance practices.
Coordinate data issue resolution, data cleanup and maintenance, and data-sharing agreement processes.
Develop conceptual, logical, and physical IT engineering designs that address infrastructure requirements across different technical and business projects.
Analyze business requirements and translate them into technical infrastructure designs, ensuring clear traceability between business needs and engineering solutions.
The ideal candidate brings extensive experience in data engineering, cloud technologies, and enterprise database architecture, combined with strong analytical capabilities and the ability to lead complex technical initiatives.
US citizenship or permanent residency is required.
Bachelor's degree or higher in a relevant discipline, with at least 9 years of relevant professional experience.
Strong knowledge of programming, SQL queries, data warehousing, relational databases, and quantitative and qualitative data analysis techniques.
Hands-on experience with core AWS services for building and supporting data solutions, particularly S3, AWS Glue, and Lambda.
Advanced expertise in AWS storage services, including S3 and EBS, AWS database technologies such as Aurora PostgreSQL, and data integration using AWS Glue.
Good understanding of AWS Identity and Access Management (IAM), networking, and monitoring tools.
Proficiency in CI/CD practices and deployment automation using GitLab pipelines.
Experience with cloud infrastructure provisioning and automation tools such as Terraform.
Strong software engineering background in Java EE and cloud technologies, including Java Lambdas, Java Streams API, and functional programming.
Proficiency in at least one additional programming language, such as Python or Scala.
Knowledge of Workday data tools, particularly Adaptive and Prism, is a plus but not required.
Strong problem-solving, troubleshooting, and analytical skills, with the ability to translate business requirements into scalable technical solutions.
Ability to collaborate effectively with cross-functional Agile teams and communicate complex technical concepts to business and technical stakeholders.
Comprehensive benefits package, including medical and dental insurance.
401(k) retirement plan with employer matching contributions.
Flexible Spending Accounts (FSA).
Up to 27 days off annually, including your birthday.
Remote work opportunities and flexible working arrangements.
Parental leave and wellness benefits.
Investment in professional development through Communities of Practice, technology partnerships, hands-on sandbox environments, and paid certifications and training.
Opportunities to contribute to impactful digital transformation projects across financial services, healthcare, nonprofits, and the public sector.
Inclusive and diverse workplace culture that values collaboration, professional growth, and individual contributions.
Recognized workplace culture, with seven Best Places to Work in Virginia awards, including in 2025.
Scan to Apply
Just scan this QR code to apply from your phone.
- Fast
- Easy
- Apply on the go