Senior Data Engineer, AI/ML Platforms in New York at Jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer, AI/ML Platforms based in the United States.

This is a senior data engineering role focused on designing and managing scalable data systems, pipelines, and data management solutions.
You’ll build and maintain critical pipelines that process large volumes of data across diverse internal and external sources and platforms.
The role combines hands-on engineering with data quality, governance, security, automation, and large-scale processing.
You’ll partner with architects, analysts, stakeholders, and business teams to translate requirements into reliable technical solutions.
You’ll have the opportunity to guide junior engineers and peers while contributing to complex, enterprise-wide data initiatives.
The environment values proactive problem-solving, technical excellence, collaboration, and continuous improvement.
This position is well suited to an experienced engineer who enjoys solving complex data challenges and building dependable infrastructure at scale.

• Collaborate with data architects, analysts, business stakeholders, and other teams to identify, clarify, and document requirements for data pipelines and process automation.
• Design, build, document, test, deploy, and maintain scalable and reliable data pipelines using established engineering best practices.
• Develop data collection and storage systems capable of processing large volumes of data across multiple platforms, sources, and data structures.
• Perform ETL and ELT operations in alignment with enterprise data governance, security, and compliance standards.
• Develop and maintain data quality and governance processes to ensure data accuracy, consistency, completeness, and reliability.
• Implement inspection, validation, processing, and anomaly-detection approaches to identify and mitigate data quality issues.
• Recommend and implement appropriate data models, storage solutions, and processing architectures based on business and technical requirements.
• Contribute to projects involving data collection, transformation, warehousing, integration, and process automation.
• Work directly with business and client stakeholders to translate business needs into practical and scalable technical solutions.
• Provide technical guidance, mentoring, and knowledge-sharing to junior engineers and peers.
• Identify potential technical issues proactively and implement measures to prevent, reduce, or resolve their impact.
• Create clear technical documentation covering data pipelines, processes, requirements, integrations, and operational procedures.
• Stay adaptable and learn new technologies, programming languages, tools, and software systems as required by evolving business needs.

• 5–7 years of relevant professional experience in data engineering or a closely related technical discipline.
• Bachelor’s degree in a relevant field.
• Strong experience working with multiple software development and data engineering methodologies, including agile approaches.
• Proven experience designing and building large, complex data pipelines spanning multiple platforms, data sources, and data structures.
• Strong understanding of computer systems, integrations, databases, data storage technologies, and enterprise data environments.
• Hands-on experience with relational databases such as SQL Server and Oracle, including advanced SQL scripting.
• Experience with major cloud platforms such as AWS, Azure, or Google Cloud Platform and their associated data integration and ETL technologies.
• Practical expertise in data warehousing, data cleansing, transformation, sourcing, maintenance, and data lifecycle management.
• Strong programming experience in Python, Apache Spark, and comparable languages or frameworks.
• Advanced knowledge of large-scale data processing engines and distributed data processing concepts.
• Strong understanding of database security, data governance, compliance requirements, and related controls.
• Ability to capture and document business processes and requirements and translate them into functional and technical specifications.
• Strong analytical, organizational, and problem-solving skills, with a proactive and detail-oriented approach.
• Excellent interpersonal and communication skills, with the ability to collaborate effectively across technical and business teams.
• Ability to explain complex technical concepts clearly and translate business needs into effective technology solutions.
• Demonstrated ability to mentor, guide, and train colleagues and contribute positively to a collaborative team environment.
• Proficiency with Microsoft Office applications, including Word, Excel, PowerPoint, and Outlook.
• Willingness and ability to quickly learn new applications, technologies, and software systems as business needs evolve.

• Fully remote position for candidates based in the United States.
• Full-time employment with the opportunity to contribute to complex, enterprise-scale data initiatives.
• Collaborative environment involving data engineering, architecture, analytics, and business stakeholders.
• Opportunities for professional development, technical learning, and knowledge sharing.
• Opportunities to mentor peers and contribute to the growth of engineering capabilities.
• Supportive workplace culture emphasizing collaboration, inclusion, continuous improvement, and professional growth.
• Equal employment opportunity environment with reasonable accommodations available where applicable.