Data Engineer in Brazil, Indiana at Jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Data Engineer based in Brazil.

This role offers the opportunity to design, develop, and optimize scalable data solutions that support critical business operations.
You will work on modern data platforms, building reliable pipelines and workflows using advanced cloud technologies.
The position focuses on transforming complex data challenges into efficient, high-performance engineering solutions.
You will collaborate with cross-functional teams to improve data accessibility, quality, and operational efficiency.
The environment values technical excellence, innovation, and continuous improvement through modern DataOps practices.
This is an opportunity for an experienced data professional to influence architecture decisions and contribute to large-scale data initiatives.

The Data Engineer will be responsible for designing, implementing, and maintaining robust data platforms, ensuring scalability, reliability, and performance across complex data environments.

• Build, maintain, and optimize scalable data pipelines and workflows using modern data engineering technologies.
• Develop and manage data solutions within Databricks environments, including Delta Lake, Spark, Unity Catalog, Jobs, and Workflows.
• Design and tune distributed data processing systems to handle large-scale data workloads efficiently.
• Create and maintain complex data models across multiple business domains.
• Develop data processing solutions using SQL and programming languages, with a preference for Python expertise.
• Implement and improve CI/CD pipelines, DevOps/DataOps practices, automated testing, and engineering standards.
• Work with distributed processing technologies such as Apache Spark to support reliable data operations.
• Troubleshoot, debug, and resolve complex technical issues across multi-system environments.
• Collaborate with engineering, analytics, and business teams to deliver high-quality data solutions.
• Contribute to technical roadmaps and lead cross-functional engineering initiatives.
• Improve data observability, monitoring, quality processes, and platform reliability.
• Participate in Agile development practices, contributing to planning, collaboration, and continuous improvement.

The ideal candidate brings strong data engineering expertise, cloud experience, and the ability to design scalable solutions in dynamic technical environments.

• 5+ years of experience in data engineering or a related technical field.
• Strong hands-on experience with Microsoft Azure data services.
• Extensive experience working with Databricks and building production-grade data pipelines.
• Advanced SQL skills and proficiency in at least one programming language, preferably Python.
• Strong experience with Apache Spark and distributed data processing architectures.
• Proven ability to design, implement, and optimize scalable data workflows.
• Experience with data modeling across multiple business areas.
• Strong knowledge of version control, CI/CD pipelines, DevOps/DataOps practices, and automated testing.
• Strong analytical, debugging, and problem-solving skills.
• Ability to collaborate effectively within Agile, cross-functional engineering teams.
• Strong communication skills and ability to influence technical decisions.

Additional experience that would be valued:

• Experience with Databricks Unity Catalog, Delta Live Tables, and Databricks Workflows.
• Experience with DataOps practices, including pipeline monitoring, observability, and automated quality checks.
• Knowledge of metadata management and cataloging platforms such as Purview, Collibra, or Alation.
• Experience with streaming technologies such as Kafka, Event Hubs, or Kinesis integrated with Spark Structured Streaming.
• Experience working in Agile environments.

• Fully remote work model, allowing professionals to work from anywhere in LATAM.
• Full-time contract opportunity with an initial duration of 5+ months and potential extension.
• Flexible remote collaboration environment.
• Opportunity to work with modern cloud data technologies and large-scale engineering challenges.
• Exposure to advanced DataOps, analytics, and distributed data processing practices.
• Collaboration with experienced technical teams in an innovative environment.