Data Engineer (Databricks) | PL in Brazil, Indiana at Jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Data Engineer (Databricks) | PL based in Brazil.

This role offers the opportunity to design and build scalable data solutions that support strategic business initiatives in financial and agribusiness environments.
The professional will work on the development of modern data platforms, creating reliable pipelines and enabling high-quality data availability.
You will collaborate with technology and business teams to transform complex data requirements into efficient and sustainable solutions.
The position involves working with advanced data engineering technologies, cloud platforms, and distributed processing architectures.
You will contribute to the evolution of data ecosystems by improving performance, reliability, and accessibility across different data sources.
This is an opportunity for a data professional who enjoys solving complex challenges and building impactful data-driven products.

The Data Engineer will be responsible for designing, developing, and maintaining data solutions that support business needs through scalable architectures and reliable processing workflows.

• Develop and evolve data platforms focused on commercial credit and agribusiness solutions.
• Design functional and data models aligned with business requirements and technical objectives.
• Build, maintain, and optimize scalable and reliable data pipelines using modern processing technologies.
• Perform data ingestion, transformation, validation, and availability processes while ensuring quality and performance.
• Develop and maintain data architectures based on Data Lake and Data Lakehouse concepts.
• Collaborate with multidisciplinary teams to understand requirements and deliver effective data solutions.
• Apply best practices in data engineering, automation, and pipeline reliability.
• Support continuous improvements in data processing efficiency and platform scalability.

The ideal candidate is a Data Engineer with experience building modern data platforms, distributed processing solutions, and cloud-based architectures. The role requires strong technical knowledge, analytical skills, and the ability to work with complex data environments.

• Experience with Apache Spark for distributed data processing.
• Experience with Apache Airflow for data pipeline orchestration.
• Knowledge of Apache Kafka for real-time data processing and integrations.
• Experience with dbt (Data Build Tool) for data transformation and modeling.
• Experience working with SQL and NoSQL databases, including PostgreSQL, MongoDB, and Cassandra.
• Experience with cloud data platforms such as Databricks, AWS Glue, and BigQuery.
• Knowledge of implementing and maintaining Data Lake and Data Lakehouse architectures.
• Ability to analyze business requirements and translate them into efficient data solutions.
• Strong problem-solving skills and attention to data quality, reliability, and performance.

• Opportunity to work on innovative data projects involving advanced technologies.
• Exposure to modern cloud platforms and large-scale data architectures.
• Professional growth in a technology-driven environment.
• Opportunity to collaborate with multidisciplinary teams and contribute to impactful solutions.
• Career development opportunities focused on continuous learning and emerging technologies.