Engenheiro de Dados in Brazil at Jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Engenheiro de Dados based in Brazil.

This role is focused on designing and building the data foundations that enable reliable, scalable, and high-performance analytics solutions.
You will work hands-on developing integrations, data pipelines, and transformation processes that move information from multiple sources into consumption layers.
The position combines software engineering, cloud technologies, data processing, and modern data architecture practices.
You will contribute to creating efficient data flows that support business decisions and improve access to valuable information.
The role offers the opportunity to work with advanced technologies such as distributed processing, streaming platforms, and cloud-based data services.
You will collaborate with technical teams in an environment focused on innovation, data quality, and scalable solutions.

The role is responsible for building and maintaining data engineering solutions, ensuring efficient data movement, processing, quality, and availability across the organization.

• Develop and maintain data ingestion pipelines, integrations, and transformation processes from multiple data sources.
• Build scalable data workflows using Apache Spark for both batch processing and real-time streaming scenarios.
• Implement and maintain event-driven data solutions using messaging and streaming technologies such as Apache Kafka and Amazon Kinesis.
• Extract and integrate raw data from different platforms, APIs, and databases.
• Design and improve transformation processes to ensure data consistency, quality, standardization, and reliability.
• Develop data preparation workflows, including validation, deduplication, and entity relationship management.
• Work with different data formats such as CSV, JSON, and TXT.
• Create and optimize data processes that support analytics and business consumption layers.
• Collaborate with technical teams to evolve data architecture and improve operational efficiency.
• Apply cloud-based data services and storage solutions to support scalable data environments.

The ideal candidate is a hands-on data engineer with strong experience building data pipelines, working with distributed processing technologies, and designing reliable data solutions.

• Professional experience in data engineering roles focused on pipeline development and data processing.
• Strong knowledge of Apache Spark and experience with batch and streaming data processing.
• Practical experience with messaging and event-driven architectures using tools such as Apache Kafka and Amazon Kinesis.
• Proficiency in data programming languages such as Python and/or Scala.
• Advanced SQL skills and experience working with complex data queries.
• Experience handling multiple data formats, including CSV, JSON, and TXT.
• Technical ability to extract and integrate data from APIs, databases, and external platforms.
• Experience working with data quality processes, including validation, standardization, deduplication, and entity matching.
• Experience with cloud data services and storage solutions, especially within AWS environments.
• Strong analytical thinking, problem-solving skills, and ability to collaborate with technical stakeholders.

• Remote work model.
• Opportunity to work on modern data engineering projects involving cloud technologies and distributed systems.
• Hands-on experience with scalable data architectures and advanced processing frameworks.
• Professional growth opportunities in a technology-focused environment.
• Opportunity to collaborate with teams working on innovative data solutions.
• Exposure to industry-leading tools for data processing, streaming, and cloud infrastructure.