Engenheiro de Dados Sênior | Automações com IA | Azure e AWS in Brazil, Indiana at Jobgether

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Engenheiro de Dados Sênior | Automações com IA | Azure e AWS in Brazil.

This role is focused on designing and evolving modern, scalable data platforms that support advanced analytics and AI-driven automation. You will work on building robust data pipelines across Azure and AWS environments, ensuring reliable ingestion, transformation, and availability of critical business data. The position involves integrating multiple data sources such as APIs, databases, and external ETL systems into unified architectures. You will contribute to a long-term digital transformation program centered on data modernization, automation, and artificial intelligence. The environment is highly collaborative, involving close work with data scientists, analysts, and engineering teams. You will also play a key role in improving data quality, governance, and performance across large-scale systems. This is a strategic role with direct impact on decision-making and operational efficiency.

• Design and implement scalable data ingestion pipelines from diverse sources including APIs, relational and non-relational databases, files, and real-time systems.
• Develop and maintain end-to-end data architectures using Azure services such as Data Factory, Databricks, Synapse Analytics, Azure Functions, and related tools.
• Build and manage data lakes, data warehouses, and data marts ensuring reliability, performance, and accessibility of data assets.
• Integrate and consolidate complex datasets across multiple platforms, ensuring consistency, quality, and governance standards.
• Optimize ETL/ELT workflows, monitor performance, and resolve bottlenecks to ensure efficient data processing at scale.
• Collaborate with cross-functional teams including data scientists and business stakeholders to support analytics and AI initiatives.
• Ensure compliance with data security, governance, and regulatory standards such as LGPD.

Requirements:

• Strong experience as a Data Engineer building scalable data pipelines in cloud environments.
• Advanced knowledge of Azure Data Services including Data Factory, Databricks, Synapse, Azure SQL, Blob Storage, and monitoring tools.
• Experience integrating data through REST/SOAP APIs and working with real-time data ingestion.
• Solid knowledge of relational and non-relational databases such as SQL Server, PostgreSQL, CosmosDB, and MongoDB.
• Proficiency in Python, Spark, SQL, and PowerShell for data processing and automation.
• Experience with DataOps practices, CI/CD pipelines, and Git-based version control.
• Strong understanding of data modeling, query optimization, and database performance tuning.
• Knowledge of data security, governance, and compliance frameworks such as LGPD.
• Ability to communicate clearly and document technical solutions effectively.

Benefits:

• Remote work (home office) flexibility.
• Occasional business travel to client sites (e.g., Campinas/SP), fully covered.
• PJ contract arrangement.
• Standard business hours schedule.
• Inclusive and collaborative work environment.
• Opportunity to work on large-scale innovation projects involving AI, data, and automation.