Desenvolvedor(a) Full Stack - SR in Brazil at Jobgether

ETL pipeline development and optimization

• Evolve and optimize ETL pipelines, improving the performance of filtering, joins, deduplication, aggregation, and other data transformation operations.

• Optimize the reading and writing of large files, including CSV, Parquet, and Gzip formats.

• Ensure data processing workflows remain stable, efficient, and scalable as data volumes increase.

• Explore and implement suitable approaches for handling large-scale datasets and improving processing performance.

Backend development and database management

• Develop and maintain backend services using Python and FastAPI, supporting data reconciliation and related platform functionality.

• Design, manage, and optimize PostgreSQL persistence, including schemas, indexes, queries, and metadata structures.

• Maintain database records for jobs, manifests, processing history, and configuration parameters.

• Apply database performance optimization techniques, including query analysis and execution-plan evaluation, to improve data access and processing efficiency.

• Implement caching, server-side pagination, and sorting mechanisms to support efficient interaction with large datasets.

Cloud infrastructure and data storage

• Integrate and manage file storage and processing results using Amazon Web Services (AWS), particularly Amazon S3.

• Work with AWS Athena and Amazon EKS to support data querying and application deployment or operations.

• Contribute to the reliability, scalability, and operational stability of data processing and storage components.

Frontend development and user experience

• Develop and improve user-facing features for data reconciliation, filtering, pagination, sorting, and exporting.

• Support frontend functionality using React and TypeScript, particularly for data grids and server-side data interactions.

• Collaborate across the stack to ensure efficient communication between frontend components, backend services, and data processing pipelines.

Technical improvement and innovation

• Evaluate and apply suitable data processing tools, such as Polars, pandas, and DuckDB, to improve performance when handling large datasets.

• Apply knowledge of artificial intelligence to support technical solutions and platform evolution.

• Contribute to architectural decisions involving job-oriented processing patterns, queues, data persistence, and scalable application design.

Senior-level experience in full stack development, backend engineering, or a closely related software engineering discipline.

Strong proficiency in Python, with practical experience developing backend applications and APIs using FastAPI.

Experience designing, maintaining, and optimizing ETL pipelines and data reconciliation workflows.

Solid knowledge of PostgreSQL, including database schema design, indexing, query optimization, and performance analysis.

Experience with large files and datasets, including efficient reading, writing, filtering, joining, deduplication, and aggregation.

Familiarity with AWS S3 for storing files and processing results.

Experience with AWS Athena and Amazon EKS, as specified in the role requirements.

Experience with artificial intelligence and its application in software development or technical solutions.

Understanding of caching strategies, server-side pagination, sorting, and performance optimization for applications handling large datasets.

Ability to design and maintain reliable, scalable systems that support demanding data processing workloads.

Differential technical experience: Hands-on experience tuning ETL pipelines and processing large volumes of data.

Differential technical experience: Advanced PostgreSQL optimization, including indexes, EXPLAIN, VACUUM, and ANALYZE.

Differential technical experience: Familiarity with job-oriented architecture patterns and queue-based processing.

Differential technical experience: Experience using Polars, pandas, or DuckDB for large-scale data processing.

Differential technical experience: Frontend development with React and TypeScript, including data grids, filters, and server-side pagination.

Strong analytical and problem-solving skills, with the ability to investigate performance bottlenecks and implement effective technical improvements.

Fully remote work: Work remotely from Brazil.

Meal allowance: Flash meal voucher of R$ 900 per month.

Health insurance: Bradesco health plan.

Dental insurance: Bradesco dental plan.

Postgraduate education support: Reimbursement of up to 30% of postgraduate tuition for the first 12 monthly payments, available after 12 months under contract.

Language assistance: Financial support for language learning.

Healthcare platform: Access to Clude Saúde for medical consultations.

Birthday benefits: A day off on your birthday, plus a gift.

Wellness benefit: Access to TotalPass.

Learning and development: Access to the Udemy learning platform.

Employee referral bonus: R$ 1,000 for each referred candidate who is hired.

Recognition program: Access to an internal recognition platform where accumulated merits can be exchanged for vouchers, including options such as iFood and Outback.