Databricks Engineer/ Architect in India at Jobgether
Explore Related Opportunities
Job Description
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Databricks Engineer/Architect based in India.
This role offers the opportunity to join a high-impact data transformation initiative focused on stabilizing and scaling an already production-live Databricks environment. You will work on enhancing data pipelines that support critical business reporting and analytics, ensuring they are robust, efficient, and production-ready. The environment is fast-paced and evolving, requiring strong technical depth combined with a pragmatic, delivery-focused mindset. You will play a key role in transforming an existing data platform into a reliable, scalable ecosystem that delivers consistent business value. The position involves close collaboration with cross-functional teams to improve data flow, performance, and overall platform maturity. This is an ideal opportunity for someone who thrives in complex environments where systems are already built but require optimization and stabilization. Your contributions will directly impact platform reliability, scalability, and business decision-making.
- Design, build, and stabilize Databricks-based data pipelines supporting end-to-end data workflows from ingestion to reporting.
- Optimize existing pipelines to improve performance, scalability, cost efficiency, and reliability in production environments.
- Develop and support reporting and data visualization solutions in collaboration with BI teams.
- Implement best practices for data engineering, architecture, and Databricks platform usage across workflows.
- Identify, troubleshoot, and resolve performance bottlenecks, data quality issues, and system inefficiencies.
- Enhance and standardize an evolving Databricks environment to ensure consistency and maintainability.
- Collaborate with cross-functional teams to improve data platform stability and maximize business value delivery.
- Contribute to the design and improvement of scalable data workflows and architecture patterns.
- Support continuous improvement of platform operations, including monitoring, tuning, and optimization.
- Strong hands-on experience with Databricks (mandatory).
- Proven experience in designing and building data pipelines (ETL/ELT).
- Solid understanding of data engineering principles and modern data architecture.
- Experience working with large-scale distributed data processing systems.
- Exposure to BI/reporting tools such as Power BI, Tableau, or similar platforms.
- Strong problem-solving skills with the ability to work in fast-paced, evolving environments.
- Ability to operate independently with minimal guidance in partially built or unstable systems.
- Familiarity with Apache Spark (PySpark or Scala) is highly desirable.
- Experience with cloud platforms such as AWS, Azure, or GCP is a plus.
- Knowledge of performance tuning, cost optimization, and Databricks best practices.
- Exposure to data governance, security, and production-grade data operations.
- Competitive salary aligned with experience and industry standards
- Opportunity to work on a large-scale Databricks transformation program
- High-impact role with direct influence on platform stability and business outcomes
- Remote or flexible working arrangements depending on project needs
- Exposure to modern data engineering, cloud, and analytics ecosystems
- Career growth in advanced data architecture and engineering domains
- Opportunity to work in a fast-paced, technically challenging environment
- Collaborative, impact-driven team culture focused on delivery excellence