Databricks Architect

We are a technology-led healthcare solutions provider. We are driven by our purpose to enable healthcare organizations to be future-ready. We offer accelerated, global growth opportunities for talent that is bold, industrious and nimble. With Indegene, you gain a unique career experience that celebrates entrepreneurship and is guided by passion, innovation, collaboration and empathy. To explore exciting opportunities at the convergence of healthcare and technology, check out

What if we told you that you can move to an exciting role in an entrepreneurial organization without the usual risks associated with it?

We understand that you are looking for growth and variety in your career at this point and we would love you to join us in our journey and grow with us. At Indegene, our roles come with the excitement you require at this stage of your career with the reliability you seek. We hire the best and trust them from day 1 to deliver global impact, handle teams and be responsible for the outcomes while our leaders support and mentor you.

If this excites you, then apply below.

Role : Databricks Architect

Description

The Databricks Architect - Lead is a critical role within our Data and Analytics practice, tasked with designing, implementing, and optimizing advanced data architectures using Databricks. This role involves close collaboration with data scientists, analysts, and business stakeholders to deliver scalable, secure, and efficient data solutions that align with organizational goals. The ideal candidate will bring deep expertise in Databricks, Apache Spark, and cloud platforms, with a proven ability to lead complex data architecture initiatives.

In this role, you will architect data lakes, data warehouses, and real-time processing systems, optimize Databricks clusters for performance and cost, and develop robust ETL / ELT pipelines. You will also ensure data governance and compliance, integrate Databricks with cloud ecosystems, and stay ahead of industry trends to drive innovation. Reporting to the Director of Data Architecture, you will play a key role in shaping our data strategy and delivering business value.

Responsibilities

• Architecture Design
• Design and maintain scalable data architectures using Databricks, including data lakes, data warehouses, and real-time processing systems.
• Create detailed blueprints for data processes and flows, ensuring alignment with business objectives and technical requirements.
• Cluster Management
• Configure, manage, and optimize Databricks clusters to achieve high performance and cost efficiency.
• Implement best practices for cluster management, including autoscaling, cluster policies, and performance tuning.
• Pipeline Development
• Develop and implement ETL / ELT pipelines using Databricks and Apache Spark to handle large-scale data processing.
• Ensure pipelines are efficient, scalable, and meet performance and reliability standards.
• Data Governance
• Enforce data governance policies, security measures, and compliance standards within the Databricks environment.
• Leverage tools like Unity Catalog to manage data governance and implement IAM roles, VPCs, and encryption protocols.
• Collaboration
• Partner with data scientists, analysts, and business stakeholders to understand data needs and deliver impactful solutions.
• Communicate complex technical concepts clearly to diverse audiences, fostering alignment and collaboration.
• Integration
• Integrate Databricks with cloud services such as AWS S3, Azure Data Lake Storage, or Google Cloud Storage to build a cohesive data ecosystem.
• Ensure seamless data flow and interoperability with existing systems and tools.
• Innovation
• Stay updated on the latest advancements in Databricks, Delta Lake, Databricks SQL, and related technologies.
• Apply industry best practices to enhance data capabilities and drive continuous improvement.

About You (Desired Profile)

EQUAL OPPORTUNITY

Indegene is proud to be an Equal Employment Employer and is committed to the culture of Inclusion and Diversity. We do not discriminate on the basis of race, religion, sex, colour, age, national origin, pregnancy, sexual orientation, physical ability, or any other characteristics. All employment decisions, from hiring to separation, will be based on business requirements, the candidate’s merit and qualification. We are an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, national origin, gender identity, sexual orientation, disability status, protected veteran status, or any other characteristics.