Databricks Engineer

Position : - Databricks Engineer ,

Location : - O Fallon, MO / Seattle - WA – Onsite ,

Client : - TCS ,

Duration : - Full Time Position,

Job Description : -

Experience Required - 8+ Years

Must Have Technical / Functional Skills

• Tenured in the fields of Computer Science / Engineering or Software Engineering.
• Bachelor's degree in computer science, or a related technical field including programming with 15+ years of demonstrated experience in software development and delivery.
• Deep hands-on experience with Databricks and Python.
• Spark and SQL Expertise : Writing performant Spark SQL and PySpark transformations. Optimizing joins, window functions, and aggregations. Handling large-scale data with partitioning and caching strategies
• Experience with real-time data processing and streaming pipelines.
• Proficient in both Delta Live Tables (DLT) and Workflows – Understanding of Lakeflow Declarative Pipelines is an asset.
• DevOps and CI / CD - Using Databricks Asset Bundles (DABs) for deployment - Integrating with Git, Bitbucket, and Jenkins for version control and automation
• Proven track record using dbt for building robust, testable data transformation workflows following TDD.
• Strong grasp of cloud-based database infrastructure (AWS, Azure, or GCP).
• Skilled in developing insightful dashboards and scalable data models using Power BI.
• Expert in SQL development and performance optimization.
• Demonstrated success in building and maintaining data observability tools and frameworks.
• Proven ability to plan and execute deployments, upgrades, and migrations with minimal disruption to operations.

Roles & Responsibilities : -