Remote Resident Solutions Architect - Spark & Databricks Expert

Role:<\/b> Senior Resident Solutions Architect (RSA) – Spark Expert
<\/p>Experience:<\/b> 5 – 10+ Years
<\/div>Location:<\/b> Remote
<\/div>Employment Type:<\/b> Full -time
<\/div>

Role Overview<\/b>
<\/h4>

We are seeking a Senior Data Solutions Consultant<\/b> with deep expertise in Apache Spark and Databricks<\/b>. This role requires a decisive, agentic -forward approach to problem -solving. You will independently lead complex customer engagements, bridging hands -on data engineering excellence with strategic technical leadership. As a trusted advisor, you will proactively build and implement solutions that unlock significant value for our customers.
<\/p>

Key Responsibilities<\/b>
<\/h4>

• Customer Leadership:<\/b> Lead engagements from discovery to delivery with full ownership and accountability.
  <\/p><\/li>

• Architecture & Optimization:<\/b> Architect, implement, and optimize large -scale Spark/Databricks workloads focusing on scalability and cost -efficiency.
  <\/p><\/li>

• Spark Expertise:<\/b> Apply expert -level Spark fundamentals to troubleshoot and tune distributed data jobs and SQL workloads.
  <\/p><\/li>

• Proactive Delivery:<\/b> Design and execute PoCs and workshops to demonstrate solution vision and inspire customer confidence.
  <\/p><\/li>

• Strategic Advocacy:<\/b> Act as a technical advocate for customers, anticipating issues and applying creative, data -driven solutions.
  <\/p><\/li>

• Cross -functional Partnership:<\/b> Collaborate with product and engineering teams to improve customer experience and platform features.
  <\/p><\/li>

• Mentorship:<\/b> Champion best practices in PySpark, Databricks, and Lakehouse design while mentoring junior engineers.
  <\/p><\/li><\/ul>

  Required Qualifications<\/b>
  <\/h4>

  • Experience:<\/b> 5–10 years in data engineering or analytics solution delivery.
    <\/p><\/li>

  • Databricks Mastery:<\/b> 3+ years of hands -on expertise, including job optimization, debugging, and workload governance.
    <\/p><\/li>

  • Technical Depth:<\/b> Deep understanding of Spark Internals<\/b>, PySpark, and Databricks SQL (DBSQL)<\/b> performance tuning.
    <\/p><\/li>

  • Modern Lakehouse:<\/b> Strong knowledge of Delta Lake, Structured Streaming, and cloud infrastructure.
    <\/p><\/li>

  • Autonomy:<\/b> Proven ability to identify and solve complex technical problems with minimal oversight.
    <\/p><\/li>

  • Communication:<\/b> Exceptional skills to simplify technical complexity for business leaders.
    <\/p><\/li><\/ul>

    Preferred Qualifications<\/b>
    <\/h4>

    • Certifications:<\/b> Databricks Certified Data Engineer Professional.
      <\/p><\/li>

    • Advanced Skills:<\/b> Experience with Delta Live Tables (DLT) and Unity Catalog (UC).
      <\/p><\/li>

    • Consulting Background:<\/b> Experience in large -scale data migration or AI -assisted analytics in enterprise environments.
      <\/p><\/li><\/ul>
      <\/div><\/span>