Talent.com
Big Data Lead
Big Data LeadVDart Inc • Philadelphia, PA, United States
Big Data Lead

Big Data Lead

VDart Inc • Philadelphia, PA, United States
12 hours ago
Job type
  • Full-time
  • Quick Apply
Job description

Role : Big Data lead (With Healthcare PAYER background)

Location : Philadelphia, PA

Mode of work : Hybrid (3 days / week) looking for resources in East coast

  • Looking for big data lead with Strong Hands on in Azure ADF, PySpark- with Healthcare Payer Domain Exp

Job Description :

  • Overall 14+ years of Azure & Data Engineering experience Design and develop cloud-native applications and services using modern architecture patterns. Collaborate with product managers, developers, and other stakeholders to define application requirements and specifications.
  • Strong hands-on experience in Database design, ETL with primary skills on Azure Databricks - Build data Pipelines using ADB - leveraging Python and PySpark, ADF : Azure Data Factory, Azure Data Lake Gen 2, Synapse Analytics.
  • Good experience and knowledge in scripting languages such as Python, PySpark, Spark SQL or Shell Scripting, etc. In-depth understanding of various storage services offered by Azure and TIDAL Scheduler.
  • Experience with implementation of data security, encryption, PII / PSI legislation, identity and access management across sources and environments.
  • Experience with data process Orchestration, end-to-end design and build process of Near-Real Time and Batch Data Pipelines.
  • Minimum 3 years of real project experience. Evaluate and recommend cloud technologies and tools to enhance application performance and reliability.
  • Lead the migration of existing applications to cloud environments, ensuring minimal disruption and optimal performance. Implement best practices for cloud security, compliance, and governance. Monitor and optimize application performance, scalability, and cost-efficiency in cloud environments.
  • Provide technical leadership and mentorship to development teams, fostering a culture of innovation and continuous improvement.
  • Stay current with emerging cloud technologies and trends and assess their potential impact on our architecture and applications.
  • Provide Technical Assistance, Problem Resolution and Troubleshooting Support.
  • Create a job alert for this search

    Data Lead • Philadelphia, PA, United States

    Related jobs
    Big Data / Hadoop Developers-Philadelphia, PA

    Big Data / Hadoop Developers-Philadelphia, PA

    Staffing the Universe • Philadelphia, PA, United States
    Full-time
    Interview Mode : Skype Preferred Only.Green Card, US Citizen and GC EAD H1B Transfer Accepted.Job Description : As a Big Data developer you will be part of a newly created Enterprise Business Intelli...Show more
    Last updated: 2 days ago • Promoted
    Director, Data and Analytics

    Director, Data and Analytics

    Digitas Health • Philadelphia, PA, US
    Full-time
    Digitas Health is the Agency of Now : the first global connected-health agency, purpose-built for marketing today.Digitas Health specializes in helping health brands navigate a complex and shifting ...Show more
    Last updated: 5 days ago • Promoted
    Senior Account Director, Syndicated Data & AI

    Senior Account Director, Syndicated Data & AI

    HealthVerity • Philadelphia, PA, US
    Full-time +1
    Senior Account Director, Syndicated Data & AI.We're seeking candidates based in the Tri-State area who are available to work from our Philadelphia office up to one day per week.Are you a proactive,...Show more
    Last updated: 30+ days ago • Promoted
    AWS Big Data Architect

    AWS Big Data Architect

    Resource Informatics Group Inc • King of Prussia, PA, US
    Full-time
    Greetings from Resource Informatic Group!.We are urgently looking for a “AWS Big Data Architect” in King of Prussia, PA.JD & send me the matching profiles : .Role &nb...Show more
    Last updated: 30+ days ago • Promoted
    Lead Databricks Data Engineer

    Lead Databricks Data Engineer

    eTeam Inc • Philadelphia, Pennsylvania, United States
    Full-time
    Quick Apply
    We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical leader, you will lever...Show more
    Last updated: 30+ days ago
    Senior Big Data Engineer

    Senior Big Data Engineer

    Highmark Health • Trenton, NJ, United States
    Full-time
    This job is responsible for designing and engineering data solutions for the enterprise and, working closely with business, analytic and IT stakeholders, assists with the development and maintenanc...Show more
    Last updated: 2 days ago • Promoted
    Big Data / Hadoop Developers WITH SCALA - Philadelphia, PA

    Big Data / Hadoop Developers WITH SCALA - Philadelphia, PA

    Staffing the Universe • Philadelphia, PA, United States
    Full-time
    Big Data / Hadoop Developers With Scala.Interview Process : Phone followed by Webex.S Citizens Scope As A Big Data Developer You Will Be Part Of A Newly Created Ent.Show more
    Last updated: 2 days ago • Promoted
    Director, Data Governance

    Director, Data Governance

    Kobie Marketing • Philadelphia, PA, US
    Full-time
    Named a Top Workplace in the USA and Top Remote Workplace, Kobie is where the best minds in loyalty come together, driven by passion and innovation. We’re always looking for talented individua...Show more
    Last updated: 19 days ago • Promoted
    Big data Lead - Pennington NJ

    Big data Lead - Pennington NJ

    Staffing the Universe • Pennington, NJ, United States
    Full-time
    US Citizen, Green Card, TN, GC EAD and H4 EAD only.No third-party agencies corp to corp.Job Description : Big Data Architect Hadoop, Hive, Scala, PySPark. Airflow and Kafka experience preferred.Cloud...Show more
    Last updated: 7 hours ago • Promoted • New!
    Technology Lead - Data Governance

    Technology Lead - Data Governance

    AmerisourceBergen Corporation (Cencora) • Chesterbrook, PA, United States
    Full-time
    Our team members are at the heart of everything we do.At Cencora, we are united in our responsibility to create healthier futures, and every person here is essential to us being able to deliver on ...Show more
    Last updated: 13 days ago • Promoted
    Side gig : Earn at least $2310 in your first 192 trips driving, guaranteed.

    Side gig : Earn at least $2310 in your first 192 trips driving, guaranteed.

    Uber • Ivyland, PA, US
    Full-time +1
    Earn at least $2310 driving with Uber when you complete your first 192 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, pa...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer - King Of Prussia, PA

    Senior Data Engineer - King Of Prussia, PA

    QTech • King of Prussia, PA, United States
    Full-time
    Quick Apply
    Job Title : Senior Data Engineer Location : King Of Prussia, PA Need Locals only] Looking for W2 Candidates.No C2C &...Show more
    Last updated: 4 days ago
    Quick Earnings : Earn At Least $2310 For Your First 192 Trips, Guaranteed.

    Quick Earnings : Earn At Least $2310 For Your First 192 Trips, Guaranteed.

    Uber • Lansdale, PA, US
    Full-time +1
    Earn at least $2310 driving with Uber when you complete your first 192 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, pa...Show more
    Last updated: 2 days ago • Promoted
    Technology Lead - Data Governance

    Technology Lead - Data Governance

    AmerisourceBergen Corporation • Wayne, PA, United States
    Full-time
    Our team members are at the heart of everything we do.At Cencora, we are united in our responsibility to create healthier futures, and every person here is essential to us being able to deliver on ...Show more
    Last updated: 4 days ago • Promoted
    Bigdata Lead - Pennington, NJ

    Bigdata Lead - Pennington, NJ

    Staffing the Universe • Pennington, NJ, United States
    Full-time
    Skills : Big Data Architect Hadoop, Hive, Scala, PySPark.Airflow and Kafka experience preferred.Hive, PySpark, Python, Impala, Hadoop architecture, SQL, Kudu.Show more
    Last updated: 2 days ago • Promoted
    Sr. Director, Data & Analytics

    Sr. Director, Data & Analytics

    Pennsylvania Staffing • Philadelphia, PA, US
    Full-time
    Senior Director, Data & Analytics.Comcast brings together the best in media and technology.We drive innovation to create the world's best entertainment and online experiences.As a Fortune 50 leader...Show more
    Last updated: 5 days ago • Promoted
    Bigdata Lead

    Bigdata Lead

    Artech • Mt Laurel, NJ, United States
    Full-time
    Lead In Information Technology.We are seeking a highly skilled and motivated individual to join our team as a Lead in Information Technology. This role is located in Mount Laurel and offers a dynami...Show more
    Last updated: 2 days ago • Promoted
    Manager, Data and Analytics

    Manager, Data and Analytics

    Digitas Health • Philadelphia, PA, US
    Temporary
    Digitas Health is the Agency of Now : the first global connected-health agency, purpose-built for marketing today.Digitas Health specializes in helping health brands navigate a complex and shifting ...Show more
    Last updated: 30+ days ago • Promoted