Lead Data Engineer – Palantir & PySpark

Job Title :   Lead Data Engineer Palantir & PySpark

Location : Remote

Job Summary :

We are seeking a highly skilled Data Engineer with hands-on experience in Palantir (Foundry preferred) PySpark and exposure to reinsurance or insurance data environments. The ideal candidate will play a key role in building scalable data pipelines optimizing ETL workflows and enabling advanced analytics and reporting capabilities. This role requires a strong technical foundation in data engineering combined with an understanding of the reinsurance business domain.

Key Responsibilities :

• Design develop and maintain data pipelines and ETL workflows using PySpark SQL and Palantir Foundry.
• Collaborate with data architects business analysts and actuarial teams to understand reinsurance data models and transform complex datasets into usable formats.
• Build and optimize data ingestion transformation and validation processes to support analytical and reporting use cases.
• Work within the Palantir Foundry platform to design robust workflows manage datasets and ensure efficient data lineage and governance.
• Ensure data security compliance and governance in line with industry and client standards.
• Identify opportunities for automation and process improvement across data systems and integrations.

Required Skills & Qualifications :

Preferred Skills :

Thanks

Afrah Faiza

Arthur Grand Technologies Inc

Arthur Grand Technologies is an Equal Opportunity Employer (including disability / vets)

Additional Information :

All your information will be kept confidential according to EEO guidelines.

Remote Work : Yes

Employment Type : Contract

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Experience : years

Vacancy : 1