Software Engineering _Data Engineer

Job title : Data Engineer with Meta project experience

Remote role

Duration 6-12+ months

Pay rate : 60-65 / hr on W2 or 70- / 5 / hr on c2C

The CWs will support efforts to perform data mitigations on large scale datasets (image, video, text) leveraged by FAIR research teams. The goal is to proactively mitigate potential risks associated with these datasets.

Job Responsibilities :

Preprocessing : converting original datasets into a format that can be consumed by mitigation pipelines.

Filtering : running filtering using Integrity's pipeline.

Post-processing : consuming filtering results to filter in the original datasets, repackaging, and re-ingestion.

Optimization : identify optimization opportunities and improve the process.

Skills :

Software engineering skills include writing scripts to automate file processing and data transferring, and creating tools to improve productivity and streamline workflows.

Data Management : Data pipeline building. Data processing and cleaning, transformation and formatting, data quality control and validation

Communication - effective communication skills to collaborate with stakeholders and team members

Must-Have Skills

• 4+ years' experience in Python.
• Some data management experience, e.g. SQL, process large data.
• Able to be flexible and work well in different environments with varying tasks and responsibilities
• Background in AI building tools
• Former Meta high preferred
• 4+ years' experience.

Education / Experience :

Strongly prefer CWs with prior experience at Meta (full 2 years preferred), as this would enable them to leverage their existing knowledge of Meta's internal tools and processes, facilitating a faster onboarding process and more effective contribution to the FAIR mitigation efforts.