Senior Data Engineer_only on W2

Senior Data Engineer_only on W2_10+years exp

Required Skills & Experience

Expert-level Python programming with strong data engineering background.

Hands-on experience with Apache Iceberg (PyIceberg / Polaris).

Proficiency with Pandas , PyArrow , DuckDB , and Parquet .

Deep understanding of data lake architectures and columnar storage .

Strong experience with ETL design , batch processing , and schema evolution .

Cloud experience with Azure Data Lake Storage (Gen2) or similar systems.

Familiarity with containerized environments (Docker, VS Code / Cursor, Azure pipelines).

Preferred Qualifications

Experience integrating data workflows with FastAPI or Flask .

Background in data governance , metadata management , and schema evolution .

Exposure to Snowflake , Sigma Computing , and distributed processing frameworks (Spark, Flink).