Data Pipeline Engineer IV

Data Engineer - Mobile Cloud ServiceLocation : Mountain View, CAGeneral Description : The Cloud services group is looking for world class engineers to join our technology innovation group focused on the rapid development of cloud based end-to-end mobile applications and services.This is a great opportunity for a talented Data Engineer to step up to the next level and build secure cloud services for users of the world's best-selling mobile devices. The Knox Cloud Team is focused on productizing research projects and supporting their corresponding cloud-based service platforms and infrastructure. Position Summary : Looking for world class server software engineers with Big Data Infrastructure and Data warehousing experience to join our technology innovation group focused on the rapid development of AI driven cloud based end-to-end mobile applications and services. Responsibilities Include :

• Implement, maintain and evolve big data platform and infrastructure
• Responsible for designing, implementing and maintaining backend REST API Services and ETL processes for Predictive Data Modeling, Machine Learning, Personalization, Recommendation, and Business Intelligence system
• Perform extensive research and analysis to make optimal architecture and design decisions
• Write large amounts of code, perform code reviews, write unit tests and documentation
• Interface with other groups including Product Management, QA and Operations
• Create quick proof-of-concept prototypes
• Work in a scrum team with ML & Cloud EngineersRequirements :
• Minimum of 3 years of Hand-on experience in Big Data technologies like Apache Iceberg, Spark, Spark ML, & Kafka
• Strong skills in statistical analysis : correlation analysis, regression analysis, univariate and multivariate analysis
• Strong skills in algorithms, Data structures, UNIX / Linux, Scripting, Machine Learning (especially classification and unsupervised clustering), Data Modeling, Data warehousing, and Networking
• Hands-on experience in building REST API's
• Team player with strong communication skills and ability to mentor ML & Cloud engineers in areas of Data Engineering
• Desire to learn fast and pick up latest and greatest technologies
• MS in Computer Science or equivalent experience Preferred :
• Programming Language : Python
• Preferred 7+ years of experience in Big Data Technologies : AWS EMR, Iceberg, Spark, Kafka, & YARN
• Machine Learning : PyTorch, TensorFlow, Spark ML
• REST API : Flask, FastAPI, or Django
• Data Quality tools such as Monte Carlo, Great Expectations, or Databand
• Experience with teams using MLflow