SUMMARY STATEMENT
The Data Engineer works within a cross-functional project team and is responsible for automating and productizing advanced analytics pipelines. S / he will work with a variety of technologies, including Generative AI, and our proprietary big graph analysis framework.
WHAT YOU'LL DO
A Data Engineer's responsibility is to implement and deploy data analysis pipelines at various clients of Lynx Analytics. This includes participating in :
- Understanding deeply the business problem that we are trying to solve by our analytical solutions
- Through continuous consultations with employees of our client, discover the client's existing data sources that are relevant to the problem we try to solve. This includes discussions with client's IT teams, data owners, future business owners etc.
- Working together with the client's IT teams to define the technical architecture for the analytical solution that we are to deploy
- Implement the data ingestion subsystem : This is the system responsible for moving all the necessary data sources to a single location where the actual analysis will happen
- Implement the data analysis pipelines
- Integrate the results into business UIs developed by Lynx or pre-existing client software systems
SKILLS AND EXPERIENCE
Skills You Should Have :
Python (pytest, pre-commit, venv, etc.)Airflow, dbt, or other orchestration toolApache Spark, PostgreSQL, BigQuery, or other SQL / NoSQL enginesDocker, Docker Compose, Terraform or other IaC toolsLinux OSOne of major cloud platforms like GCP, AWS, or AzureWhat You Might Also Work With :
CI / CD tools like GitHub ActionsFastAPI or Flask for service endpointsNetwork setup (DNS, TLS, SSH, IP routes, etc.)You Might Be a Fit If You :
Are a generalist who thrives in ambiguity and loves figuring things out.Enjoy breaking down big, vague, and unfamiliar problems into concrete actions.Value pragmatism over perfection : you look for MVPs, iterative delivery, and quick feedback loops.View that DevOps isn't someone else's job-you're comfortable setting up pipelines, fixing flaky builds, or tweaking a reverse proxy config.Are comfortable switching hats quickly-from setting up data pipelines and crawling websites to tuning SQL queries or debugging backend servers.Are passionate about learning and applying unfamiliar technologies and tools.Have some prior experience in Generative AI (ideally RAG) and data science / analytics.Get excited about opportunities to travel and work abroad!Why You'll Love It Here :
High ownership, zero micromanagementRapid learning opportunities and diverse challengesFlexible work hours, remote-friendly setupA collaborative, culture that values real outcomesFlat organisational hierarchy with high visibility and accessibility to our leaders