Big Data Engineer
JOB REQUIREMENTS : Fetch Rewards, Inc. seeks a Big Data Engineer based in Madison, Wisconsin. The job duties for the Big Data Engineer position include : Model and tune real-time database (Redis, Pinot, Hudi, Iceberg, RDS, etc.
and query performance utilizing best practices. Enable all stakeholders to be able to access and use endless amounts of data that come from an ever-growing variety of data sources using tools like Kafka, Trino, Pinot, Grafana, custom solutions, and easy-to-understand documentations.
Lead data documentation and data discovery initiatives using Lucid chart, Miro, and DataHub. Deploy scalable Kubernetes infrastructure to host applications using Docker, Kubernetes, Helm, Argo, AWS EKS, ECR, etc.
Build performant and scalable pipelines to quickly move data from backend to data lake using Kafka, Flink, S3, Hudi, Iceberg, Argo, Airflow, Spark and Terraform.
Monitor and maintain alerting and telemetry around pipeline tooling to ensure data gaps are addressed as quickly as possible using tools like Grafana, Pager Duty, Prometheus, and custom scripts.
Write applications to quickly encrypt and obfuscate data in real time using Kafka Connect, and AWS KMS, and custom scripts.
Design data transformation patterns to improve transparency and usability of data using Flink SQL, Trino, and Pinot. Stand up highly available and performant real-time OLAP datastores to ingest streams using tools like Pinot, Hudi, and Iceberg.
Establish technical standards and norms for real-time data ingestion, aggregation, monitoring, and data contract. Work closely with other technical leads to develop and staff cross-guild initiatives with teams from Fetch 's other specialized technical departments.
To apply : send resume to [email protected]. Please reference job title when applying. OTHER EXPERIENCE AND QUALIFICATIONS : Minimum requirements : Master 's degree in Computer Science, Business Intelligence & Analytics, Data Science, or a related field plus 2 years of experience with handling, modeling, and moving data.
In addition, the following specific skills are required : 2 years of experience reading, writing, debugging and deploying code in Python and Java.
2 years of experience with moving high volume and high throughput data (terabyte / day with 1,000 events / s) with tools like Kafka or Kinesis.
2 years of experience translating business requirements into technical criteria and scope. 1 year of experience building and interacting with real-time OLAP data stores and their associated infrastructure such as HDFS, Hudi, InfluxDB, and Pinot.
APPLICATION INSTRUCTIONS : E-Mail a Rsum : [email protected]
Big Data Engineer
The job duties for the Big Data Engineer position include: Model and tune real-time database (Redis, Pinot, Hudi, Iceberg, RDS, etc. Big Data Engineer based in Madison, Wisconsin. Lead data documentation and data discovery initiatives using Lucid chart, Miro, and DataHub. Enable all stakeholders to ...
Senior Underwriting Data Analyst
Senior Underwriting Data Analyst. Develop advanced data and reporting solutions utilizing intelligence applications to provide dashboards, data marts, query tools, and ad hoc reporting. Retrieve and manipulate data from multiple data sources using current tools and software, such as SAS EG, SAS VA, ...
Embedded Software Engineer
A Bachelor Degree in engineering, science, or closely related discipline is desired. Detailed understanding of multiple programming languages (assembler/C/C++11/Java/Python) to develop and evolve software systems optimally. Wide breadth and deep understanding of development of medical device softwar...
Data Architect/Business Intelligence Engineer
Create and optimize data models and architecture within Azure Data Lake, ensuring efficient data organization and storage for analytical purposes. Design, implement, and maintain efficient and scalable data pipelines and ETL processes using Azure Data Factory or similar tools for data ingestion, tra...
Software Engineer
A passionate team of data architects, data scientists, data engineers, and data analysts, Snow Fox Data empowers you to make a difference with data. Snow Fox Data is a premier data strategy, data science, and analytics solutions provider. Whether your organization needs a better data strategy, impro...
Software Developer - AI Trainer (Contract)
We are looking for proficient programmers to join our team to train our AI chatbots to code.You will work with the chatbots that we are building in order to measure their progress, as well as write and evaluate code.Qualifications, skills, and all relevant experience needed for this role can be foun...
Software Developer - Creative
CreativeCorporate Headquarters12575 Uline Drive, Pleasant Prairie, WI 53158Do you have a passion for graphic design? In this Software Developer role, you will craft custom solutions to support Uline's award-winning Creative department. ...
Data Analyst I - Intern
Nelnet is looking for a talented and motivated intern to assist with a diverse set of data and analysis projects. This will be a hands-on opportunity to quickly build experience working with data, generating value-add reporting, conducting analyses, and interacting with clients and internal stakehol...
Data Scientist
We are looking for a Data Scientist who will support our product, sales, leadership, and marketing teams with insights gained from analyzing company data. They must have strong experience using a variety of data mining/data analysis methods, using a variety of data tools, building and implementing m...
Senior Software Engineer - Embedded & Desktop Linux Optimisation
Canonical is a growing international software company that works with the open-source community to deliver Ubuntu, "the world's best free software platform". Our teams partner with specialist engineers from major silicon companies to integrate next-generation features and performance e...