Title: Sr Big Data Engineer
Location: Fort Worth, TX
Note: Please don't submit any profiles without Databricks experience.
Job Description
The big data and predictive analytics team is seeking an individual to standardize and automate open source processes and functions. Primarily, this position will focus on automating quality assurance, testing, and provisioning processes. Extended areas of concentration will be creating end user applications intended to expedite and automate data acquisition, integration, and control processes.
Duties/Responsibilities:
- Responsible for identifying and designing automation opportunities
- Databricks is must for this position.
- Build a working knowledge of all existing operational analytics and data pipeline methods and functionality
- Create effective and automated processes to drive efficiency and consistency across all areas of big data and advanced analytics projects
- Work closely with peers and leadership within Technology Services to develop an automation framework
- Create an infrastructure to support continued growth in the open source environment
Basic Qualifications:
- 8-10 Years of experience in SQL queries and working with NoSQL, RDBMS
- Bachelor¿s in Business, Information Technology, Computer Science, Economics or other related discipline or equivalent work related experience
- Apache Hadoop software library knowledge
- Proficient with automation tools and framework design
- Experience in automation scripting and web application development
- Strong personal and organizational skills to execute project deliverables
- Excellent verbal and written communication skills to lead a cross functional team
- Preferred Qualifications:
- MBA or equivalent degree
- Working knowledge of Hortonworks 2.3 or greater
- Experience in using Java, pySpark, Python, Scala, Spark, Shell script, Spark with Python, Spark streaming and SQL.
- Background in ETL and data warehousing
- Sqoop, Hive and Big data concepts.
- Shell scripting
- ADF, Azure databricks , ADLS is good to have
Sr Big Data Engineer • Fort Worth, TX, Texas, USA
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own ... Show more
A data solutions firm in Fort Worth is on the lookout for a Data Architect who will be responsible for designing robust data and information systems to meet the needs of the organization.The succes... Show more
A leading real estate services firm is seeking a Chief Engineer in Roanoke, TX to oversee data center operations.The ideal candidate will have over 15 years of relevant experience and a proven trac... Show more
DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day.As a Dasher, you’ll stay busy with a variety o... Show more
Data Scientist Job Duties: Formulates and leads guided, multifaceted analytic studies again... Show more
Outlier helps the world’s most innovative companies improve their AI agents by providing human feedback.We collaborate with leading AI organizations to train Large Language Models (LLMs) to functio... Show more
We are looking for a passionate individual with a sense of responsibility and willingness to help create families to join us as a surrogate.In this role, you will be instrumental in supporting indi... Show more
Data Engineer Westlake TX, W2 position Team: Team support data analytics for FIA - responsible for getting the snowflake.Looking for 8-10 years of experience.Top Skills: Snowflake - data migration ... Show more
Outlier helps the world’s most innovative companies improve their AI agents by providing human feedback.We collaborate with leading AI organizations to train Large Language Models (LLMs) to functio... Show more
JLL empowers you to shape a brighter way.Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology for our clients.We are... Show more
Sr MLE/ML Ops- Pod Lead (FedGov Clients).GGI) – A Service-Disabled Veteran-Owned Small Business (SDVOSB) driving AI/ML innovation for commercial and federal clients.Through GGAI (Fed/Gov) LLC, we d... Show more
Charles Schwab is searching for an experienced data architect based in Westlake, TX.This role requires over 15 years in data management with expertise in enterprise architecture, cloud platforms, a... Show more
As the job of privacy moves beyond law, policy, and compliance and into operations and the actualization of information technology, we are seeking a driven and highly motivated Data Privacy Enginee... Show more
Position - Data Engineer</b></p> <div> <p><b>Location - Skyview 8 Fort Worth Texas USA 76155</b></p> </div> <div> <p><b>Note - Inte... Show more
Driving with Uber is an alternative to a part-time or full-time job and can get you earning cash on the road quickly.Driving with Uber allows you to earn quick cash while maintaining the flexibilit... Show more
Dexian is searching for a Cloud Database Architect to provide technical leadership and guide cloud-native solutions in Westlake, TX.The ideal candidate will have over 12 years of experience in dist... Show more
Clinical Data Coordinator Job Duties: Support laboratory data management procedures including authoring and reviewi... Show more
Note: Fidelity will not provide immigration sponsorship for this position.In this leadership role, you will drive the Data Architecture and Data platform modernization for the Workplace Investing d... Show more
