Principal Engineer, Data
At Verint, we believe customer engagement is the core of every global brand. Our mission is to help organizations elevate Customer Experience (CX) and increase workforce productivity by delivering CX Automation.
We hire innovators with the passion, creativity, and drive to answer constantly shifting market challenges and deliver impactful results for our customers.
Our commitment to attracting and retaining a talented, diverse, and engaged team creates a collaborative environment that openly celebrates all cultures and affords personal and professional growth opportunities.
Learn more at www.verint.com .
Overview of Job Function :
The Principal Data Engineer will be a part of Big Data team and responsible for developing batch or event-driven data pipelines in the cloud (AWS) while improving the reliability, security, resilience, and performance of the Big Data pipeline.
The Principal Engineer will bring knowledge of software development using Java and Spark technologies and contribute to daily operations including CI / CD.
Principal Duties and Essential Responsibilities :
Design and develop overall data architecture to ensure the effective storage, retrieval, and analysis of large-scale data sets
Build and maintain scalable data pipelines for ingesting, processing, and transforming data from various sources into our data warehouse or data lake.
Ensure data quality and data consistency throughout the pipeline
Optimize data storage, retrieval, and processing performance through indexing, partitioning, and caching techniques
Evaluate and select appropriate technologies, tools, and platforms for data processing
Improve availability and reliability of data streaming pipeline
Evaluate the scalability of data architecture to accommodate future growth and changing business needs
Develop build and deployment automation for microservices using CI / CD
Essential Requirements :
Bachelor's degree in Computer Science, Engineering or related field
8+ years developing backend services with Java / Scala / Python
Strong modern data store knowledge including traditional data warehouse and data lake
Experience on solution design with microservices dealing large scale datasets
Experience in automating operational tasks through development and coding.
Hands-on experience using Maven, Jenkins, Git, JUnit
5+ years working experience using cloud services in AWS or other cloud provider
Excellent communication skill
Preferred Requirements :
Knowledge of Spark (java, Scala)
Knowledge of Databrick
Hands-on experience with Docker and Kubernetes
Experience working in cloud environments : AWS and / or Azure
Familiarity with performance monitoring using Datadog
Understanding of asynchronous Java programming
LI-KD1
MIN : $135K
MAX : $190K
Senior Data Engineer - Principal Associate (Spark, Scala)
Senior Data Engineer - Principal Associate (Spark, Scala). As a Capital One Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One. Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Clo...
Principal Associate, Data Loss Prevention (DLP) Engineer
Principal Associate, Data Loss Prevention (DLP) Engineer. Capital One is hiring a technical Cyber Security professional to join the Data Loss Prevention (DLP) team and work with the line of business stakeholders building DLP system policies/ruleset based on ongoing regulatory requirements and analy...
Principal Engineer, Data
The Principal Data Engineer will be a part of Big Data team and responsible for developing batch or event-driven data pipelines in the cloud (AWS) while improving the reliability, security, resilience, and performance of the Big Data pipeline. Build and maintain scalable data pipelines for ingesting...
Senior Software Engineer
The Senior Software Engineer will work on the within the Technology Group to expand, enhance and strengthen our technology platform to amplify the Company's competitive advantage in the market. The Senior Software Engineer works within an Agile team environment. Strong background in object-oriented ...
Senior Software Engineer - Digital Workplace
As a Senior Web Engineer at Canonical, you need an analytical, data-driven mind and a passion to connect and make sense of interesting data from APIs. Our Workplace Engineering team are a highly performant group which specialises in web architecture and analytics specialists. It's part of our en...
Senior Embedded Software Engineer
Collaborate closely with cross-functional teams including software engineers, hardware engineers, and data scientists to achieve project objectives and deliver high-quality solutions on schedule. Collaborate with hardware engineers to integrate embedded software with various hardware components such...
Mechanical Engineer II
Education/Experience Bachelor degree in engineering required 2-4 years experience required Responsibility level Exercises moderate independent judgment with direction from supervisor Skills Creativity, verbal and written communication skills, analytical and problem solving ability (Required)o Team p...
Data Architect/Business Intelligence Engineer
Create and optimize data models and architecture within Azure Data Lake, ensuring efficient data organization and storage for analytical purposes. Design, implement, and maintain efficient and scalable data pipelines and ETL processes using Azure Data Factory or similar tools for data ingestion, tra...
Data Management - Quality Assurance Analyst IV
Ability to automate test scripts for a data management platform supporting ETL, MDM, data quality and business intelligence. Ability to perform functional and non-functional testing for platform supporting ETL, MDM, data quality and business intelligence – 1 year. Compile and analyze statistical dat...
Software Engineer
A passionate team of data architects, data scientists, data engineers, and data analysts, Snow Fox Data empowers you to make a difference with data. Snow Fox Data is a premier data strategy, data science, and analytics solutions provider. Whether your organization needs a better data strategy, impro...