Create and manage Azure Databricks workspaces, Unity Catalog setupallocating resources and configuring settings based on specific needs for allenvironments (Dev / Test / Prod).
- Design and implement access control mechanisms, userpermissions, and security policies to safeguard sensitive data. : 6 to 10yesr expereince
- Configure and launch Databricks clusters, optimizingperformance and cost through effective instance typeselection, auto-scaling, and termination policies.
- Monitor cluster health and performance, troubleshoot issuesproactively, and adjust configurations as necessary.
- Install and configure libraries, dependencies, andenvironment variables essential for data engineering and analytics tasks.
- Implement robust security practices, including networksecurity settings, integration with Azure Active Directory, and dataencryption.
- Stay informed about security best practices andupdates, applying them proactively to maintain a secure environment.
- Monitor resource utilization and costs associated with Databricksusage, identifying opportunities for optimization and cost reduction.
- Analyze cluster performance metrics and implement tuningstrategies to ensure optimal query execution times and resource utilization.
- Track system logs and identify potential issues before they impactusers or operations.
- Collaborate with data engineers, data scientists, andother stakeholders to understand their analytics needs and translate them intoeffective configurations.
- Provide technical support to users, troubleshooting issuesand resolving technical inquiries.
- Document setup processes, configurations, andtroubleshooting steps for future reference and knowledge sharing
Azure Databricks admin
Create and manage Azure Databricks workspaces, Unity Catalog setupallocating resources and configuring settings based on specific needs for allenvironments (Dev/Test/Prod). Implement robust security practices, including networksecurity settings, integration with Azure Active Directory, and dataencry...
DevOps Engineer (Remote)
KLDiscovery, a leading global provider of electronic discovery, information governance and data recovery services, is currently seeking a Development Operations Engineer for an exciting new opportunity. Seek and participate in personal development opportunities to maintain a detailed knowledge of in...
Data Engineer II
JobPosting","title":"Data Engineer II","datePosted":"2024-04-15T00:00:00","validThrough":null,"description":"Data Engineer II (Multiple Openings), Project Management Institute, Inc. Data Engineer II (Multiple Openings), Project Management Institute, Inc. The position requires a minimum of a Bachelor...
Database Manager/Data Analyst
Data Analyst/ Database Manager. Data Analyst/Database Manager position within the Office of Nursing Research and Scholarship's (ONRS) Statistics Team. The Data Analyst/Database Manager will partner with the ONRS Statistics Team to:. Provide data quality control, data maintenance support and perform ...
Intern Systems Engineer
Engineering Interns must be enrolled in an accredited degree program in Computer Engineering, Systems Engineering, Software Engineering, Electrical Engineering, Mechanical Engineering or other related scientific or technical discipline with a preference for a standing of a sophomore or higher. Gener...
Software Engineer II (Kubernetes & Public Cloud)
As a software engineer, you should have a strong engineering sensibility that applies Agile and DevOps technical practices such as CI/CD and automation to cloud management problems. As a member of this team, the Software Engineer II - Cloud | Kubernetes is responsible for supporting our AWS environm...
Solutions Enterprise Architect
Define architecture strategy, and own responsibility of the planning, design, and implementation of enterprise solutions across multiple technology towers and disciplines, inclusive of cloud, custom internet-scale software development, modern workplace systems, business applications, networking, sec...
DevOps Engineer-GitHub SME
This DevOps engineer would be helping our client with their GitHub migration. They are migrating from Azure DevOps to GitHub to stay technology relevant and forward thinking. The driving force here is that Azure DevOps is going away and GitHub is its replacement. ...
Data Governance Analyst (Data Analyst)
The Data Analyst is a member of the Data Governance within Finance. The two primary outcomes of this job are to ensure our business units are interacting with accurate and meaningful data and that our data is captured efficiently. Inovalon was founded in 1998 on the belief that technology, and data ...
Senior Software Engineer-Site Reliability
Senior Software Engineer, Site Reliability - Minneapolis, MN. Senior Software Engineer, Site Reliability. Bachelor's Degree in Engineering, Software, Computer Science, or related discipline or equivalent experience. Demonstrated experience conducting software investigations, designing, developing, a...