Talent.com
Senior Developer - AWS Databricks
Senior Developer - AWS DatabricksSpectraforce Technologies • Columbia, SC, United States
No longer accepting applications
Senior Developer - AWS Databricks

Senior Developer - AWS Databricks

Spectraforce Technologies • Columbia, SC, United States
1 day ago
Job type
  • Full-time
Job description

Role Name : Senior Developer

Location : Columbia, SC, 29219 (Tue, Wed, Thurs)

Duration : 12 Months

Hours - 8 : 30 AM - 5 : 00 PM

Job Description : Duties :

  • Responsible for analysis, design, programming, and implementation of the most complex applications tasks and projects in the area. Devise feasible, logical procedures to resolve business problems through the use of computer resources.
  • Formulate scope and objectives through research to develop or modify complex systems. Provide technical direction and support in the development and support of business systems software and procedures. Design, code, test and debug the most complex application programs.
  • 20% Provide expertise regarding the integration of applications across the business.
  • Conceive, design, and implement structures and programs to business systems software.
  • 15% Act as an internal consultant, advocate, mentor, and change agent providing expertise and technical guidance on complex projects.
  • Work closely with customers, business analysts, and team members to determine business requirements that drive the analysis and design of quality technical solutions. Ensure solutions are aligned with business and IT strategies and comply with the organization's architectural standards.
  • 15% Provide design recommendations based on long-term IT organization strategy. Make recommendations towards the development of new code or reuse of existing code. Responsibilities may also include participation in component and data architecture design, performance monitoring, product evaluation and buy versus build recommendations.
  • 15% Perform analysis, design, programming, and implementation on systems and procedures to solve complex business or scientific problems. Develop enterprise-level applications and custom integration solutions. Evaluate complex interrelationships in immediate programming area to determine how changes in one program will affect another related area.
  • 15% Develop programming and development standards. Devise new sources of data and develop new approaches and techniques. Involved in the full systems life cycle and is responsible for designing, coding, testing, implementing, maintaining and supporting application software that is delivered on time and within budget.
  • 15% Provide guidance to lower level programmers / analysts. Lead, plan, organize, and / or coordinate complex projects or phases of large projects. Determine and resolve problems with other systems analysts, programmers, and systems users.
  • 5% Test designed programs, verify logic, perform any necessary "debugging," and write the documentation.

Skills :

  • Advanced understanding of applications / development, quality assurance and integration methodologies, concepts and facilities in a mainframe, midrange, and / or PC / LAN environment.
  • Demonstrates a high level of technical proficiency in the areas of programming languages, platform capabilities, and methods of systems analysis and program design.
  • Advanced analysis, decision-making, and problem solving skills. Demonstrates logical abstract thinking and assimilating / adhering to project goals and deadlines. Ability to communicate effectively verbally and in writing.
  • Able to work well under pressure and as part of a team.
  • Extensive knowledge of interpersonal skills / team building. Familiar with project management concepts. Ability to assess requirements, alternatives, and risks / benefits for low- to high-impact projects.
  • Pays attention to detail. Ability to establish and maintain effective working relationships with employees, clients, vendors etc. In-depth understanding of organizational functions, behavior, and inter-relationships.
  • Day to Day

  • The Senior Developer's primary responsibility will be as a technical expert for our business unit's implementation in the corporate Databricks solution
  • This is a new platform for our client's organization and a foundation for our business analytical solutions requiring technical depth with the Databricks product, including Unity Catalog configuration, medallion architecture enablement, setup of logical data controls for security and governance, and configuration of secure data sharing and clean room capabilities to support compliant collaboration
  • This role will participate in the technical strategy and execution to provide trusted, stable, reliable, responsive, and secure solutions and proactively inform business partners on Data & Analytics platform and product health, and problem resolution
  • This role will be instrumental in ensuring a successful deployment, optimizing performance, and enabling data teams to leverage Databricks for advanced analytics and machine learning.
  • The Senior Developer will work collaboratively with core technology partners to solve business problems and deliver solutions.
  • Enable and monitor platform-level observability, lineage, and governance features
  • Support development teams by defining secure data access patterns, logical data controls, and Unity Catalog policies for compliant use of visualization and reporting solutions.
  • Manage Unity Catalog administration, workspace binding, and metastore configuration, enforcing catalog-level RBAC and ensuring each workspace aligns with corporate governance and security requirements.
  • Oversee Databricks cluster policy enforcement, compute governance, and FinOps optimization to ensure efficient, secure, and cost-effective operations across all environments.
  • Work Environment :

    Customer-focused, project-oriented programming environment. Fast paced, multi-platformed environment which may require action and response 24X7 to support the technical business needs of the customer.

    The Team :

    Commercial Systems Information Management (CSIM) aka Data Lake.

    Job Requirement :

    Minimum Required Education :

  • Bachelor's degree-in Computer Science, Information Technology or other job related degree.
  • Degree Equivalency : 4 years of job related work experience or 2 years of job related experience plus an associate's degree in Computer Science, Information Technology or other job related degree
  • Required Work Experience :

  • 8 years-of application development, systems testing or other job related experience.
  • Required Technologies :

  • 7+ years of technical experience with at least 3 years managing Databricks environments in production at enterprise scale
  • Deep expertise with Databricks Unity Catalog, Delta Lake, Delta Live Tables, SQL Warehouses, and medallion architecture implementations
  • Hands-on experience administering Databricks workspaces, metastores, cluster policies, jobs, and serverless compute
  • Proven ability to design and maintain Infrastructure-as-Code solutions (AWS CloudFormation, CDK, Github Actions, or Similar) for Databricks and AWS resource provisioning
  • Experience integrating Databricks with Azure AD / Entra for identity and access governance
  • Strong Understanding of FinOps practices, including tagging standards, cost analysis, and optimization for cloud compute
  • Working knowledge of data ingestion patterns (batch, streaming, CDC) to support data engineering enablement
  • Strong knowledge of Spark, Python, AWS services (like EC2, S3, IAM, Glue, Cloud Watch) Nice to Have : R R Studio / Posit Workbench R Shiny / Posit Connect Posit Package Manager Amazon Bedrock
  • Nice To Have :

    AWS Redshift, Databricks- delta Lake, Unity catalog, Data Engineering and processing using Databricks, AI and Machine Learning Amazon Bedrock, AWS Sagemaker, AWS Sagemaker Unified Studio, R Studio / Posit Workbench, R Shiny / Posit Connect, Posit Package Manager, AWS Data Firehose, Kafka, Hive, Hue, Oozie, Sqoop, Git / Git Actions, IntelliJ, Scala

    Create a job alert for this search

    Aws Developer • Columbia, SC, United States

    Related jobs
    AWS Data Engineer

    AWS Data Engineer

    VirtualVocations • Columbia, South Carolina, United States
    Full-time
    A company is looking for an AWS Data Engineer to support cloud migration and optimize data queries.Key Responsibilities Review and rewrite existing SQL / Power BI queries for Amazon Redshift Optim...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data and AI Engineer

    Senior Data and AI Engineer

    VirtualVocations • Columbia, South Carolina, United States
    Full-time
    A company is looking for a Senior Engineer specializing in Data and AI to transform business operations through advanced AI applications. Key Responsibilities Lead the design, development, and dep...Show more
    Last updated: 3 days ago • Promoted
    Senior Full-Stack Developer

    Senior Full-Stack Developer

    VirtualVocations • Columbia, South Carolina, United States
    Full-time
    A company is looking for a Senior Full-Stack Developer to build generative AI applications.Key Responsibilities Design and develop scalable data pipelines and microservices using Python and AWS s...Show more
    Last updated: 30+ days ago • Promoted
    CDL-A Drivers : Historic Pay Increase! Earn Up To $0.66 Per Mile!

    CDL-A Drivers : Historic Pay Increase! Earn Up To $0.66 Per Mile!

    Millis Transfer Inc • Camden, SC, USA
    Full-time
    STOP WHAT YOU’RE DOING — THIS IS BIG.Millis Just Launched a Historic Pay Raise for ALL Drivers!.Just more money in your pocket. Millis is raising the bar — and your paycheck.Orientation Now Offered ...Show more
    Last updated: 4 days ago • Promoted
    CDL A Drivers : '25-'26 Trucks Rolling Out - Top Miles w / Reefer Freight

    CDL A Drivers : '25-'26 Trucks Rolling Out - Top Miles w / Reefer Freight

    Navajo Express, Inc • Camden, SC, USA
    Full-time
    New Business and More High-Mile Lanes Secured! 2025 & 2026 Model Trucks Arriving Daily! .It's a Great Time to Find Your Lane at Navajo Express!. No local or Florida positions currently available •.Ne...Show more
    Last updated: 4 days ago • Promoted
    Senior Developer

    Senior Developer

    United Global Technologies • Columbia, SC, US
    Full-time
    Duties : Responsible for analysis, design, programming, and implementation of the most complex applications tasks and projects in the area. Devise feasible, logical procedures to resolve business pro...Show more
    Last updated: 30+ days ago • Promoted
    Engineering Co-Op

    Engineering Co-Op

    Alpek Polyester USA • Gaston, SC, US
    Full-time
    We are seeking motivated students to join our.Co-ops are reportable to their assigned engineering team's manager and work closely with Technical, Business and Engineering personnel to accomplis...Show more
    Last updated: 30+ days ago • Promoted
    Medical Device Sales – Paid Internship

    Medical Device Sales – Paid Internship

    Medical Sales College • Saint Matthews, South Carolina, US
    Internship
    Description Medical Device Sales - Paid Internship Looking for a rewarding and lucrative career in the medical sales industry? Our paid Internship may be the right path for you! Here are just some ...Show more
    Last updated: 30+ days ago • Promoted
    Field Tech I

    Field Tech I

    Nexus Water Group • Irmo, SC, United States
    Full-time
    Nexus Water Group is a leading regulated water and wastewater utility serving more than 1.Through the essential water and wastewater services we deliver, we have a very personal connection to the p...Show more
    Last updated: 30+ days ago • Promoted
    Senior Cloud Software Developer

    Senior Cloud Software Developer

    VirtualVocations • Columbia, South Carolina, United States
    Full-time
    A company is looking for a Senior Cloud Software Developer (Kotlin).Key Responsibilities Design and develop scalable, high-performance cloud-native applications using microservices architecture o...Show more
    Last updated: 2 days ago • Promoted
    Estimator - Utilities

    Estimator - Utilities

    SST Direct • Eastover, SC, US
    Full-time +1
    Seeking an Estimator with Grading, Utility, and Wastewater experience in Columbia, SC.This position involves reviewing project plans and specifications, determining material, labor, and equipment c...Show more
    Last updated: 30+ days ago • Promoted
    Senior Developer - AWS Databricks

    Senior Developer - AWS Databricks

    Spectraforce Technologies • Columbia, SC, United States
    Full-time
    Location : Columbia, SC, 29219 (Tue, Wed, Thurs).Responsible for analysis, design, programming, and implementation of the most complex applications tasks and projects in the area.Devise feasible, lo...Show more
    Last updated: 18 hours ago • Promoted • New!
    Team Lead, Market Operations

    Team Lead, Market Operations

    Carvana • Lexington, SC, US
    Full-time
    At Carvana, we sell cars, but we are not salespeople.We have made it our mission to create a hassle-free way for people to buy and sell cars. We saw a huge problem with how much of a headache it is ...Show more
    Last updated: 30+ days ago • Promoted
    AWS Connect Developer

    AWS Connect Developer

    VirtualVocations • Columbia, South Carolina, United States
    Full-time
    A company is looking for a Senior AWS Connect Developer to design and implement scalable contact center solutions.Key Responsibilities Design and implement Amazon Connect contact flows, routing p...Show more
    Last updated: 2 days ago • Promoted
    Sales Engineer-Controls

    Sales Engineer-Controls

    MSS Solutions, LLC • Lexington, SC, US
    Full-time
    As a result of our phenomenal growth,.Sales Engineer-Controls in our Columbia, SC office.If you are an experienced professional who is looking to grow your career and contribute fresh and innovativ...Show more
    Last updated: 1 day ago • Promoted
    New Business Development Manager

    New Business Development Manager

    Sigmatex UK Ltd. • Cameron, SC, US
    Full-time
    As a Business Development Manager , you will be responsible for engaging with sales leads and potential new customers on a frequent basis, building a close working relationship with them, understan...Show more
    Last updated: 30+ days ago • Promoted
    Global Vice President of Product Engineering

    Global Vice President of Product Engineering

    Pure Power Technologies Inc • Blythewood, SC, US
    Full-time
    Global Vice President of Product Engineering.Location : Jacksonville, NC / Blythewood, SC / Global.Department : Engineering & Product Development. Reports To : Chief Executive Officer / Chief Operat...Show more
    Last updated: 2 days ago • Promoted
    Senior DevOps Developer

    Senior DevOps Developer

    VirtualVocations • Columbia, South Carolina, United States
    Full-time
    A company is looking for a Senior DevOps Developer.Key Responsibilities Design, implement, maintain, and test automation frameworks and pipelines for system and product development Support confi...Show more
    Last updated: 1 day ago • Promoted
    IT Architect

    IT Architect

    Alpek Polyester USA • Gaston, SC, US
    Full-time
    We are seeking a motivated individual to join our Information Technology team based out of our Gaston, SC facility.The ideal candidate for the Alpek Polyester. Cybersecurity and IT Infrastructu...Show more
    Last updated: 30+ days ago • Promoted
    Operational Excellence Leader

    Operational Excellence Leader

    Pure Power Technologies Inc • Blythewood, SC, US
    Full-time
    The OPEX Leader is responsible for leading the implementation and advancement of the Stanadyne Production System (SPS) at the site level. This role will develop and execute a local lean roadmap to e...Show more
    Last updated: 30+ days ago • Promoted