Talent.com
Senior Developer - AWS Databricks
Senior Developer - AWS DatabricksSpectraforce Technologies • Columbia, SC, United States
No longer accepting applications
Senior Developer - AWS Databricks

Senior Developer - AWS Databricks

Spectraforce Technologies • Columbia, SC, United States
9 days ago
Job type
  • Full-time
Job description

Role Name : Senior Developer

Location : Columbia, SC, 29219 (Tue, Wed, Thurs)

Duration : 12 Months

Hours - 8 : 30 AM - 5 : 00 PM

Job Description : Duties :

  • Responsible for analysis, design, programming, and implementation of the most complex applications tasks and projects in the area. Devise feasible, logical procedures to resolve business problems through the use of computer resources.
  • Formulate scope and objectives through research to develop or modify complex systems. Provide technical direction and support in the development and support of business systems software and procedures. Design, code, test and debug the most complex application programs.
  • 20% Provide expertise regarding the integration of applications across the business.
  • Conceive, design, and implement structures and programs to business systems software.
  • 15% Act as an internal consultant, advocate, mentor, and change agent providing expertise and technical guidance on complex projects.
  • Work closely with customers, business analysts, and team members to determine business requirements that drive the analysis and design of quality technical solutions. Ensure solutions are aligned with business and IT strategies and comply with the organization's architectural standards.
  • 15% Provide design recommendations based on long-term IT organization strategy. Make recommendations towards the development of new code or reuse of existing code. Responsibilities may also include participation in component and data architecture design, performance monitoring, product evaluation and buy versus build recommendations.
  • 15% Perform analysis, design, programming, and implementation on systems and procedures to solve complex business or scientific problems. Develop enterprise-level applications and custom integration solutions. Evaluate complex interrelationships in immediate programming area to determine how changes in one program will affect another related area.
  • 15% Develop programming and development standards. Devise new sources of data and develop new approaches and techniques. Involved in the full systems life cycle and is responsible for designing, coding, testing, implementing, maintaining and supporting application software that is delivered on time and within budget.
  • 15% Provide guidance to lower level programmers / analysts. Lead, plan, organize, and / or coordinate complex projects or phases of large projects. Determine and resolve problems with other systems analysts, programmers, and systems users.
  • 5% Test designed programs, verify logic, perform any necessary "debugging," and write the documentation.

Skills :

  • Advanced understanding of applications / development, quality assurance and integration methodologies, concepts and facilities in a mainframe, midrange, and / or PC / LAN environment.
  • Demonstrates a high level of technical proficiency in the areas of programming languages, platform capabilities, and methods of systems analysis and program design.
  • Advanced analysis, decision-making, and problem solving skills. Demonstrates logical abstract thinking and assimilating / adhering to project goals and deadlines. Ability to communicate effectively verbally and in writing.
  • Able to work well under pressure and as part of a team.
  • Extensive knowledge of interpersonal skills / team building. Familiar with project management concepts. Ability to assess requirements, alternatives, and risks / benefits for low- to high-impact projects.
  • Pays attention to detail. Ability to establish and maintain effective working relationships with employees, clients, vendors etc. In-depth understanding of organizational functions, behavior, and inter-relationships.
  • Day to Day

  • The Senior Developer's primary responsibility will be as a technical expert for our business unit's implementation in the corporate Databricks solution
  • This is a new platform for our client's organization and a foundation for our business analytical solutions requiring technical depth with the Databricks product, including Unity Catalog configuration, medallion architecture enablement, setup of logical data controls for security and governance, and configuration of secure data sharing and clean room capabilities to support compliant collaboration
  • This role will participate in the technical strategy and execution to provide trusted, stable, reliable, responsive, and secure solutions and proactively inform business partners on Data & Analytics platform and product health, and problem resolution
  • This role will be instrumental in ensuring a successful deployment, optimizing performance, and enabling data teams to leverage Databricks for advanced analytics and machine learning.
  • The Senior Developer will work collaboratively with core technology partners to solve business problems and deliver solutions.
  • Enable and monitor platform-level observability, lineage, and governance features
  • Support development teams by defining secure data access patterns, logical data controls, and Unity Catalog policies for compliant use of visualization and reporting solutions.
  • Manage Unity Catalog administration, workspace binding, and metastore configuration, enforcing catalog-level RBAC and ensuring each workspace aligns with corporate governance and security requirements.
  • Oversee Databricks cluster policy enforcement, compute governance, and FinOps optimization to ensure efficient, secure, and cost-effective operations across all environments.
  • Work Environment :

    Customer-focused, project-oriented programming environment. Fast paced, multi-platformed environment which may require action and response 24X7 to support the technical business needs of the customer.

    The Team :

    Commercial Systems Information Management (CSIM) aka Data Lake.

    Job Requirement :

    Minimum Required Education :

  • Bachelor's degree-in Computer Science, Information Technology or other job related degree.
  • Degree Equivalency : 4 years of job related work experience or 2 years of job related experience plus an associate's degree in Computer Science, Information Technology or other job related degree
  • Required Work Experience :

  • 8 years-of application development, systems testing or other job related experience.
  • Required Technologies :

  • 7+ years of technical experience with at least 3 years managing Databricks environments in production at enterprise scale
  • Deep expertise with Databricks Unity Catalog, Delta Lake, Delta Live Tables, SQL Warehouses, and medallion architecture implementations
  • Hands-on experience administering Databricks workspaces, metastores, cluster policies, jobs, and serverless compute
  • Proven ability to design and maintain Infrastructure-as-Code solutions (AWS CloudFormation, CDK, Github Actions, or Similar) for Databricks and AWS resource provisioning
  • Experience integrating Databricks with Azure AD / Entra for identity and access governance
  • Strong Understanding of FinOps practices, including tagging standards, cost analysis, and optimization for cloud compute
  • Working knowledge of data ingestion patterns (batch, streaming, CDC) to support data engineering enablement
  • Strong knowledge of Spark, Python, AWS services (like EC2, S3, IAM, Glue, Cloud Watch) Nice to Have : R R Studio / Posit Workbench R Shiny / Posit Connect Posit Package Manager Amazon Bedrock
  • Nice To Have :

    AWS Redshift, Databricks- delta Lake, Unity catalog, Data Engineering and processing using Databricks, AI and Machine Learning Amazon Bedrock, AWS Sagemaker, AWS Sagemaker Unified Studio, R Studio / Posit Workbench, R Shiny / Posit Connect, Posit Package Manager, AWS Data Firehose, Kafka, Hive, Hue, Oozie, Sqoop, Git / Git Actions, IntelliJ, Scala

    Create a job alert for this search

    Aws Developer • Columbia, SC, United States

    Related jobs
    Drive With Uber : Earn At Least $1535 For Your First 127 Trips, Guaranteed.

    Drive With Uber : Earn At Least $1535 For Your First 127 Trips, Guaranteed.

    Uber • Eastover, SC, US
    Full-time +1
    Earn at least $1535 driving with Uber when you complete your first 127 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, pa...Show more
    Last updated: 1 day ago • Promoted
    IT Architect

    IT Architect

    Alpek Polyester USA • Gaston, SC, US
    Full-time
    We are seeking a motivated individual to join our Information Technology team based out of our Gaston, SC facility.The ideal candidate for the Alpek Polyester. Cybersecurity and IT Infrastructu...Show more
    Last updated: 30+ days ago • Promoted
    Choose your schedule - Earn At Least $1535 For Your First 127 Trips, Guaranteed.

    Choose your schedule - Earn At Least $1535 For Your First 127 Trips, Guaranteed.

    Uber • Pomaria, SC, US
    Full-time +1
    Earn at least $1535 driving with Uber when you complete your first 127 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, pa...Show more
    Last updated: 1 day ago • Promoted
    Drive with Uber : Earn at least $755 when you complete 69 trips.

    Drive with Uber : Earn at least $755 when you complete 69 trips.

    Uber • Salley, GA, US
    Full-time +1
    Earn at least $755 driving with Uber when you complete your first 69 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, part...Show more
    Last updated: 1 day ago • Promoted
    Quick Earnings : Earn At Least $755 For Your First 69 Trips, Guaranteed.

    Quick Earnings : Earn At Least $755 For Your First 69 Trips, Guaranteed.

    Uber • Wagener, GA, US
    Full-time +1
    Earn at least $755 driving with Uber when you complete your first 69 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, part...Show more
    Last updated: 1 day ago • Promoted
    IBM Curam Developer

    IBM Curam Developer

    Divine Global Solutions • Columbia, SC, US
    Full-time
    As a Developer, you will be responsible for below responsibilities.Work closely with other web developers, as well as other teams, to ensure the message on our site is clear, concise, and functiona...Show more
    Last updated: 16 days ago • Promoted
    Senior Developer

    Senior Developer

    Spectraforce Technologies • Columbia, SC, United States
    Full-time
    Location : Columbia, SC (Hybrid, 2-3 days onsite a week).Contract length : 12 Months (Possibility of extension).Work Hours : Monday through Friday 8 : 00-5 : 00 - plus potential overtime, on call, weeken...Show more
    Last updated: 30+ days ago • Promoted
    Quick Earnings : Earn At Least $1375 For Your First 120 Trips, Guaranteed.

    Quick Earnings : Earn At Least $1375 For Your First 120 Trips, Guaranteed.

    Uber • Stateburg, SC, US
    Full-time +1
    Earn at least $1375 driving with Uber when you complete your first 120 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, pa...Show more
    Last updated: 1 day ago • Promoted
    Engineering Co-Op

    Engineering Co-Op

    Alpek Polyester USA • Gaston, SC, US
    Full-time
    We are seeking motivated students to join our.Co-ops are reportable to their assigned engineering team's manager and work closely with Technical, Business and Engineering personnel to accomplis...Show more
    Last updated: 30+ days ago • Promoted
    Azure APIM Developer

    Azure APIM Developer

    TMS • Columbia, SC, United States
    Full-time
    Quick Apply
    MessageBody"> Role : Azure APIM Developer Duration : Long Term Location : Columbia, SC- Hybrid Must, Try for local or nearby candidates ...Show more
    Last updated: 4 days ago
    New Business Development Manager

    New Business Development Manager

    Sigmatex UK Ltd. • Cameron, SC, US
    Full-time
    As a Business Development Manager , you will be responsible for engaging with sales leads and potential new customers on a frequent basis, building a close working relationship with them, understan...Show more
    Last updated: 30+ days ago • Promoted
    Earn At Least $755 For Your First 69 Trips, Guaranteed.

    Earn At Least $755 For Your First 69 Trips, Guaranteed.

    Uber • Wagener, GA, US
    Full-time +1
    Earn at least $755 driving with Uber when you complete your first 69 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, part...Show more
    Last updated: 1 day ago • Promoted
    Earn At Least $1535 For Your First 127 Trips, Guaranteed.

    Earn At Least $1535 For Your First 127 Trips, Guaranteed.

    Uber • Blythewood, SC, US
    Full-time +1
    Earn at least $1535 driving with Uber when you complete your first 127 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, pa...Show more
    Last updated: 1 day ago • Promoted
    Uber - Sign Up to Drive and Earn

    Uber - Sign Up to Drive and Earn

    Uber • Elloree, SC, US
    Full-time +1
    Driving with Uber is an alternative to a part-time or full-time job and can get you earning cash on the road quickly.Driving with Uber allows you to earn quick cash while maintaining the flexibilit...Show more
    Last updated: 4 days ago • Promoted
    Senior Software Engineer, Core Experiences - Columbia, USA

    Senior Software Engineer, Core Experiences - Columbia, USA

    Speechify • Columbia, SC, US
    Full-time
    Speechify is the easiest way to listen to the world's information.Articles on the web, documents in the cloud, books on your phone. We absorb it all and let you listen to it at your desk, on the...Show more
    Last updated: 23 days ago • Promoted
    Drive with Uber : Earn at least $1535 when you complete 127 trips.

    Drive with Uber : Earn at least $1535 when you complete 127 trips.

    Uber • Wedgefield, SC, US
    Full-time +1
    Earn at least $1535 driving with Uber when you complete your first 127 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, pa...Show more
    Last updated: 1 day ago • Promoted
    Drive with Uber - Sign Up Today

    Drive with Uber - Sign Up Today

    Uber • Pomaria, SC, US
    Full-time +1
    Driving with Uber is an alternative to a part-time or full-time job and can get you earning cash on the road quickly.Driving with Uber allows you to earn quick cash while maintaining the flexibilit...Show more
    Last updated: 4 days ago • Promoted
    Flexible $ : Earn At Least $1535 For Your First 127 Trips, Guaranteed.

    Flexible $ : Earn At Least $1535 For Your First 127 Trips, Guaranteed.

    Uber • North, SC, US
    Full-time +1
    Earn at least $1535 driving with Uber when you complete your first 127 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, pa...Show more
    Last updated: 1 day ago • Promoted