NCDOT - Databricks Data Specialist

NCDIT-T Web Systems is seeking a skilled Data Analyst with strong experience in Azure Databricks to support the creation of data aggregations, dashboards, and reports.

The candidate will need to come on-site on the first day to collect equipment.

All candidates must be local to the Triangle region of North Carolina.

This position may require up to 3 days per week at a Triangle-area office for return to office in addition to various in-person responsibilities, including meetings.

NCDIT-T Web Systems is seeking a skilled Data Analyst with strong experience in Azure Databricks to support the creation of data aggregations, dashboards, and reports. The ideal candidate will have hands-on expertise with Databricks (PySpark) and visualization tools, including both Databricks native tools and Power BI. In this role, you will be responsible for developing business requirements, supporting change management documentation, and actively collaborating with stakeholders to ensure alignment between data solutions and business needs. You will work closely with a technical lead and participate in design discussions and planning with the broader development team.

Key Responsibilities

• Conduct comprehensive data analysis, create data mappings, develop dashboards, and ensure data quality and integrity
• Leverage Spark SQL within Databricks to query and analyze large datasets, writing efficient and complex SQL queries
• Collaborate closely with data engineers to design and deliver high-quality data products
• Develop detailed data mappings to support the integration and transformation of data from diverse sources into structured, analysis-ready formats
• Design and build intuitive, informative dashboards using tools such as Power BI or Databricks' native visualization tools to effectively communicate insights
• Build Gold-layer data products to support custom-built dashboards, APIs, and UI tools
• Create clear and comprehensive documentation for data pipelines, mappings, models, and dashboard functionality
• Perform statistical analysis, data mining, and machine learning to uncover patterns, trends, and actionable insights
• Develop and implement predictive models, algorithms, and advanced analytical tools to address specific business challenges

Preferred :

Databricks Data Analyst Associate Certification

Required / Desired Skills

Skill

Required / Desired

Amount

of Experience

Hands-on experience designing, deploying, and managing Azure Databricks architecture in enterprise environments

Required

Years

Strong understanding of data science concepts, including statistical learning and machine learning algorithms

Required

Years

Proficiency in SQL and Python for developing queries, data transformations, and interactive dashboards

Required

Years

Experience with techniques like dimensional modeling, entity-relationship modeling, normalization / denormalization, or Data Vault

Required

Years

Excellent communication skills with proven ability to collaborate with cross-functional teams and translate business needs into technical solutions

Required

Years

Questions

No.

Question

Question1

Absences greater than two weeks MUST be approved by CAI management in advance, and contact information must be provided to CAI so that the resource can be reached during his or her absence. The Client has the right to dismiss the resource if he or she does not return to work by the agreed upon date. Do you agree to this requirement?

Question2

Your candidate must be able to attend an in-person interview. Do you agree to this requirement?

Question3

What is your candidate's email address?

Question4

How soon can your candidate start if selected for this opportunity?

Question5

Vendors are encouraged to submit candidates that are available for the duration of the assignment. Do you anticipate your candidate being able to work until the proposed end date listed on this VectorVMS req?

Question6

Vendors must disclose to the agency if the candidate will be subcontracted at the time of submission. Is your candidate an employee of your company or a subcontractor? Please be sure to notify a CAI Account Manager if your candidate's employee status changes.

Question7

Vendors must notify the agency if any portion of the requirements listed in this task order will be outsourced to other countries. Do you anticipate outsourcing any work being done for this assignment to another country?

Question8

Candidates submitted above the hourly Vendor Rate of $107.40 may not be considered for this assignment. Do you agree to this requirement?

Question9

Payment for all approved hours will be paid at the straight hourly rate regardless of the total hours worked by the engaged resource. It is the responsibility of the Vendor to adhere to any applicable compensation laws including payment for overtime hours. Do you agree to this requirement?

Question10

Have you thoroughly validated, and attest to the accuracy of, the credentials listed throughout your candidate s VectorVMS profile and resume pursuant to Section 5.2.5 of ITS-009440?

Question11

ONLY SUBMIT CANDIDATES CURRENTLY LIVING IN THE RALEIGH / DURHAM / CHAPEL HILL, NC AREA. Please list where your candidate is currently located.