Azure Databricks Administrator Architect

JOB DESCRIPTION

Job title: Technical Specialist- Junior (749745)
 
Location: Raleigh, NC 27610     Only local candidates are preferred for this opportunity 
 
Duration: 12 Months from projected
 
  
 
Databricks Certifications is must 
 
  
 
**The candidate must come onsite on the first day to collect equipment.**
 
**Posting may require up to 1-2 days per month in a Triangle area office for meetings.**
 
Seeking a Databricks Administrator/Architect with proven skills for a 12-month engagement for creation/tuning & support of the Databricks environment. This position will be responsible for developing and designing the Databricks environment at NCDIT-T. This individual will work with internal staff to plan/design/maintain the Databricks environment and recommend changes needed to accommodate/grow as our business needs dictate. This individual will facilitate changes through DIT-T's change process and work very closely with the DBA & Development Staff regarding all aspects of the design and planning of the Databricks environment.
 
  
 
Responsibilities:
 
*Provide mentorship, guidance, overall knowledge share, and support to team members, promoting continuous learning and development.
 
*Oversee the design, implementation, and maintenance of Databricks clusters.
 
*Ensure the platform's scalability, performance, and security.
 
*Provide escalated support and troubleshooting to users.
 
*Oversee maintenance of role-based access to data and features in the Databricks Platform using Unity Catalog.
 
*Review clusters health check and best practices implementation.
 
*Review and maintain documentation for users and administrators.
 
*Design and implement tailored data solutions to meet customer needs and use cases, spanning from ingesting data from APIs, building data pipelines, analytics, and beyond within a dynamically evolving technical stack.
 
*Work on projects involving on-prem data ingestion into Azure using ADF.
 
*Build data pipelines based on the medallion architecture that clean, transform, and aggregate data from disparate sources.