Senior Databricks Aws Data Engineer Moline

JOB DESCRIPTION

Job Title: Senior Databricks & AWS Data Engineer
 
Location: Moline IL 61265- Onsite
 
Contract Duration: Long Term
 
Must Have Skills
 
AWS core services EC2,S3,Lambda, RDS, DynamoDB, SQS, API Gateway
 
Databricks Unity Catalog Admin, Databricks CLI, Databricks SQL, Databricks delta Lake, Databricks workflows
 
Python and PySpark
 
  
 
Nice to have skills
 
Data Warehouse
 
Azure Data Factory
 
  
 
Detailed Job Description
 
Senior Full Stack Developer with 8 to 12 years of experience. 
 
The candidate will have extensive experience in Databricks Unity Catalog Admin, Databricks CLI, Amazon S3, Python, Databricks SQL, Databricks delta Lake, Databricks workflows and PySpark.
 
  
 
Must have strong knowledge with Databricks Platform.
 
Experience in ADF, Azure SQL, Synapse, Spark/Data Bricks, big data, moder Data Lake and DW concepts.
 
Develop and maintain Python scripts for data processing and analysis tasks.
 
Lead the development and implementation of data solutions using Databricks Unity Catalog Admin, ensuring data governance and security.
 
Oversee the use of Databricks CLI for efficient management and automation of Databricks resources.
 
Guide on Amazon S3 for scalable storage solutions and integration with Databricks.
 
Apply data bricks SQL to build and optimize queries for data retrieval and reporting
 
Provide L3 Support of the applications part of Databricks, Python, PySpark, AWS
 
Implement and manage Databricks Delta Lake for reliable and high performance data lakes.
 
Collaborate with multi-function teams to understand business requirements and translate them into technical solution.