GCP Data Engineer (Apache Hudi and BigQuery EXPERIENCE is a MUST)

JOB DESCRIPTION

Lead Data Engineer 

Remote 

Long Term

Looking for who can assess the current landscape, do data profiling, data mapping , build solution etc.

Tech stack : GCP. Scala, Spark, Kafka, Database (many) – with data profiling /data mining skills

end-to-end ownership

Expertise in Hive, Spark, and Apache Hudi for big data processing and storage.

Hands-on experience with BigQuery and Google Cloud Platform (GCP) services such as GCS, Dataflow, and Pub/Sub.

Strong programming skills in Scala and Python, with experience in building data pipelines and ETL processes.

Proficiency with workflow orchestration tools like Apache Airflow.

Solid understanding of data warehousing concepts, data modelling, and schema design.

Knowledge of distributed systems and parallel processing.

Strong problem-solving skills and ability to work with large datasets in a fast-paced environment.

**-**

**Thanks & Regards**

**Sridhar G**

**Lead Recruiter**

**Torque Technologies LLC**

**Minority Business Enterprise (MBE) Certified | Member of IT Serve Alliance**

**An E-Verified Company | INC 5000 Company**
1135 Kildaire Farm Road, Suite #200, Cary, NC, 27511

P: (919)234-7515 | F: 203-547-6447

E: sridhar@torquetek.com

Linkedin: linkedin.com/in/sridhar-g-a956a398

Torque Technologies LLC is an Equal Opportunity Employer (EOE). Qualified applicants are considered for employment without regard to age, race, color, religion, sex, national origin, sexual orientation, disability, or veteran status.