Title:: GCP Data Engineer role with Snowflake
Candidate should have experience with Snowflake Data Clean Room, no submission will be entertained with out this skill set.
Location:: Remote
JD
Key Responsibilities
Design, develop and optimize scalable data pipelines and ETL workflows using Google Cloud Platform (GCP), particularly leveraging BigQuery, Dataflow, Dataproc and Pub/Sub.
Design and manage secure, efficient data integrations involving Snowflake and BigQuery.
Write, test and maintain high-quality Python code for data extraction, transformation and loading (ETL), analytics and automation tasks.
Use Git for collaborative version control, code reviews and managing data engineering projects.
Implement infrastructure-as-code practices using Pulumi for cloud resources management and automation within GCP environments.
Apply clean room techniques to design and maintain secure data sharing environments in alignment with privacy standards and client requirements.
Collaborate with cross-functional teams (data scientists, business analysts, product teams) to deliver data solutions, troubleshoot issues and assure data integrity throughout the lifecycle.
Optimize performance of batch and streaming data pipelines, ensuring reliability and scalability.
Maintain documentation on processes, data flows and configurations for operational transparency.
________________________________________
Required Skills
Strong hands-on experience with GCP core data services: BigQuery, Dataflow, Dataproc and Pub/Sub.
Proficiency in data engineering development using Python.
Deep familiarity with Snowflake-data modeling, secure data sharing and advanced query optimization.
Proven experience with Git for source code management and collaborative development.
Demonstrated ability using Pulumi (or similar IaC tools) for deployment and support of cloud infrastructure.
Practical understanding of cleanroom concepts in cloud data warehousing, including privacy/compliance considerations.
Solid skills in debugging complex issues within data pipelines and cloud environments.
Effective communication and documentation skills.
#L!-CEIPAL
Hiring Family Law Litigators to join our growing team!This Jobot Job is hosted by: Brooke HogrefeAre you a fit? Easy Apply now by clicking the "Apply" buttonand sending us your resume.Salary: $110,000 - $130,000 per yearA bit about us:Boutique law firm focused...
...Accounts Payable Specialist to join our centralized Regional Business Office team located in Ontario, California! The ideal candidate has a... ...1099 records for year-end reporting. Maintains proper petty cash records notifying management immediately of any shortage or...
...respect Position Purpose: Food and food service delivery Drivers fulfill a critical role in the countrys food supply chain. Our... ...High school diploma/GED or state approved equivalent Valid CDL B Meet all State licensing and/or certification requirements (...
...Job Description ABOUT AMAZON Our Worldwide Operations network delivers millions of packages and smiles to Amazon customers every... ...customer-focused individuals who want to join our team as an Area Manager. In this role, you will lead a team of hourly employees and...
...Job Description Quality Control Engineer We are looking for a Quality Control Engineer to join our team at EMD! As a Quality Control Engineer, you will have responsibility for the design and implementation of quality control software inspection programs....