Data Engineer - Snowflake and Databricks Job at Expedite Technology Solutions, Seattle, WA

QjRRUEdOajVKTTFCUjl3ZWtiL0dNN3N3eEE9PQ==
  • Expedite Technology Solutions
  • Seattle, WA

Job Description

Primary Skill: DBT Labs Snowflake Secondary Skill: Databricks Databricks Unity Catalog Responsibilities: Develop, optimize, and maintain data pipelines using Azure Data Factory (ADF), DBT Labs, Snowflake, and Databricks. Develop reusable jobs and configuration-based integration framework to optimize development and scalability. Manage data ingestion for structured and unstructured data (landing/lake house: ADLS, Sources: ADLS, Salesforce, SharePoint Documents Libraries, Partner Data: Client, IHME, WASDE, etc.). Implement and optimize ELT processes, source-to-target mapping, and transformation logic in DBT Labs, Azure Data Factory, Databricks Notebook, Snow SQL, etc. Collaborate with data scientists, analysts, data engineers, report developers, and infrastructure engineers for end-to-end support. Co-develop CI/CD best practices, automation, and pipelines with Infrastructure engineers for code deployments using GitHub Actions. Bring in automation from source-to-target mappings to data pipelines and data lineage in Collibra. Required Experience: Hands-on experience building pipelines with ADF, Snowflake, Databricks, and DBT Labs. Expertise in Azure Cloud with Databricks, Snowflake, and ADLS Gen2 integration. Data Warehousing and Lakehouse Knowledge: Proficient with ELT processes, *** Tables, and External Tables for structured/unstructured data. Experience with Databricks Unity Catalog and data sharing technologies. Strong skills in CI/CD (Azure DevOps, GitHub Actions) and version control (GitHub). Strong cross-functional collaboration and technical support experience for data scientists, report developers, and analysts. #J-18808-Ljbffr Expedite Technology Solutions

Job Tags

Similar Jobs

Expivia Interaction Marketing Group Inc.

Bilingual Customer Service Job at Expivia Interaction Marketing Group Inc.

Exciting Bilingual (Spanish/English) Customer Service Positions Available!Work from Home Opportunity!Weekly Attendance Bonuses!Weekly Motivations!Flexible Schedules!Equipment Provided!**There will be mandatory on-site training at our EBCO Park location in Erie... 

Inizio Engage

Medical Science Liaison Director - Diagnostics, Neurodegenerative Diseases Job at Inizio Engage

 ...Inizio Engage, in partnership with Danaher Diagnostics, is seeking a Medical Science Liaison (MSL) Director to lead a national team focused on advancing clinical education and scientific engagement around novel biomarkers for neurodegenerative diseases, such as Alzheimer... 

The Rundown AI, Inc.

Staff RF System Design Engineer (R2319) Job at The Rundown AI, Inc.

 ...Description: Are you a passionate, innovative, experienced Electrical Engineer looking to help develop state-of-the-art AI hardware products?...  ...for you! Shield AI is seeking a passionate and experienced RF System Engineer to develop cutting-edge AI-driven hardware. In this... 

LifeStance Health

Licensed Mental Health Counselor - Granite Falls, WA Job at LifeStance Health

At LifeStance Health, we believe in a truly healthy society where mental and physical healthcare are unified to make lives better. Our mission is to help people lead healthier, more fulfilling lives by improving access to trusted, affordable, and personalized mental healthcare...

CrowdStrike

Remote Regional Sales Engineer (Remote, SWE) Job at CrowdStrike

 ...security solutions are designed and deployed, and why they are failing. This position is open to candidates that are located remotely in Sweden What Youll Do: Deliver technical product presentations & demonstrations. Configure product installations...