AZURE DATA ENGINEER Job at CapB InfoteK, Des Moines, IA

QllVR0h0Ny9LODFPUjlrUWtyVEJON016eFE9PQ==
  • CapB InfoteK
  • Des Moines, IA

Job Description

CapB is a global leader on IT Solutions and Managed Services. Our R&D is focused on providing cutting edge products and solutions across Digital Transformations from Cloud, AI/ML, IOT, Blockchain to MDM/PIM, Supply chain, ERP, CRM, HRMS and Integration solutions. For our growing needs we need consultants who can work with us on salaried or contract basis. We provide industry standard benefits, and an environment for LEARNING & Growth. For one of our going on project we are looking for an AZURE DATA ENGINEER. The position is based out of Des Moines, IA . Locals preferred but can be done remotely for the time being this year. Responsibilities:

  • Create functional design specifications, Azure reference architectures, and assist with other project deliverables as needed.
  • Design and Develop Platform as a Service (PaaS) Solutions using different Azure Services
  • Create a data factory, orchestrate data processing activities in a data-driven workflow, monitor and manage the data factory, move, transform and analyze data
  • Design complex enterprise Data solutions that utilize Azure Data Factory Create migration plans to move legacy SSIS packages into Azure Data Factory
  • Build conceptual and logical data models
  • Design and implement big data real-time and batch processing solutions
  • Design, build, and scale data pipelines across a variety of source systems and streams (internal, third-party, as well as cloud-based), distributed / elastic environments, and downstream applications and/or self-service solutions.
  • Develop and document mechanisms for deployment, monitoring and maintenance
Skills and Experience:
  • Bachelor's degree or higher in Computer Science Engineering/ Information Technology, Information Systems
  • 3+ years experience with Microsoft Cloud Data Platform: Azure Data Factory, Azure Databricks, Python, Scala, Spark SQL, SQL Data Warehouse
  • 3+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL, data lake solutions
  • Expertise with SQL, database design/structures, ETL/ELT design patterns, and DataMart structures (star, snowflake schemas, etc.)
  • Functional knowledge of programming scripting and data science languages such as JavaScript, PowerShell, Python, Bash, SQL, .NET, Java, PHP, Ruby, PERL, C++, R, etc.
  • Creation of descriptive, predictive and prescriptive analytics solutions using Azure Stream Analytics, Azure Analysis Services, Data Lake Analytics, HDInsight, HDP, Spark, Databricks, MapReduce, Pig, Hive, Tez, SSAS, Watson Analytics, SPSSA
  • Experience in Azure Data Factory (ADF) creating multiple pipelines and activities using Azure for full and incremental data loads into Azure Data Lake Store and Azure SQL DW
  • Experience for Azure Data Lake Storage and working with Parquet files and partitions
  • Experience managing Microsoft Azure environments with VM’s, VNETS, Subnets, NSG’s, Resource Groups, etc.
  • Experience in Creation & Configuration of Azure Resources & RBAC
  • Experience with Git/Azure DevOps
  • Azure certification would be desired
  • Must have an ability to communicate clearly and be a team player CapB InfoteK

Job Tags

Contract work, Local area, Remote work,

Similar Jobs

SpartanNash

Liquor Store Clerk Job at SpartanNash

 ...SpartanNash Store Associate At SpartanNash, we deliver the ingredients for a better life through customer-focused innovation. We do this for our supply chain customers and U.S. military commissaries, retail store guests and, most importantly, our Associates. In fact... 

DXC Technology

Life and Annuity Call Center Rep - US REMOTE Job at DXC Technology

 ...Applicants without this license will not be considered + 1-2 years of Life Insurance and Annuities experience is required + Call center experienced is required + Understanding of insurance products as well as administrative, claims, underwriting and marketing organizations... 

ADTRAV Travel Management

Corporate International/Complex Travel Consultant Job at ADTRAV Travel Management

 ...Job Description Job Description ADTRAV Travel Management, founded in 1977, has over four decades of experience in managing corporate...  ...be responsible for booking and issuing domestic and complex international airline itineraries, hotel reservations and car and train... 

CHRISTUS Health

RN, Registered Nurse Clinical Educator II - Nursing Administration Job at CHRISTUS Health

 ...promulgated by state and federal agencies, the hospital, and other regulatory entities.Performs all duties in a manner that protects the confidentiality of patients and does not solicit or disclose any confidential information unless it is necessary in the performance of assigned... 

Corporate Crime Control Protective Services

Now Hiring: Armed & Unarmed Security Officers - FT/PT/Seasonal Job at Corporate Crime Control Protective Services

 ...and represent our team with professionalism. Were currently hiring for both armed and unarmed positions , and the majority of our...  ...-Metro area . Whether youre an experienced officer or just starting out, we offer opportunities for those who want more than a static...