Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

QUkwQUg5enhJczVQU2RzWmxiakdON0l3enc9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Recooty

Entrepreneurs with A Growth Mindset Job at Recooty

 ...hourly or salary income, starting with us part-time to earn additional income may be the best way for you to begin your career as an entrepreneur.No matter where you are in lifes journey, we have a place for you! Maybe youre just starting out, going through corporate... 

Sysco

CDL-A Driver - Home Daily - Earn Up to $110,000/Year + $10k Sign-On Job at Sysco

 ...Job Description Sysco is Now Hiring Local CDL-A Drivers in Montana!\nHome Daily - Top Drivers Earn $110,000+ per Year \nHiring Immediately -...  ...provided)\n \n\n Benefits: \n\n \n\t ~ Local routes - Home daily \n\t ~ Top drivers earn $110,000+ per year!\n\t... 

Aramark

Catering Services Worker - Elanco Job at Aramark

Job Description The Catering Services Worker supports the event operations team in running successful catering orders and events within the location. The Catering Services Worker supports and carries out event set up, transporting equipment, food, or other supplies to... 

JLL

Sr. Program Manager (San Francisco) Job at JLL

 ...flexibility, and personalized benefits to manage life in and outside of work. Whether you...  ...personally. We are currently seeking a Senior Program Manager specializing in global...  ...Off and Company Holidays ~ Flexible and Remote Work Arrangements may be available.... 

Risinger Brothers Transfer, Inc.

Lease Purchase Truck Driver Job at Risinger Brothers Transfer, Inc.

Job Description: CDL-A Lease Purchase- Solo Gross $3K-$4,500/Weekly Be your own boss with...  ...Risinger's CDL-A Lease Purchase Program! Own a Truck in 2 Years! We provide you with...  ...being a professional & safe Class-A Truck Driver, you can lease purchase well maintained...