Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

Rzl4ZXphNVlTRVZoeHArdzhmWjNnbjNjRVE9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Newport Associates

Remote Booking Specialist Job at Newport Associates

 ...trips for travelers. This is an opportunity to work from home booking air, car, hotel, cruises, sporting events and concerts for a company...  ...start to finish Respond to telephone, email inquiries and online travel submissions in a timely fashion Research and book... 

MCT Express, Inc.

First Responder / Ambulance Driver Job at MCT Express, Inc.

 ...and Responsibilities: Provides emergency and non-emergency ambulance operations in conjunction with a partner, demonstrates excellent...  ...Requirements: Must be at least 21 years of age Hold a valid Florida driver license for a minimum of 3 years Less than 3 points on... 

SMI Telecom

Entry Level Sales Associate Job at SMI Telecom

 ...seeking an Entry LevelSales Associateto help expand our presence in South Jersey and...  ...individual to join our team. No prior sales experience? No problem! If you have a passion for...  ...connecting with people and driving results, we want to hear from you. Whats in it for you... 

Veterans Affairs, Veterans Health Administration

Health Technician Job at Veterans Affairs, Veterans Health Administration

 ...Summary The position is located at the Department of Veterans Affairs (VA) - Veterans Health Administration (VHA) - at the Raymond G. Murphy VA Medical Center in the Ambulatory Care Service. The primary purpose of the Health Technician is to provide medical and administrative... 

Rule 5 Hire

Maintenance Technician Job at Rule 5 Hire

 ...A manufacturing maintenance technician will perform regular preventive maintenance on equipment used in the manufacturing process to...  ...and ability to read blueprints Knowledge of parametric and industrial control systems. Familiarity with OSHA safety standards and...