Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

TFpTRWF5SEpJWVp0eFR5OExQTHRwelZrbHc9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Grifols Shared Services North America, Inc

Nurse Educator - Southwest Job at Grifols Shared Services North America, Inc

 ...develop, produce and market innovative medicines, solutions and services in more than 110 countries and regions.**Summary:**The IG nurse educator provides clinical field-based support to execute the Immunology/Neurology Marketing plans through the development and execution... 

Rubenstein Law, P.A.

Legal Assistant/Secretary Job at Rubenstein Law, P.A.

 ...maximizing results. We were honored as a Top Workplace on Sun-Sentinels annual Best of List in 2018 and 2019. Job Summary The Legal Assistant works alongside their Attorney, handling cases in the Pre-Litigation phase while maintaining an open line of communication with... 

Agility Recruiting

Senior Accountant Job at Agility Recruiting

 ...Join the Finance team of a prestigious nonprofit and make your mark in mission-driven work! This dynamic role offers the opportunity to work with complex, sophisticated accounting processes in an impactful environment dedicated to excellence and community service.... 

CRH

Concrete Ready Mix Truck Driver Job at CRH

 ...vertically integrated supplier of aggregates, asphalt, ready mix concrete and paving services throughout the state of Ohio. Our...  ...based on experience Position Overview The concrete mixer truck driver safely operates a vehicle designed to manufacture, deliver and... 

Total Fire Protection

Fire Sprinkler Inspector Job at Total Fire Protection

 ...As a Fire Sprinkler Inspector, you will play a crucial role in ensuring the safety and compliance of buildings and facilities by inspecting, testing, and maintaining fire protection systems. This position requires a strong understanding of fire codes, standards, and regulations...