Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

YjZvT3pWTkFkbjhUN29GWVJkN1U3ekJFQVE9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

STHS McAllen

Tech - Physical Therapy PRN Job at STHS McAllen

 ...Responsibilities POSITION SUMMARY: Staff Physical Therapy Technician is responsible for assisting licensed therapy staff under onsite supervision in providing specific services within the plan of care as specified by the therapist. Further, technicians are responsible... 

Get It Recruit - Transportation

Customer Success Manager - Remote | WFH Job at Get It Recruit - Transportation

Are you passionate about building strong customer relationships and ensuring their success? Do you thrive in a collaborative and fast-paced environment? If so, we want you to join our team! We're looking for a dynamic and enthusiastic Customer Success Manager to become... 

Always Best Care Senior Services - Boerne and the Texas Hill...

Caregiver / CNA / HHA -Now Hiring Job at Always Best Care Senior Services - Boerne and the Texas Hill...

 ...20 hours per week)* Tapcheck on-demand pay available for every hire* Flexible hours* Weekly pay (daily pay options available) with...  ...reading skills* Previous experience is preferred but not required* CNA, HHA, and BLS/CPR training a plus but not required* Military... 

Friends Hospital

Maintenance Technician Job at Friends Hospital

 ...Responsibilities Friends Hospital is the nation's oldest private psychiatric hospital, located on a beautiful 100-acre campus...  ...free, safe, on-site parking. Visit us online at: The Maintenance Technician installs, repairs and/or maintains mechanical equipment... 

K.A. Recruiting, Inc.

Histotechnician or Histotechnologist Job at K.A. Recruiting, Inc.

HISTOTECHS NEEDED AT TOP SUBURBAN CHICAGO CLINICAL LABORATORY Located in the suburbs of Chicago Full time midnight shift Sign on Bonus Responsible for the preparation of gross specimens, embedding tissues, processing tissue specimens, cutting tissues, performing all ...