Python developer with Spark AWS Job at Conch Technologies Inc, Columbus, OH

YUtzRXlGSkFlMzBTNjRoYlQ5TGQ0VGRBQmc9PQ==
  • Conch Technologies Inc
  • Columbus, OH

Job Description

Hi

Greetings from Conch Technologies Inc

Job Title: Python Spark AWS

Location: Columbus OH nonlocal candidates accepted

Duration: 12 Months COntract or Direct Fulltime

Job Responsibilities:

Develop and maintain data platforms using Python Spark and PySpark.
Handle migration to PySpark on AWS.
Design and implement data pipelines.
Work with AWS and Big Data.
Produce unit tests for Spark transformations and helper methods.
Create Scala/Spark jobs for data transformation and aggregation.
Write Scaladocstyle documentation for code.
Optimize Spark queries for performance.
Integrate with SQL databases (e.g. Microsoft Oracle Postgres MySQL).
Understand distributed systems concepts (CAP theorem partitioning replication consistency and consensus).

Skills:
Proficiency in Python Scala (with a focus on functional programming) and Spark.
Familiarity with Spark APIs including RDD DataFrame MLlib GraphX and Streaming.
Experience working with HDFS S3 Cassandra and/or DynamoDB.
Deep understanding of distributed systems.
Experience with building or maintaining cloudnative applications.
Familiarity with serverless approaches using AWS Lambda is a plus

With Regards



Teja Maripeti

Desk:

Email: t

Web:

Job Tags

Full time, Contract work,

Similar Jobs

Marion County Public Schools

Electrician Helper Job at Marion County Public Schools

REPORTS TO: COORDINATOR II OF TECHNICAL SERVICES For more information, visit: POSITION SUMMARY: This is a skilled position which applies electrical code and theory in the installation, replacement, and repair of electrical systems common to the equipment and electrical...

Agile Consulting Group, Inc.

Lead Generation Specialist Job at Agile Consulting Group, Inc.

 ...support our sales and marketing efforts. As a Lead Generation Specialist, you'll play a key role in driving growth by ensuring our lead...  ...databases we subscribe to, as well as Google Top candidates will read prior notes and leave short but detailed updates Collaborate... 

DEMIX TRANSPORT INC

Owner Operator - Box Truck / Sprinter (Cargo) Van Job at DEMIX TRANSPORT INC

 ...EIN & Business Bank Account ~ COI: $1 mln Auto Liability & $100k Cargo (with unlimited radius)~ Vehicle 2010 or newer ~6+ months...  ...old ~ Clean Driving Record Equipment Accepted: Sprinter Van / Cargo Van, Box Truck, Reefer Van/Truck, Curtain Side Truck How... 

The Structures Company

Chief Financial Officer (CFO) Job at The Structures Company

 ...Job Title: Chief Financial Officer (CFO) Location: Remote (U.S.-based) Employment Type: Full-Time Salary: Up to $180,000 DOE + benefits We are a national aerospace and defense staffing agency seeking a highly qualified candidate to join our... 

Graphic Packaging International, Inc.

Inspector - Packer Job at Graphic Packaging International, Inc.

 ...team player, 18 years old or older, with a great work ethic! No experience, no problem! We will train you! No high school diploma/GEDNO PROBLEM! Whats in it for you? Excellent starting pay. Opportunity to move into skilled operator roles...