Big Data Developer in New York, NY at Open Systems Technologies

Date Posted: 11/7/2019

Job Snapshot

  • Employee Type:
    Full-Time
  • Location:
    New York, NY
  • Job Type:
  • Experience:
    At least 5 year(s)
  • Date Posted:
    11/7/2019

Job Description

Our client is hiring a Senior Developer to join the our Enterprise Architecture group. You will assist in developing Big Data Architecture and will interact with the Global IT team in Capital Markets. 

Responsibilities:

  • Develop Big Data architecture, specifically the Hadoop stack (HDFS cluster, MapReduce, Hive, Kafka, Spark, Elasticsearch and NoSQL)
  • Migrate Data from relational databases to Hadoop HDFS
  • Hands on development  in Java and Python
  • Assist and support proof of concepts as Big Data technology evolves
  • Ensure solutions adhere to security and data entitlements
  • Translate functional and technical requirements into detailed design

Skills:

  • 5+ years’ experience developing in Big Data architecture, Hadoop stack
  • 5+ years’ experience in data migration from relational databases to Hadoop HDFS
  • 7+ years hands on development experience in Java and Python
  • 7+ years hands-on experience working in RDBMS such as Oracle, DB2, MySQL and PostgresSQL
  • 5+ years hands-on experience writing SQL and working in Data Warehouse developing ETL processes
  • Hands-on experience writing stream processing pipelines
  • Hand-on experience with iLabs and Enterprice Integration Patterns
  • Translate, load and present disparate data sets in multiple formats including JSON
  • Translate functional and technical requirements into detailed design
  • Experience in analysis of data stores and help with data analytics
Job category:
  • Information Technology
Job keywords:
  • Big Data
  • Hadoop
  • Developer
  • Cluster
  • Relational Database
  • Java
  • Python
  • Oracle