Hadoop Developer in New York, NY at Open Systems Technologies

Date Posted: 10/16/2019

Job Snapshot

  • Employee Type:
    Full-Time
  • Location:
    New York, NY
  • Job Type:
  • Experience:
    At least 5 year(s)
  • Date Posted:
    10/16/2019

Job Description

Our client is seeking a Senior Hadoop Developer to assist the team in solving challenges of large-scale data storage, low-latency retrievals, high volume requests and high availability over a distributed environment. This candidate will help refresh and evolve many facets of the data and analytics infrastructure for several systems. This is part of an initiative to help standardize the storage backends and structure data flows across our systems to improve discoverability and data provenance. Price History is our canonical end of day time series datastore. It is a distributed analytics framework that allows internal and external users to express complex data retrieval, analytics and screening criteria.

Responsibilities:

  • Interact with development teams and understand their application requirements and access patterns
  • Design and develop systems that meet our latency, volume, storage and scale expectations
  • Participate in daily scrums to help influence architectural decisions

Skills:

  • 5+ years of experience programming in Java
  • 3+ years of experience with Hadoop/HDFS/MapReduce
  • 3+ years of experience with NoSQL data stores (preferably HBase or Cassandra)
  • Experience developing, enhancing and maintaining high throughput, low-latency Hadoop systems in a mission-critical production environment
  • Experience working in a Test Driven and Agile development environment
  • Experience enhancing and maintaining mission-critical software in a fast-paced environment
  • Experience with Spark, Kafka, Oozie, Zookeeper, Flume or Storm
Job category:
  • Information Technology
Job keywords:
  • Hadoop
  • Big Data