Sr. Datawarehouse Developer in Chevy Chase, MD at Open Systems Technologies

Date Posted: 10/14/2019

Job Snapshot

  • Employee Type:
    Contractor
  • Job Type:
  • Experience:
    Not Specified
  • Date Posted:
    10/14/2019

Job Description

An insurance company is currently seeking a Sr. Datawarehouse Developer to join their team in Chevy Chase, MD.

Responsibilities

  • Develop ETL/ELT jobs on the Hadoop platform using Spark and other BigData technologies
  • Design needed transformations, mapping data from source to target for jobs on platform
  • Develop and use frameworks for data transformation
  • Create and schedule jobs with Oozie and other job coordinators
  • Monitor and optimize transformation logic
  • Testing and documenting results
  • Troubleshooting and triaging problems including performance issues
  • Communicating with end customers, and teammates to work in collaborative environment

Qualifications

Required

  • 3 years of hands-on experience in Hadoop Eco System (HDFS, YARN, MapReduce, Oozie and Hive)
  • 2 years of hands-on experience in Spark core, Scala and Spark SQL

Desired

  • Experience in any one of the ETL tools such as Abinitio Talend or Kettle
  • Hadoop or NoSQL performance optimization and benchmarking using tools such as HiBench or YCSB
  • Experience on continuous build and test process using tools such as Gradle or Maven and Jenkins
  • Understanding of Kafka and Spark Streaming
  • Experience with Graph Databases
Job keywords: