Skip to content

 

Merrimack, New Hampshire - USD Full Time Posted: Thursday, 11 October 2018
 
 
Lead Data Engineer
job details:
  • location:Merrimack, NH
  • salary:$110 per hour
  • date posted:Thursday, October 4, 2018
  • job type:Contract
  • industry:Finance and Insurance
  • reference:646686
job description
Lead Data Engineer
job summary:
Description:
Designs, modifies, develops and implements software programming applications and components. Supports and/or installs software applications and components. Works from written specifications and pre-established guidelines to perform the functions of the job Primarily expertise in an emerging technology where there may be fewer available resources such as Hadoop, Actimize, Big Data, Dev Ops, Brio/BenXL/Blaze/Exadata/Hadoop/Hibernate/Netezza/RECON/RTC/SDL Tridion/SPS/SunGard/Sybase .
Job Responsibilities
  • Design, build, and implement scalable streaming data pipelines and ETL frameworks to increase data access and decrease analysis and decision times across the organization
  • Own software throughout the entire development life-cycle - design, code, test, automate & deploy
  • Share ideas to improve our product and processes, and provide feedback
What you'll bring to team
  • 15+ years of experience in defining data architecture solutions and establishing common data capabilities for enterprises
  • Proven experience in creating actionable Data and Analytics strategies for Compliance, Risk, Financial Intelligence business functions
  • Experience in defining technology blueprints, roadmaps and collaboratively defining solutions and enabling architecture capabilities
  • Experience in tool selection, conducting rapid PoCs and recommending use case appropriate technologies
  • 6+ years experience building distributed solutions in Spark, MapReduce and other MPP system with associated data models and datastores (e. g., Redshift, Cassandra, HBase, Parquet)
  • 2+ years of experience working with AWS Cloud data engineering stack including EC2, S3, EMR, Kinesis, Glue and other AWS Services
  • Hands-on experience with Apache Ni-Fi, Kafka, Python, Spark preferably on AWS
  • Experience with structured/unstructured/semi-structured data ingestion and processing
  • Experience with automation and deployment (Jenkins, CloudFormation,Chef etc.)
  • Experience writing high quality code in Python and one another OOP language (Java, Scala, C++, Go, etc)
  • Experience working with RDBM systems, particularly familiarity with SQL
  • Solid Experience in optimizing the Hive queries using Partitioning and Bucketing techniques, which controls the data distribution, to enhance performance.
  • Experience in working with UNIX Shell scripts.
  • Production development of event-based applications using frameworks such as Kinesis, Kafka, Spark Streaming, or similar
  • Familiarity with machine learning techniques, continuous deployment pipelines and tools.
  • Desire to work across internal teams to identify requirements and iterate on solutions
  • Debug complex production issues across various levels of the tech stack
location: Merrimack, New Hampshire
job type: Contract
work hours: 9am to 5pm
education: Bachelors
responsibilities:
  • Design, build, and implement scalable streaming data pipelines and ETL frameworks to increase data access and decrease analysis and decision times across the organization
  • Own software throughout the entire development life-cycle - design, code, test, automate & deploy
  • Share ideas to improve our product and processes, and provide feedback
qualifications:
  • Designs, modifies, develops and implements software programming applications and components.
  • Supports and/or installs software applications and components.
  • Works from written specifications and pre-established guidelines to perform the functions of the job
  • Primarily expertise in an emerging technology where there may be fewer available resources such as Hadoop, Actimize, Big Data, Dev Ops, Brio/BenXL/Blaze/Exadata/Hadoop/Hibernate/Netezza/RECON/RTC/SDL Tridion/SPS/SunGard/Sybase.
skills:
  • 15+ years of experience in defining data architecture solutions and establishing common data capabilities for enterprises
  • Proven experience in creating actionable Data and Analytics strategies for Compliance, Risk, Financial Intelligence business functions
  • Experience in defining technology blueprints, roadmaps and collaboratively defining solutions and enabling architecture capabilities
  • Experience in tool selection, conducting rapid PoCs and recommending use case appropriate technologies
  • 6+ years experience building distributed solutions in Spark, MapReduce and other MPP system with associated data models and datastores (e. g., Redshift, Cassandra, HBase, Parquet)
  • 2+ years of experience working with AWS Cloud data engineering stack including EC2, S3, EMR, Kinesis, Glue and other AWS Services
  • Hands-on experience with Apache Ni-Fi, Kafka, Python, Spark preferably on AWS
  • Experience with structured/unstructured/semi-structured data ingestion and processing
  • Experience with automation and deployment (Jenkins, CloudFormation,Chef etc.)
  • Experience writing high quality code in Python and one another OOP language (Java, Scala, C++, Go, etc)
  • Experience working with RDBM systems, particularly familiarity with SQL
  • Solid Experience in optimizing the Hive queries using Partitioning and Bucketing techniques, which controls the data distribution, to enhance performance.
  • Experience in working with UNIX Shell scripts.
  • Production development of event-based applications using frameworks such as Kinesis, Kafka, Spark Streaming, or similar
  • Familiarity with machine learning techniques, continuous deployment pipelines and tools.
  • Desire to work across internal teams to identify requirements and iterate on solutions
  • Debug complex production issues across various levels of the tech stack
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

Merrimack, New Hampshire, United States of America
IT
USD
Randstad
Randstad
JS2365_E9DD222E3FFF6AE429DA56F8DAB35950/537351176
10/11/2018 9:25:33 AM

We strongly recommend that you should never provide your bank account details to an advertiser during the job application process. Should you receive a request of this nature please contact support giving the advertiser's name and job reference.

Other jobs like this

Boston, Massachusetts
USD
Chestnut Hill, Massachusetts
USD
Boston, Massachusetts
USD
Boston, Massachusetts
See more