(Hadoop) IT Architect
First Data - New York, NY

This job posting is no longer available on First Data. Find similar jobs: IT Architect jobs - First Data jobs

Business Segment Overview First Data’s Retail and Alliance Services (RAS) business is a leading provider of payment solutions, processing 58 billion transactions annually at more than six million merchant locations worldwide. First Data has the largest distribution network in the industry, partnering with thousands of financial institutions, ISO’s and sales agents to service merchants large and small across the globe.

We help merchants simplify payment processing and improve the customer experience with our broad portfolio of solutions, including: credit and debit card processing; point of sale terminals and deployment services via our subsidiary, TASQ Technology; gift card and loyalty solutions; TeleCheck® electronic check acceptance services; MoneyNetwork® payroll distribution; eCommerce and mobile payment solutions; and world-class security services, like our TransArmorSM Solution. " > Job Description
This position will be provide senior-level design and planning of the Big Data Environment for items such as security, Hadoop hardening, and design of critical data ingestion and consumption processes.

This position will work in a fast-paced agile development environment to quickly analyze, develop, and test potential use cases for the business; take valid use cases from ideation through development to production; design efficient high-performing applications to extract, transform, load, and query very large datasets.

Responsible for developing standards and new design patterns for Big Data applications; along with understanding MapReduce concepts and master the tools and technology components within the Cloudera Hadoop ecosystem.

Position will also be tasked helping formulate use cases from potentially ambiguous business requirements, provide timely communication to business partners on use cases and project status along with mentoring and assisting other developers as well as users as they query and analyze the data. Job Specific Responsibilities

Design and implement map reduce jobs to support distributed processing using java, python, hive and pig; Ability to design and implement end to end solution.

Build libraries, user defined functions, and frameworks around Hadoop

Research, evaluate and utilize new technologies/tools/frameworks around Hadoop eco system

Develop user defined functions to provide custom hive and pig capabilities

Mentor other developers in the team

Define and build data acquisitions and consumption strategies

Define & develop best practices

Work with support teams in resolving operational & performance issues

Work with architecture/engineering leads and other teams on High Availability, Security, Capacity Planning

Work with Infrastructure/Operations team on configuration/upgrades of the cluster

Candidate Requirements

10+ years’ experience in large-scale software development dealing with information systems

1+ year experience in Hadoop (Cloudera preferred)

Strong knowledge of data structures, algorithms and enterprise systems

Deep understanding of web services software architectural and design issues

Strong Java programming, Spring framework, shell scripting, Python, and SQL

Strong development skills around Hadoop, MapReduce, Hive, Pig, HBase, Flume & Oozie

Strong understanding of Hadoop internals

Experience with build tools such as Maven

Experience with cloud development ecosystems, Amazon, Google

Experience with databases like Oracle, Netezza, MySQL/PostgresSQL

Experience with performance/scalability tuning, algorithms and computational complexity

Experience (at least familiarity) with data warehousing, data integration (real-time and batch), reporting, query and analysis

Proven ability to work cross functional teams to deliver appropriate resolution

Ability to handle multiple competing priorities in a fast-paced environment

Experience with open source NOSQL technologies such as HBase and Cassandra

Experience with Cloudera Impala (Nice to have)

Experience with Storm (Nice to have)

Scala programming (Nice to have)

Machine learning framework (Nice to have)

Statistical analysis with Python, R or similar (Nice to have)

MS/BS degree in a computer science field or related discipline

First Data - 7 months ago - save job
About this company
677 reviews
Whether you are just beginning your career or have many years of experience, First Data can provide you with a wealth of exciting challenges...