Business Segment Overview First Data’s Retail and Alliance Services (RAS) business is a leading provider of payment solutions, processing 58 billion transactions annually at more than six million merchant locations worldwide. First Data has the largest distribution network in the industry, partnering with thousands of financial institutions, ISO’s and sales agents to service merchants large and small across the globe.
We help merchants simplify payment processing and improve the customer experience with our broad portfolio of solutions, including: credit and debit card processing; point of sale terminals and deployment services via our subsidiary, TASQ Technology; gift card and loyalty solutions; TeleCheck® electronic check acceptance services; MoneyNetwork® payroll distribution; eCommerce and mobile payment solutions; and world-class security services, like our TransArmorSM Solution. " > Job Description
This position will be provide senior-level design and planning of the Big Data Environment for items such as security, Hadoop hardening, and design of critical data ingestion and consumption processes.
This position will work in a fast-paced agile development environment to quickly analyze, develop, and test potential use cases for the business; take valid use cases from ideation through development to production; design efficient high-performing applications to extract, transform, load, and query very large datasets.
Responsible for developing standards and new design patterns for Big Data applications; along with understanding MapReduce concepts and master the tools and technology components within the Cloudera Hadoop ecosystem.
Position will also be tasked helping formulate use cases from potentially ambiguous business requirements, provide timely communication to business partners on use cases and project status along with mentoring and assisting other developers as well as users as they query and analyze the data. Job Specific Responsibilities
Design and implement map reduce jobs to support distributed processing using java, python, hive and pig; Ability to design and implement end to end solution.
Build libraries, user defined functions, and frameworks around Hadoop
Research, evaluate and utilize new technologies/tools/frameworks around Hadoop eco system
Develop user defined functions to provide custom hive and pig capabilities
Mentor other developers in the team
Define and build data acquisitions and consumption strategies
Define & develop best practices
Work with support teams in resolving operational & performance issues
Work with architecture/engineering leads and other teams on High Availability, Security, Capacity Planning
Work with Infrastructure/Operations team on configuration/upgrades of the cluster
10+ years’ experience in large-scale software development dealing with information systems
1+ year experience in Hadoop (Cloudera preferred)
Strong knowledge of data structures, algorithms and enterprise systems
Deep understanding of web services software architectural and design issues
Strong Java programming, Spring framework, shell scripting, Python, and SQL
Strong development skills around Hadoop, MapReduce, Hive, Pig, HBase, Flume & Oozie
Strong understanding of Hadoop internals
Experience with build tools such as Maven
Experience with cloud development ecosystems, Amazon, Google
Experience with databases like Oracle, Netezza, MySQL/PostgresSQL
Experience with performance/scalability tuning, algorithms and computational complexity
Experience (at least familiarity) with data warehousing, data integration (real-time and batch), reporting, query and analysis
Proven ability to work cross functional teams to deliver appropriate resolution
Ability to handle multiple competing priorities in a fast-paced environment
Experience with open source NOSQL technologies such as HBase and Cassandra
Experience with Cloudera Impala (Nice to have)
Experience with Storm (Nice to have)
Scala programming (Nice to have)
Machine learning framework (Nice to have)
Statistical analysis with Python, R or similar (Nice to have)
MS/BS degree in a computer science field or related discipline
First Data - 7 months ago
Whether you are just beginning your career or have many years of experience, First Data can provide you with a wealth of exciting challenges...