Lead Software Engineer - Python/Scala, Spark and hadoop Job Listing at Mastercard in Pune, MH (Job ID R-207620)

Description

Our Purpose

We work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team – one that makes better decisions, drives innovation and delivers better business results.

Title and Summary

Lead Software Engineer - Python/Scala, Spark and hadoop Overview

As a Lead Software Development Engineer in the Mastercard Data & Services Technologies team, you will play a valuable role within a successful and rapidly growing business unit, working closely with experienced and motivated engineers to solve challenging problems. As a member of the Mastercard D&S Technical Foundations Team, you will bring your technical knowledge and full stack development experience to help build, deploy, and scale our data pipeline to support the needs of many analytical products in our ecosystem. The Technical foundations team builds scalable, easy-to-use services and frameworks that provide the foundation for many of Mastercard's customer-facing applications. We work closely with market-facing product engineering teams to help them take maximum advantage of these capabilities and to evolve our platform to meet their needs and the needs of our customers. We are looking for a Software Engineering Manager who is excited to engage deeply with our core technologies, design and implement a highly scalable data pipeline using modern and big-data focused scale-out technologies (distributed storage, scale-out compute, elastic resources in the cloud).

Our engineers work in small, flexible teams. Every team member contributes to feature design, building, and testing. There are no rigid organizational structures at Mastercard; each team uses processes that work the best for that team's members and projects.

Position Responsibilities

Implement scalable and efficient data architectures using technologies like Hadoop, Impala, Hive, Spark on-premises.
Evaluate and recommend new technologies and approaches to improve the performance, scalability, and reliability of our software systems
Build out a data pipeline and compute tier that operates on Hadoop and Impala/Spark
Critically review the code and guide the team with a focus on improving the code quality
Lead large scale projects from inception to release
Provides strategic leadership related to engineering process, specific applications and systems, or software-development methodologies
Serve as a technical resource for team members and mentor junior engineers
Collaborate with partners teams across broader Mastercard (Software Delivery, Corporate Security, Privacy and Data Protection, Global Product Management) to deliver high-quality solutions that meet business requirements
Ensure that code is well-designed, maintainable, and adheres to best practices and standards
Play a key role in shaping the direction of engineering practices through working on a scrum-size team empowered to organize and run the team as they see fit

Additional Tasks As Required

All About you:

Experience in full stack software development with a focus on data-driven applications
Experience with scale-out technologies like Hadoop, Impala, Hive and Spark on-premise
Strong understanding of database technologies, proficiency with SQL
Experience working with .NET and C# technologies
Background in big data with hands-on experience with Impala or Spark development
Strong knowledge of the architecture and internals of technologies in the Hadoop ecosystem is a plus
Experience with data modeling and data architecture design
Proficiency with advanced object-oriented programming
Excellent problem-solving and analytical skills
Excellent written and oral communications skills
Ability to mentor and lead junior team members
Bachelor's degree in Computer Science, Computer Engineering, Software Engineering or a related field

Corporate Security Responsibility

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

• Abide by Mastercard's security policies and practices;

• Ensure the confidentiality and integrity of the information being accessed;

• Report any suspected information security violation or breach, and

• Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.

 Apply on company website