This site uses cookies. To find out more, see our Cookies Policy

Big Data Platform Engineer in San Jose at PayPal

Date Posted: 4/2/2019

Job Snapshot

Job Description

Fueled by a fundamental belief that having access to financial services creates opportunity, PayPal (NASDAQ: PYPL) is committed to democratizing financial services and empowering people and businesses to join and thrive in the global economy. Our open digital payments platform gives PayPal’s 267 million active account holders the confidence to connect and transact in new and powerful ways, whether they are online, on a mobile device, in an app, or in person. Through a combination of technological innovation and strategic partnerships, PayPal creates better ways to manage and move money, and offers choice and flexibility when sending payments, paying or getting paid. Available in more than 200 markets around the world, the PayPal platform, including Braintree, Venmo and Xoom enables consumers and merchants to receive money in more than 100 currencies, withdraw funds in 56 currencies and hold balances in their PayPal accounts in 25 currencies.

The Big Data Platform Engineering Team is looking for a highly talented, self-driven, proven software engineer to help design and build core data services that deal with big data (>90PB) at low latency (i.e. sub-second) for a variety of use-cases spanning near-real time analytics and machine intelligence. You will have significant responsibility and influence in shaping the future of big data platform engineering at PayPal. This position involves hiring and leading a data engineering team to develop the large-scale data warehouse, ETL pipelines and analytical solutions using modern big data technologies on big data ecosystem. Successful candidates will have strong leadership, engineering skills, and communication, as well as a belief that data-driven processes lead to great products.

As a Big Data Engineer, you will design, develop, test and debug large scale complex data platform using cloud and big data technologies. This role will involve working closely with the Data Scientists, Engineers & Analysts.

Job Responsibilities:

  • Develop web applications and tools for the effective management and operation of PayPal’s  big data platform
  • Be hands-on in leading and performing development work during the production cycle.
  • Design and develop data structures that support high performing and scalable analytic applications.
  • Work closely with Data science to integrate amazing innovations and algorithms into data lake systems.
  • Think out of the box - don't be afraid to innovate!
  • Co-develop & follow best practices related to SDLC (Software Development Life Cycle) & agile methods to raise the level of automation and quality in our code repositories
  • Embrace open-source – either by using it, extending it, or inventing new projects.
  • Share your work with the world-at-large via authoring blogs & articles, contributing to open source projects, and by speaking internally (and external to PayPal).
  • Mentor colleagues in order to help develop strong coding practices and standards across the organization.

Qualifications and Requirements  

  • Bachelors or Masters in Computer Science.

  • Minimum 8 years of industry experience. 5+ years of experience in building and managing highly scalable, reliable, available, resilient, distributed and parallel computing systems.

  • Experience of developing large distributed systems using core Java and/or Scala Experience in at least one scripting language such as Python.

  • Proficient in Container-based solutions such as Dockers & Kubernetes.

  • Strong real-world experience with one or more of the following technologies at scale is required:​
    • Stream processing ecosystem (e.g. Kafka, Storm). Kafka is preferred.
    • Hadoop ecosystem technologies (e.g. Yarn, HDFS, Presto, Spark, Flink, Beam). Spark/Flink is preferred.
    • NoSQL/Document/OLAP (e.g. Hbase, Cassandra, Aerospike, Elastic, Druid, Mongo). Hbase/Cassandra/Aerospike is preferred.
  • Outstanding architectural and implementation skills are required
  • Experience in developing large-scale data platforms and analytic systems is required. Ability to understand and explain complex systems.
  • Basic SQL experience is required.
  • Any open-source contribution or external conference talk is definitely a plus.
  • Ability to adapt to new technologies / programming paradigms with ever changing technology landscape.
  • Ability to coach and mentor fellow team members
  • Ability to work well in a team environment and be able to effectively drive cross-team solutions that have complex dependencies and requirements in a fast-paced environment

We're a purpose-driven company whose beliefs are the foundation for how we conduct business every day. We hold ourselves to our One Team Behaviors which demand that we hold the highest ethical standards, to empower an open and diverse workplace, and strive to treat everyone who is touched by our business with dignity and respect. Our employees challenge the status quo, ask questions, and find solutions. We want to break down barriers to financial empowerment. Join us as we change the way the world defines financial freedom.

PayPal provides equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, pregnancy, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, PayPal will provide reasonable accommodations for qualified individuals with disabilities.



  1. Software Engineer Jobs
  2. Project Engineer Jobs