Big Data Engineer in San Jose at PayPal

Date Posted: 8/3/2019

Job Snapshot

Job Description

Fueled by a fundamental belief that having access to financial services creates opportunity, PayPal (NASDAQ: PYPL) is committed to democratizing financial services and empowering people and businesses to join and thrive in the global economy. Our open digital payments platform gives PayPal’s 286 million active account holders the confidence to connect and transact in new and powerful ways, whether they are online, on a mobile device, in an app, or in person. Through a combination of technological innovation and strategic partnerships, PayPal creates better ways to manage and move money, and offers choice and flexibility when sending payments, paying or getting paid. Available in more than 200 markets around the world, the PayPal platform, including Braintree, Venmo and Xoom enables consumers and merchants to receive money in more than 100 currencies, withdraw funds in 56 currencies and hold balances in their PayPal accounts in 25 currencies.

The Global Product Data Services is a newly formed team in the Payments organization under Customer Experiences and Technology. Its vision is to “Provide Enterprise Product Data at lower cost and better quality”. To achieve this vision, we are looking for people with a passion and curiosity to solve customer problems with data. The internal stakeholders for the Program include but are not limited to PayPal Inc.’s Product Teams, Accounting and Finance, Sales, Risk, Customer Service, Treasury and Strategy Teams. Our External stakeholders include Regulators, Customers, Third Party Service Providers and Banks. GPDS is looking for motivated and experienced big data engineers, to join a highly skilled team of experienced professionals, which believe in best-of-breed software craftsmanship, clean and elegant coding, using the right tool for the job, and always exploring and learning new technologies and approaches. This Big Data Developer will work on a high volume data pipeline, data integration hub, data transformation with Transaction State Management. This involves working across PayPal and its subsidiaries to ingest payments, contextual and end to end transaction state data into an Operational Data Store for downstream analytics by multiple stakeholders. There will be four pillars of activities in this initiative. They are the following: 1. A Real time enterprise wide data integration hub (iHub) 2. High volume data processing to create transaction state instrumentation 3. Near Real Time Operational Data Store 4. First line Data Governance


As an engineer, you will be responsible for working on applications and services that handle all types of PayPal transactions. You will work in a fast-paced environment where continuous innovation and experimentation are a given. You will master both established and cutting-edge technologies like Hive, Spark, Presto, Hadoop, Oracle, Casandra, Storm, Kafka, Druid, MongoDB, CouchBase among others.

Typical GPDS team engineer responsibilities include:

  • Design, development, and testing of features/functions delivered via applications and services
  • Collaborating with peers and seniors both within their team and across the organization
  • Working with product managers using agile methodologies to deliver high quality solutions on time
  • Working with operations teams to ensure your applications and services are highly available and reliable
  • Supporting your applications and/or services as and when required on a 24x7 basis

Successful GPDS team engineers will:

  • Design, develop, test, and debug large scale complex platform using big data technologies.
  • Develop tools and automation for the effective management and operation of PayPal’s big data platform.
  • Analyze and improve stability, efficiency, and scalability of the platform.
  • Collaborate with architects, engineers, and business on product design and feature.
  • Hadoop development, debugging, and implementation of workflows and common algorithms
  • Apache Hadoop and data ETL (extract, transform, load), ingestion, and processing with Hadoop tools
  • Knowledge of building a scalable and integrated Data Lake for an Enterprise
  • Use the HDFS architecture, including how HDFS implements file sizes, block sizes, and block abstraction. Understand default replication values and storage requirements for replication. Determine how HDFS stores, reads, and writes files.
  • Be driven to get results and not let anything get in your way
  • Be proactive and anticipate/handle most issues before they blowup
  • Exhibit a strong backbone and challenge the status quo when needed
  • Demonstrate a high level of curiosity and keep abreast of the latest technologies
  • Show pride of ownership and strive for excellence in everything they do

Job Requirements:

  • 2 + years software development experience
  • BS in Computer Science or related degree required. MS preferred
  • Expert in SQL, Hive, Spark, Presto
  • Expert in Hadoop, HBase, Yarn
  • Expert on Big Data Technologies such as Kafka, Apache Spark
  • Experience in database/storage technologies like Oracle, Cassandra, CouchBase and so on.
  • Competent in design/implementation for reliability, availability, scalability and performance
  • Competent in software engineering tools and best practices

EDUCATIONAL REQUIREMENT: Master’s degree, or foreign equivalent, in Computer Science, Engineering or closely related quantitative discipline or Bachelor’s degree, or foreign equivalent, in Computer Science, Engineering, or closely related quantitative discipline


With a Master’s degree: One (1) year of experience in the job offered or one (1) year of experience in the field of software engineering or program analysis.

With a Bachelor’s degree: Two (2) years of experience in the job offered or two (2) years of progressively responsible experience in the field of software engineering or program analysis.

We're a purpose-driven company whose beliefs are the foundation for how we conduct business every day. We hold ourselves to our One Team Behaviors which demand that we hold the highest ethical standards, to empower an open and diverse workplace, and strive to treat everyone who is touched by our business with dignity and respect. Our employees challenge the status quo, ask questions, and find solutions. We want to break down barriers to financial empowerment. Join us as we change the way the world defines financial freedom.

PayPal provides equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, pregnancy, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, PayPal will provide reasonable accommodations for qualified individuals with disabilities.



  1. Software Engineer Jobs
  2. Project Engineer Jobs