Big Data Platform Engineer

Company: Apple Inc.
Location: Santa Clara
Posted on: May 27, 2023

Job Description:

The SWE (Software) Data Analytics team at Apple collects, processes, and analyzes diagnostics and usage data from Apple devices across the world. We leverage streaming and batch analytics solutions to generate data that advises and drives product strategies across all of Apple software and hardware development. We discuss, analyze, and implement ground breaking solutions to problems of scale and distributed computing and are looking to expand our team with an engineer passionate about the big data workspace! Kafka, Flume, Hadoop, Spark, and other innovative technologies are core to our large scale infrastructure. You will be collaborating with data analysts, device engineers, and diverse engineering teams and drive the development of data pipelines and services with a high degree of ownership. Key Qualifications

• In-depth knowledge and experience in one or more large scale distributed technologies including but not limited to: Hadoop ecosystem, Kafka, Samza, Flink, Storm, Flume, HBase, Cassandra, Redshift, Vertica, Spark.
• Passion for and understanding of key algorithms and tools for developing high efficiency data processing systems.
• Proficient in working with Linux or other POSIX operating systems, shell scripting, and networking technologies.
• Problem-solving and debugging skills with experience in one or more of the following languages: Java, Python, Scala, Go, or Ruby.
• There is a lot of communication involved! Excellent interpersonal skills are highly valued. Description As part of a team of highly skilled data engineers you will own significant responsibility in crafting, developing and maintaining our large-scale ETL pipelines, storage, and processing services. You will build self-service analytics tools to help engineering teams derive concrete metrics out of large volumes of raw data. You will partner with data science and engineering teams and develop algorithms to answer sophisticated questions on usage of Apple products. You will work closely with the DevOps team and develop monitoring and alerting scripts on various data pipelines and jobs. You will have the opportunity to learn and work on the latest Big Data technologies, lead PoCs to exercise new insights and, influence the strategic direction of our technology stack. Education & Experience Bachelors in Computer Science or equivalent experience Additional Requirements
  • - Experience using data storage technologies such as Apache Parquet or Avro Experience in machine learning algorithms is a plus.
  • - Testing tools and methodologies to test large scale distributed computing systems.
  • - Experience in data modeling and developing SQL database solutions is a plus.
  • - Validated software engineering experience and field in design, test, source code management, and CI/CD practices.

Keywords: Apple Inc., Santa Clara , Big Data Platform Engineer, Engineering , Santa Clara, California