Reliability Engineer, Ai & Data Platforms

Apple

  • Austin, TX
  • Permanent
  • Full-time
  • 10 days ago
Join the AI and Data Platforms team at Apple, where we build and manage cloud-based data platforms handling petabytes of data at scale. We are looking for a passionate and independent Software Engineer specializing in reliability engineering for data platforms, with a strong understanding of data and ML systems. If you thrive in a fast-paced environment, love crafting solutions that don't yet exist, and possess excellent communication skills to collaborate across diverse teams, we invite you to contribute to Apple's high standards in an exciting and dynamic setting.DescriptionAs part of our team, you will be responsible for developing and operating our big data platform using open source or other solutions to aid critical applications, such as analytics, reporting, and AI/ML apps. This includes working to optimize performance and cost, automate operations, and identifying and resolving production errors and issues to ensure the best data platform experience.Responsibilities
  • Develop and operate large-scale big data platforms using open source and other solutions.
  • Support critical applications including analytics, reporting, and AI/ML apps.
  • Optimize platform performance and cost efficiency.
  • Automate operational tasks for big data systems.
  • Identify and resolve production errors and issues to ensure platform reliability and user experience
Minimum Qualifications
  • 3+ years of professional software engineering experience, with strong programming skills in languages such as Java, Scala, Python, or Go, preferably with critical, large-scale distributed systems.
  • Expertise in designing, building, and operating critical, large-scale distributed systems with a focus on low latency, fault-tolerance, and high availability.
  • Proven experience with data processing ecosystems and distributed computing frameworks like Spark or Flink, as well as MPP Query Engines such as Trino or Starrocks.
  • Experience designing and developing stateless APIs (e.g., HTTP) for service-oriented architectures across multi-cloud environments.
  • Proficiency with container orchestration (e.g., Kubernetes, Helm), CI/CD pipelines (e.g., GitHub Actions, Jenkins), and infrastructure as code tools (e.g., Terraform, Pulumi).
  • Strong troubleshooting and performance analysis skills in complex production environments, with proficiency in Unix/Linux operating systems and command-line tools.
Preferred Qualifications
  • Experience with contribution to Open Source projects is a plus.
  • Experience with multiple public cloud infrastructure, managing multi-tenant Kubernetes clusters at scale and debugging Kubernetes/Spark issues.
  • Experience with workflow and data pipeline orchestration tools (e.g., Airflow, DBT).
  • Understanding of data modeling and data warehousing concepts.
  • Familiarity with the AI/ML stack, including GPUs, MLFlow, or Large Language Models (LLMs).
  • A learning attitude to continuously improve the self, team, and the organization.
  • Solid understanding of software engineering best practices, including the full development lifecycle, secure coding, and experience building reusable frameworks or libraries.
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.

Apple