R&D AI Software Engineer / End-to-End Machine Learning Engineer / RAG and LLM

Pathway

  • Palo Alto, CA
  • Permanent
  • Full-time
  • 1 month ago
  • Apply easily
About PathwayPathway is building LiveAI™ systems that think and learn in real time as humans do. Our mission is to deeply understand how and why LLMs work, fundamentally changing the way models think.The team is made up of AI luminaries. Pathway's CTO, Jan Chorowski, co-authored papers with Geoff Hinton and Yoshua Bengio and was one of the first people to apply attention to speech. Our CSO, Adrian Kosowski, received his PhD in Theoretical Computer Science at the age of 20 and made significant contributions across numerous scientific fields, including AI and quantum information. He also served as a professor and a coach for competitive programmers at Ecole Polytechnique. The team also includes numerous world's top scientists and competitive programmers, alongside seasoned Silicon Valley executives.Pathway has strong investor backing. To date, we have raised over $15M; Our offices are located in Palo Alto, CA, as well as Paris, France, and Wroclaw, Poland.The OpportunityWe are currently searching for 2 ML/AI Engineers with a solid software engineering backbone who are able to prototype, evaluate, improve, and productionize end-to-end Machine Learning projects with enterprise data.For representative examples of the type of projects you would be expected to create or deliver, see our .If you would consider it would be fun to create a hybrid Vector/Graph index that beats the state of the art on a RAG benchmark, to deliver a working AI pipeline to a client in a critical industry, or to pre-process datasets in a way which would boost LLM accuracy in inference & training - this is the job for you!You Will
  • help design experimental end-to-end ML/AI pipelines
  • contribute to addressing new use cases, beyond state of the art
  • improve/adapt AI pipelines for production, working directly with client data (often live data streams)
  • invent ways to pre-process data sources and perform tweaks (reranking, model paramater configuration...) for optimal performance of AI pipelines.
  • design benchmark tasks and perform experiments.
  • build unit tests and implement model monitoring.
  • contribute high-quality production code to our developer frameworks, used by thousands of developers.
  • help to pre-process data sets for LLM training.
The results of your work will play a crucial role in the success of both our developer offering and client delivery.RequirementsCover letterIt's always a pleasure to say hi! If you could leave us 2-3 lines, we'd really appreciate that.You Are
  • A graduate of a 4+-year university degree in Computer Science, where you have received A-grades in both foundational courses (Algorithms, Computational Complexity, Graph Theory,...) and Machine Learning courses.
  • Passionate about delivering high-quality code and solutions that work.
  • Good with data & engineering innovation in practice - you know how to put things together so that they don't blow up.
  • Experienced at hands-on Machine Learning / Data Science work in the Python stack (notebooks, etc.).
  • Experienced with model monitoring, git, build systems, and CI/CD.
  • Respectful of others
  • Curious of new technology - an avid reader of HN, arXiv feeds, AI digests, ...
  • Fluent in English
Bonus Points
  • Successful track-record in algorithms (ICPC / IOI), data science contests (Kaggle), or a HuggingFace leaderboard.
  • Showing a code portfolio.
  • PhD in Computer Science.
  • Authoring a paper at major Machine Learning conference.
  • You like playing/tinkering with new tools in the LLM stack.
  • You are already a part of the Pathway community, or have been recognized for your work in one of our bootcamps.
Why You Should Apply
  • Join an intellectually stimulating work environment.
  • Be a technology innovator that makes a difference: your code gets delivered to a community of thousands of developers, and to clients processing billions of records of data.
  • Work in one of the hottest AI startups, that believes in impactful research and foundational changes.
Benefits
  • Type of contract: Full-time, permanent
  • Preferable joining date: January 2025. The positions are open until filled – please apply immediately.
  • Compensation: competitive base salary (80th to 99th percentile) based on profile and location + Employee Stock Option Plan + possible bonuses if working on client projects. The stated lower band of EUR 72k/ USD 75k for the salary base concerns senior candidates; mid-senior or mid candidates may be considered with adapted salary bands.
  • Location: Remote work. Possibility to work or meet with other team members in one of our offices: Palo Alto, CA; Paris, France or Wroclaw, Poland. As a general rule, permanent residence will be required in the EU, UK, US, or Canada.
(Note for candidates based in India: We are proud to be part of the current as well as a partner of ICPC India. Top IIT/IIIT graduates are more than welcome to apply regardless of current location. )If you meet our broad requirements but are missing some experience, don’t hesitate to reach out to us.

Pathway