
Software Engineer II (AI Tooling)
- Boston, MA
- Permanent
- Full-time
- Design, develop, and deploy internal AI tools powered by large language models, including natural language to SQL query generation, AI-driven translation and summarization services, and other productivity-enhancing tools
- Develop tools that enable efficient machine learning model training, support the integration of models into the WHOOP production environments, and improve access to data at WHOOP.
- Build robust APIs, services, and user interfaces to expose AI tools to internal users.
- Integrate AI models into operational workflows, ensuring low latency and high reliability.
- Collaborate with Product Managers, Software Engineers, Data Scientists, and end users to define product requirements and iterate on solutions.
- Own the full development lifecycle and contribute to the platform infrastructure supporting LLM and ML applications.
- Monitor and improve the performance, quality, and cost-efficiency of AI-powered tools.
- Stay current with advances in generative AI, LLMs, and agentic systems; evaluate new technologies for adoption.
- Proficient in software engineering with experience in Python (preferred), Java, or Scala.
- Experience with front-end frameworks like VueJS, ReactJS, or NextJS is preferred but not required.
- Experience, professional or personal, working with or integrating large language models (e.g., OpenAI, Anthropic, Hugging Face Transformers).
- Familiarity with prompt engineering, fine-tuning, or retrieval-augmented generation (RAG) techniques.
- Familiar with data storage and processing technologies such as Snowflake, S3, Spark, and relational databases
- Demonstrated ability to turn ambiguous internal problems into scoped engineering solutions.
- Effective communicator with a collaborative mindset and experience working across cross-functional teams.