
Staff Software Engineer, Backend - Kai
- Miami, FL
- Permanent
- Full-time
- Build and Maintain Service Architecture: Architect and implement reliable, scalable backend services to support the application, including services that power AI/LLM-driven functionality.
- Drive Infrastructure Improvements: Partner with the infrastructure team to evolve CI/CD pipelines, service deployment patterns, and AI model/service integration pipelines.
- Mentor and Lead by Example: Lead technical development with knowledge of up-to-date best practices, and guide other engineers through code reviews, architectural discussions, and technical decision-making.
- Design for Scalability and Resilience: Build systems that handle growth gracefully and are resilient to failure across distributed environments, including AI-inference workloads.
- Evolve Messaging and Integration Patterns: Contribute to the adoption and evolution of event-driven architectures and asynchronous service communication using tools like Kafka or similar.
- Champion Developer Productivity: Ensure our tooling provides developers with the best environment to develop locally, test, and ship their code, including local AI testing workflows.
- Continuously Improve Systems: Proactively identify bottlenecks and technical debt, leading efforts to improve platform stability, AI performance, and user experience
- 8+ years of professional software engineering experience.
- Strong proficiency in backend programming languages (e.g., Python, Go, Java, or similar).
- Experience with event-driven architectures and message brokers (e.g., Kafka, Kinesis, RabbitMQ).
- Knowledge of security and compliance considerations.
- Deep understanding of service-oriented architecture and microservices best practices.
- Prior experience in a fast-paced startup environment.
- Proficiency with cloud platforms such as AWS or GCP.
- Ability to identify problems/opportunities, break them down into critical parts, and design scalable solutions.
- Hands-on experience with CI/CD pipelines, infrastructure automation, and deployment strategies.
- Strong knowledge of RESTful APIs and/or gRPC.
- Experience writing unit and integration tests to ensure high-quality software.
- Experience with Docker and container orchestration platforms such as Kubernetes or ECS.
- Proficiency in SQL and experience with relational databases such as Postgres or MySQL.
- Strong experience with peer code reviews, offering and receiving constructive feedback to maintain and elevate coding standards.
- Exposure to frontend architecture (e.g., React)
- Familiarity with content delivery networks (CDNs) and caching strategies.
- Familiarity with E2E testing systems (e.g. Playwright)
- Familiarity with integrating and scaling backend systems that interact with Large Language Models (LLMs).
- Experience with API gateways (e.g., Kong, AWS API Gateway).
- Familiarity with service meshes (e.g., Dapr, Linkerd, Istio).
- Experience with observability tools and practices, including distributed tracing, logging, and monitoring.
- Production experience integrating LLMs or AI services (e.g., OpenAI, Anthropic, or fine-tuned in-house models) into scalable backend systems.
- Understanding of AI system design, including prompt orchestration, retrieval-augmented generation (RAG), and model lifecycle management.
- Experience building APIs or services that expose AI-driven functionality to end users.
- Awareness of trust, safety, and security concerns in AI systems, including prompt injection, data privacy, and auditability.