ML Engineering Lead (LLM Ops)
Neko
2 weeks ago
HybridFull_timellm operationsrag systemsclinical machine learning
2 weeks ago
Workplace
Hybrid
Employment
Full_time
Posted
2 weeks ago
Summary
The ML Engineering Lead (LLM Ops) owns the operational lifecycle of Neko's LLM, GenAI, and RAG systems. The role builds production ML platforms for clinical workflows and proprietary sensor data in a regulated medical-device environment.
Responsibilities
- Deploy and monitor production llm pipelines
- Build evaluation suites with human feedback
- Ship rag and agent pipelines safely
- Version prompts and applications for rollback
- Define serving cost, latency, and gpu capacity frameworks
- Integrate llm ops with existing mlops
pythonmlflowlangchainlanggraphpytorchkubernetesterraformdatabricksunity catalogragprompt engineeringdistributed systems
llm operationsrag systemsclinical machine learningmedical device softwareproprietary sensor data