Karve
Browse all jobs

ML Engineering Lead (LLM Ops)

Neko

2 weeks ago

HybridFull_timellm operationsrag systemsclinical machine learning

Workplace

Hybrid

Employment

Full_time

Posted

2 weeks ago

Summary

The ML Engineering Lead (LLM Ops) owns the operational lifecycle of Neko's LLM, GenAI, and RAG systems. The role builds production ML platforms for clinical workflows and proprietary sensor data in a regulated medical-device environment.

Responsibilities

  • Deploy and monitor production llm pipelines
  • Build evaluation suites with human feedback
  • Ship rag and agent pipelines safely
  • Version prompts and applications for rollback
  • Define serving cost, latency, and gpu capacity frameworks
  • Integrate llm ops with existing mlops
pythonmlflowlangchainlanggraphpytorchkubernetesterraformdatabricksunity catalogragprompt engineeringdistributed systems
llm operationsrag systemsclinical machine learningmedical device softwareproprietary sensor data