Engineering

ML Infrastructure Engineer

$3,000 – $5,000 / moFull-timeRemoteSenior

Build the backbone every agent runs on: model routing, observability, cost control, and infrastructure that scales from ten runs to ten million.

What You Will Do

Operate multi-provider LLM gateways with routing, fallbacks, and rate-limit handling.
Build tracing and observability for every agent step (inputs, outputs, tokens, cost).
Automate deployments with Docker/Kubernetes and IaC; keep environments reproducible.
Implement caching, batching, and queueing strategies to cut inference costs.
Set up alerting and SLOs; own incident response for agent infrastructure.
Manage secrets, keys, and provider budgets securely across the org.

Requirements

4+ years in DevOps/SRE/platform or ML infrastructure roles.
Deep Docker and Kubernetes experience; Terraform or similar IaC.
Scripting fluency in Python and Bash; Go is a plus.
Experience running or integrating LLM inference at scale (self-hosted or API).
Security mindset: secrets management, least privilege, audit logging.

Skills & Tools

KubernetesDockerTerraformPythonObservability (OTel/Grafana)LLM GatewaysCost Optimization

What We Offer

Remote-FirstWork from anywhere in your announced time zone band. Async by default.

Meaningful EquityEvery full-time role ships with an equity package. We win together.

Learning BudgetAnnual budget for courses, conferences, compute credits, and books.

Mission TimeDedicated hours each month to point agents at a problem you personally care about.

How to Apply

Send your CV, portfolio, and a short note on why this mission is yours to hrd@rinejourney.xyz with the subject line “Application — ML Infrastructure Engineer”. Applications are reviewed on a rolling basis — no portals, no ghosting.

One click opens Gmail with a pre-filled application to our HR team.

Apply via Gmail ↗or use your default mail app