Software Engineer - Infrastructure (Mid - Senior)

San Francisco, CA Until 8/21/2026 First posted May 21, 2026 Last posted May 21, 2026
Job description

Compensation: Competitive base salary and meaningful equity

Benefits: Health & dental insurance, gym reimbursement, daily team meals, commuter benefits

We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in code sandboxes (isolated remote containers) that we manage. We’re revenue‑generating and backed by AI Grant, YCombinator, Bessemer Venture Partners and the founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.

The Role

Build and scale the code‑execution sandboxes that power Julius across cloud environments (AWS and GCP). We orchestrate 500k+ containers/month and growing. You’ll own reliability, performance, and security for multi‑tenant compute.

What You’ll Do

  • Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling.

  • Ship cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.

  • Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.

  • Optimize images, scheduling, networking, and cost ; build fair‑use and rate‑limiting controls.

What You Bring

  • Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.

  • Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).

  • Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).

  • Security best practices for containerized, multi‑tenant systems.

Nice to Have

  • gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).

  • You’ve built an AI side project and enjoy tinkering with LLMs.

Why Julius

Small, senior team; massive impact surface; hard infra problems at meaningful scale.

Compensation (from employer):
Estimated Salary Range $150K – $200K • Offers Equity

About this role

Summary

Build and maintain scalable, secure container infrastructure and cloud deployment solutions.

Job title

Software Engineer - Infrastructure (Mid - Senior)

Experience level

mid to senior level

Industry

software

Location requirements

On-site in San Francisco, CA; remote not specified.

Salary

Estimated Salary Range $150K – $200K • Offers Equity

Management role

No

Skills & keywords

Required skills

kubernetesdockercloudterraformhelmnetworkingmonitoringloggingsecurity

Preferred skills

gvisorkatafirecrackerciliumeBPFGPU schedulingserverless autoscalingLLMs

Specializations

containerscloudkubernetessecurityIaC
Locations

Structured locations inferred from the posting.

San Francisco, CA, USA

On-site City