DevOps Engineer

About the Role

We're looking for a DevOps Engineer to build the infrastructure foundation that keeps our AI-powered product fast, reliable, secure, and cost-efficient. You'll set up the cloud, deployment, and monitoring systems that let a small team ship confidently and scale smoothly through the pilot and beyond.

What You'll Do

Design, provision, and manage cloud infrastructure (AWS, GCP, or Azure)

Build and maintain CI/CD pipelines for fast, safe, automated deployments

Implement infrastructure-as-code (Terraform, Pulumi, or similar) for reproducible environments

Containerize and orchestrate services (Docker, Kubernetes) as the system grows

Set up observability: monitoring, logging, alerting, and tracing across the stack

Manage and optimize the cost, latency, and reliability of LLM and AI workloads

Own security, secrets management, and access controls across environments

Establish backup, disaster-recovery, and incident-response practices for the pilot

4+ years of DevOps, SRE, or infrastructure engineering experience

Strong hands-on experience with at least one major cloud provider (AWS/GCP/Azure)

Proficiency with infrastructure-as-code tools (Terraform, Pulumi, CloudFormation)

Experience with containerization and orchestration (Docker, Kubernetes)

Solid CI/CD experience (GitHub Actions, GitLab CI, CircleCI, or similar)

Strong scripting skills (Bash, Python, or Go)

Experience implementing monitoring and observability tooling (Prometheus, Grafana, Datadog, etc.)

Security-first mindset and experience with secrets and access management

Experience managing infrastructure for AI/ML or LLM-heavy workloads

Familiarity with cost optimization for high-throughput API usage

Experience with GPU infrastructure or inference serving

Early-stage experience standing up infrastructure from scratch

Originally posted on Himalayas