Technical Lead

Own the architecture and technical foundation for evaluation and monitoring systems, ensuring scalability, reliability, and seamless integration into client platforms.

Role Overview

As Technical Lead at Reins AI, you’ll define and implement the technical backbone of our evaluation and monitoring services for AI systems in regulated industries. You’ll work at the intersection of engineering, research, and client delivery by translating evaluation requirements into scalable, production-ready systems. This role combines hands-on building with architectural oversight, making you a key driver of technical excellence.

Responsibilities

  • Design and implement core infrastructure for evaluation pipelines, data ingestion, orchestration, and monitoring.
  • Build integrations with client platforms and ecosystems (e.g., Databricks, GCP, Azure, Arize, LangSmith, OpenTelemetry).
  • Translate evaluation designs into robust, scalable APIs and workflows.
  • Collaborate with Test Designers and Evaluation Implementation Engineers to bring scenarios and metrics to life.
  • Mentor junior engineers and enforce best practices across code quality, testing, and deployment.
  • Balance speed of prototyping with reliability and compliance in production environments.
  • Qualifications

  • 5+ years of experience in software engineering, ML infrastructure, or systems architecture.
  • Proficiency in Python and modern API frameworks (FastAPI, Flask, etc.).
  • Strong background in distributed systems, cloud environments, and CI/CD pipelines.
  • Familiarity with ML observability tools (Arize, LangSmith, OpenTelemetry, etc.).
  • Ability to collaborate with cross-functional teams and translate requirements into technical solutions.
  • Preferred Skills

  • Experience in regulated domains (audit, finance, healthcare, etc.).
  • Knowledge of statistical validation and synthetic data generation.
  • Comfort working in an early-stage environment.
  • 12 months, 50% time blended
    October 1, 2025