Member Of Technical Staff – Agent Orchestration

Anuvaya Labs · New Delhi

New DelhiPosted 30+ days agoLast checked 20 Oct 2026

Free account: apply link, HR contact and an AI-written cold email

About the role

ABOUT ANUVAYA

We think conversational AI agents will deliver all professional services in India. We started with astrology. We're a small group of engineers, designers, and product folks building at the intersection of conversational AI and domain expertise. Making an AI agent sound human-like is hard. Making an AI an expert in a domain is also hard. We're doing both together.

We're backed by Accel, Arkam Ventures, and Weekend Fund.

THE ROLE

Most AI agents treat conversations as stateless request-response cycles. Ours doesn't. We've built a stateful agent that streams responses with natural pacing, handles mid-response interruptions without corrupting state, decides autonomously whether to keep talking or wait, and maintains a living context that evolves across turns.

The Agent Orchestration team owns the core runtime - the system that coordinates LLM calls, tool execution, context management, delivery pacing, and conversation persistence. When you break something here, users notice in real-time. When you get it right, the agent feels like talking to a person who genuinely knows what they're doing.

WHAT YOU'LL DO

- Own and evolve the stateful agent runtime - the streaming pipeline, state management, and tool execution layer

- Ensure what the user sees, what the model remembers, and what we persist stay perfectly in sync - even when users interrupt mid-response

- Build and refine the streaming architecture - how responses are buffered, delivered, and recovered cleanly on interruption

- Implement and tune delivery pacing - making the agent's output feel natural, not robotic

- Design the tool execution layer - the agent calls domain-specific tools mid-conversation and reasons over results in real-time

- Work on autonomous continuation - the agent deciding when to keep going and when to stop, based on conversational context

- Optimize for latency and reliability - first-token time, interruption recovery, context window management

WHAT WE'RE LOOKING FOR

- Deep systems programming instincts - you think about state machines, concurrency, race conditions, and failure modes naturally

- Experience building real-time or streaming systems - WebSockets, SSE, or similar

- You've built and maintained stateful, long-running processes in production

- Comfort with distributed systems - message queues, event-driven architectures, service coordination

- Strong debugging skills for systems where "it worked on my machine" is never the problem

- You can read and reason about concurrent code - whether it's Elixir processes, Go goroutines, or async runtimes

BONUS

- Experience with Elixir/OTP - GenServers, supervisors, the actor model

- Familiarity with LLM APIs and streaming protocols (SSE, chunked responses)

- You've built or worked on conversational AI systems (not just chatbot wrappers)

- Experience with NATS, Kafka, or other messaging systems

- You've read our whitepaper on Stateful Agent Orchestration and can poke holes in it

HOW WE WORK

Skills mentioned

  • Kafka
  • LLMs

Want to reach Anuvaya Labs's HR directly?

NextKnock finds the hiring contact and writes a personal cold email from your resume. You send it from your own Gmail.

Similar jobs

More jobs at Anuvaya Labs

All Anuvaya Labs jobs and company facts →

Browse more