$ sec.08 / notes

Notes

Working notes on agent architecture, LLM operations, and what it takes to get a system past a demo.

  1. 01Route models through a gateway, not an SDKCalling a provider SDK directly puts model choice in your application code. A thin gateway makes it configuration, which is what you need the day a model is deprecated.LLMOpsArchitectureCost
  2. 02Turning OpenAPI specs into agent toolsHand-writing a tool definition per endpoint does not scale. Generating them from the spec does - but only once you add the metadata a planner actually needs.AgentsOpenAPITool Use