Harrison Chase 分享降低编程代理成本的三个措施
我们看到我们的编码代理成本连续第二个月大幅下降
稍后会有更长的博客文章,但我们采取了三个快速步骤
1/ 成本可见性。你无法控制你无法衡量的东西。从跟踪所有内容到 LangSmith 开始。这为我们提供了超级细粒度的可见性,了解谁在使用什么,他们如何使用等。LangSmith 支持与所有主要编码框架的一方集成 https://www.langchain.com/blog/your-coding-agents-are-a-black-box-heres-how-to-crack-them-open
2/ 成本控制。通过我们的 LLM 网关,设置用户级成本上限。(您可以通过与我们的 VPE 交谈来增加您的上限)。这有助于遏制意外或意外支出。https://docs.langchain.com/langsmith/llm-gateway
3/ 优化框架。显然,第三方框架更难优化,但我们越来越多地通过 OpenSWE 进行编码,这是我们的开源云代理框架。诸如模型路由之类的东西有助于降低成本 https://www.langchain.com/blog/how-to-build-a-model-router-in-the-harness
如果您想在您的公司实施这些,欢迎随时联系寻求帮助!

对照原文
we're seeing our coding agent costs decrease significantly for second month in row longer blog on this later, but three quick steps we took 1/ cost visibility. you cant control what you cant measure. Start tracking everything to langsmith. This gives us super granular visibility into who is using what, how they are using it, etc. LangSmith supports first party integrations with all main coding harnesses https://t.co/zPHBAWaRVS 2/ cost controls. Through our LLM gateway, set user level cost caps. (You can increase your cap by talking to our VPE). This helps curb unexpected or accidental spend. https://t.co/YhvxFjTfxi 3/ optimize the harness. Obviously 3rd party harnesses are tougher to optimize, but we are doing more and more coding through OpenSWE, our open source cloud agent harness. Things like model routing help bring the cost down https://t.co/pHUDDCF6zs feel free to reach out if you want help implementing these at your co!