返回 X 名人动态

Harrison Chase 分享降低编程代理成本的三个措施

中文全文 · AI 翻译

我们看到我们的编码代理成本连续第二个月大幅下降

稍后会有更长的博客文章,但我们采取了三个快速步骤

1/ 成本可见性。你无法控制你无法衡量的东西。从跟踪所有内容到 LangSmith 开始。这为我们提供了超级细粒度的可见性,了解谁在使用什么,他们如何使用等。LangSmith 支持与所有主要编码框架的一方集成 https://www.langchain.com/blog/your-coding-agents-are-a-black-box-heres-how-to-crack-them-open

2/ 成本控制。通过我们的 LLM 网关,设置用户级成本上限。(您可以通过与我们的 VPE 交谈来增加您的上限)。这有助于遏制意外或意外支出。https://docs.langchain.com/langsmith/llm-gateway

3/ 优化框架。显然,第三方框架更难优化,但我们越来越多地通过 OpenSWE 进行编码,这是我们的开源云代理框架。诸如模型路由之类的东西有助于降低成本 https://www.langchain.com/blog/how-to-build-a-model-router-in-the-harness

如果您想在您的公司实施这些,欢迎随时联系寻求帮助!

Harrison Chase 的原推文配图 1
原推文配图 · 查看来源
对照原文

we're seeing our coding agent costs decrease significantly for second month in row longer blog on this later, but three quick steps we took 1/ cost visibility. you cant control what you cant measure. Start tracking everything to langsmith. This gives us super granular visibility into who is using what, how they are using it, etc. LangSmith supports first party integrations with all main coding harnesses https://t.co/zPHBAWaRVS 2/ cost controls. Through our LLM gateway, set user level cost caps. (You can increase your cap by talking to our VPE). This helps curb unexpected or accidental spend. https://t.co/YhvxFjTfxi 3/ optimize the harness. Obviously 3rd party harnesses are tougher to optimize, but we are doing more and more coding through OpenSWE, our open source cloud agent harness. Things like model routing help bring the cost down https://t.co/pHUDDCF6zs feel free to reach out if you want help implementing these at your co!

老杨AI实操

微信扫一扫,添加好友

老杨AI实操的微信好友二维码

手机可长按保存图片,再到微信中识别二维码

保存二维码