跳到正文
原文
Mistral AI·· 2024-11-07AI 评分35

Mistral Batch API发布,降低AI应用成本50%

Mistral Batch API

AI 导读

Mistral AI推出Batch API,以50%低于同步API调用的成本,高效处理大量请求。适用于数据量优先的AI应用,如客户反馈分析、文档摘要和翻译、向量嵌入等。API适用于所有Mistral模型,并即将在云服务合作伙伴推出。

原文

This could've been a tweet, but... While the AI developer community was faced with several API price hikes in the past few weeks, we’re trying to make sure to continue bringing frontier AI to you at affordable price points. To that end, we’re introducing the batch API, available today on La Plateforme.

The batch API introduces a more efficient way to process high-volume requests to Mistral models at 50% lower cost than that of a synchronous API call. If you’re building AI applications where you prioritize volume of data over synchronous responses, the batch API can be an ideal solution. You simply upload your batch file, and once the requests have been processed, download and use the output file. For detailed instructions, check out our batch API documentation.

Popular applications for the batch API include customer feedback and sentiment analysis, document summarization and translation in bulk, vector embedding to prepare search indexes, and data labeling.

The batch API is available for all models served on la Plateforme, and coming soon to our cloud provider partners. Rate of usage is limited to 1 million ongoing requests per workspace.

Please be sure to let us know what you think, and contact us for custom or private deployments.

来源:Mistral AI · mistral.ai