#Tech news

Mistral launches new services, SDK to let customers fine-tune its models


French AI startup Mistral is introducing new AI model customization options, including paid plans, to let developers ā€” and enterprises ā€” fine-tune its generative models for particular use cases.

The first is self-service. Mistral has released a software development kit (SDK), Mistral-Finetune, for fine-tuning its models on workstations, servers and small datacenter nodes.

In the readme for the SDKā€™s GitHub repository, Mistral notes that the SDK is optimized for multi-GPU setups but can scale down to a single Nvidia A100 or H100 GPU for fine-tuning smaller models like Mistral 7B. Fine-tuning on a data set such as UltraChat, a collection of 1.4 million dialogs with OpenAIā€™s ChatGPT, takes around half an hour using Mistral-Finetune across eight H100s, Mistral says.

For developers and companies who prefer a more managed solution, thereā€™s Mistralā€™s newly launched fine-tuning services available through the companyā€™s API. Compatible with two of Mistralā€™s models for now, Mistral Small and the aforementioned Mistral 7B, Mistral says that the fine-tuning services will gain support for more of its models in the coming weeks.

Lastly, Mistral is debuting custom training services ā€” currently only available to select customers ā€” to fine-tune any Mistral model for an organizationā€™s apps using their data. ā€œThis approach enables the creation of highly specialized and optimized models for their specific domain,ā€ the company explains in a post on its official blog.

Mistral, which my colleague Ingrid Lunden recently reported is seeking to raise around $600 million at a $6 billion valuation from investors including DST, General Catalyst and Lightspeed Venture Partners, is no doubt looking to grow revenue as it faces considerable ā€” and growing ā€” competition in the generative AI space.

Since Mistral unveiled itsĀ first generative model in September 2023,Ā itā€™s releasedĀ several more, including a code-generating model, and rolled out paid APIs. But it hasnā€™t disclosed how many users it has ā€” nor what its revenues are looking like.



Source link

Leave a comment

Your email address will not be published. Required fields are marked *