Safe Installs

European firms buy future AI computing power

 ·  By Celestine Black
European firms buy future AI computing power - ai computing
European firms buy future AI computing power

Mistral AI, a French AI company, will host third-party open models on its infrastructure, starting with Z.ai’s GLM-5.2, alongside new regional endpoints and a priority API tier. This move allows companies to use Mistral’s infrastructure even when they choose a model other than Mistral’s own.

The company wants to give enterprises one place to run different open models, without forcing them to start over every time they switch. Mistral’s regional endpoints are now largely available in Europe and the United States.

Mistral’s Priority Tier, which puts eligible requests ahead of standard traffic and comes with a 99.5% uptime service-level agreement, is in public preview. The first third-party model to be hosted is GLM-5.2, a model from Z.ai with a 1 million-token context window.

Mistral lists coding and long-context agentic work among the main uses of GLM-5.2. The model is available through the company’s API and costs $1.40 per million input tokens, $4.40 per million output tokens, and $0.14 per million cached input tokens.

A team might use GLM-5.2 for coding, Mistral Medium for work involving images and text, and Small for cheaper, everyday requests. However, using the same API doesn’t make the models interchangeable, as each model has its own quirks.

With Mistral’s regional inference service, developers can decide whether their requests are processed in Europe or the United States by changing the API endpoint. This can reduce latency and help companies meet data-location requirements, although it adds 10% to the cost of every input, output, and cached token.

Related: Nscale acquires Anyscale to advance multi-cloud neutrality

Some account and usage data may still leave the selected region, and information may also be shared with outside companies under the safeguards in Mistral’s Trust Center. Companies working with financial, health, or government data will still have some homework to do.

The prompts may stay in Europe, but teams also need to find out what Mistral logs, where that information is stored, who can see it, and what gets through to outside companies. The Microsoft-Mistral sovereign compute partnership addresses some of these questions for Azure customers.

It’s clear that Mistral needs customers to keep using its infrastructure, whichever model they choose. That same bet — that the infrastructure layer matters more than any single model — is one that a number of enterprises are already making. GLM-5.2 is the first sign of how that could work.

Mistral’s move to host third-party models is a significant step towards creating a more open and flexible AI ecosystem.
Developers and users try to work with the complexities of AI adoption, considering data centers and their role in this process.

Mistral’s approach will be important to watch as it affects the industry, including the role of AI compute in shaping the future of business and technology.

Leave a Comment

Your email address will not be published.