At a glance
| robots.txt name | MistralAI-User |
|---|---|
| Company | Mistral |
| Kind | Fetch on request. Opens a page when someone asks Le Chat about it |
| Visits sites | Yes |
| Official page | docs.mistral.ai |
MistralAI-User opens a page when someone asks Le Chat about it. This means the fetcher acts on demand, not as part of a broad crawl. For a business, this matters because the fetcher may access pages that are relevant to user queries, and its behaviour is tied to real user requests.
You can decide whether to allow or block MistralAI-User. To allow it, use Allow: / or no rule for it in robots.txt. To block it, add a group with its User-agent line and Disallow: /. Keep in mind that robots.txt is a request, not a lock, and a firewall or bot-protection service can block a crawler even when robots.txt allows it.
robots.txt lines
User-agent: MistralAI-User Disallow: /
User-agent: MistralAI-User Allow: /
Questions
What is MistralAI-User?
MistralAI-User is a user fetcher from Mistral. It opens a page only when a person asks the assistant about that page or a link. It is not a general crawl.
Should I block MistralAI-User?
It depends on your goals. If you want the assistant to be able to read your pages when users ask about them, allow it. If you prefer not to let it fetch pages on demand, block it. Remember that blocking may affect how the assistant can respond about your content.
How do I block MistralAI-User in robots.txt?
Add these two lines to your robots.txt file: User-agent: MistralAI-User Disallow: /
Does blocking MistralAI-User affect AI search or Google?
Blocking MistralAI-User only affects this specific fetcher. It does not affect Google or other AI search systems. Each crawler has its own rules, so blocking one does not block others.