User-agent: *
Allow: /$
Allow: /llms.txt$
Allow: /model-catalog.md$
Allow: /api/public/models_info$
Allow: /sitemap.xml$
Disallow: /

Sitemap: https://tokenfactory.nebius.com/sitemap.xml