User-agent: * Allow: / Allow: /api/sitemap Disallow: /auth/ Disallow: /admin/ Disallow: /profile/ Disallow: /settings/ Disallow: /dashboard/ Disallow: /pages/index-* Disallow: /_next/