# robots.txt — CricketDream IPL Fantasy Cricket # https://www.cricketdream.in # ── Social media crawlers — allow everything so OG images load ── User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: LinkedInBot Allow: / User-agent: WhatsApp Allow: / User-agent: Slackbot Allow: / User-agent: TelegramBot Allow: / # ── Search engines & all other bots ── User-agent: * # ── Explicitly allow all public content ── Allow: / Allow: /compare/ Allow: /players/ Allow: /matches/ Allow: /blog/ Allow: /previews/ Allow: /trivia/ Allow: /teams/build Allow: /leaderboard Allow: /draft Allow: /multi-draft Allow: /dynasty Allow: /predictor Allow: /quiz Allow: /groups Allow: /leagues Allow: /how-to-play Allow: /faq Allow: /about Allow: /contact # OG image generator — not indexable content (linked from og:image meta only) Disallow: /api/ # /quiz/leaderboard must be explicitly allowed first (longer match wins) Allow: /quiz/leaderboard Disallow: /quiz/ # Block all quiz/dynasty/predictor/draft API routes — not crawlable content Disallow: /api/quiz/ Disallow: /api/dynasty/ Disallow: /api/predictor/ Disallow: /api/draft/ Disallow: /api/multi-draft/ # Block private / auth-gated paths only Disallow: /api/push/ Disallow: /api/teams Disallow: /api/me Disallow: /api/admin/ Disallow: /api/feedback/ Disallow: /api/enquiry Disallow: /admin/ Disallow: /profile/ Disallow: /my-teams/ Disallow: /share/ Disallow: /reset-password # Block query parameters that create duplicate/non-canonical pages Disallow: /*?tab= Disallow: /*?ref= Disallow: /*?utm_ Disallow: /*?fbclid= Disallow: /*?gclid= # LLMs.txt — tells AI crawlers (ChatGPT, Claude, Perplexity) about the site # https://www.cricketdream.in/llms.txt # Sitemaps Sitemap: https://www.cricketdream.in/sitemap-index.xml Sitemap: https://www.cricketdream.in/sitemap.xml Sitemap: https://www.cricketdream.in/sitemap-players.xml Sitemap: https://www.cricketdream.in/sitemap-compare.xml