# Notice: Crawling DATAGRO is prohibited unless you have express written permission. User-agent: * Disallow: /*.json$ User-agent: baiduspider Disallow: /* User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: Mediapartners-Google Allow: / User-agent: Adsbot-Google Allow: / User-agent: PetalBot Disallow: / Sitemap: https://beefdinner.com/sitemap.xml