# Content signals (https://contentsignals.org). "yes" grants the stated use, # "no" withholds it, and an omitted signal neither grants nor restricts it. # search: building a search index and returning links and short excerpts # ai-input: taking content to ground or answer with a generative AI system # ai-train: training or fine-tuning AI models # use: how an AI system may consume it (immediate, reference, or full) # Any restriction stated below is an express reservation of rights under # Article 4 of EU Directive 2019/790 on copyright in the Digital Single Market. # Google search and image crawling: full site, no restrictions. User-agent: Googlebot Content-Signal: search=yes,ai-input=yes,ai-train=no Disallow: User-agent: Googlebot-Image Disallow: # Google Ads landing-page and Merchant Center checks. User-agent: AdsBot-Google Disallow: # Existing training and bulk-crawl restrictions. Some of these services # also support search or retrieval; these are deliberate access tradeoffs. User-agent: Amazonbot User-agent: anthropic-ai User-agent: Applebot-Extended User-agent: atlassian-bot User-agent: AwarioRssBot User-agent: AwarioSmartBot User-agent: BorderxBot User-agent: Bytespider User-agent: CCBot User-agent: CitibotSiteCrawler User-agent: Claude-Web User-agent: ClaudeBot User-agent: CloudflareBrowserRenderingCrawler User-agent: cohere-ai User-agent: Cotoyogi User-agent: Diffbot User-agent: FishBot User-agent: Google-CloudVertexBot User-agent: GoogleOther User-agent: GPTBot User-agent: ICC-Crawler User-agent: KimiBot User-agent: magpie-crawler User-agent: meta-externalagent User-agent: MistralAI-Training User-agent: NavuBot User-agent: omgili User-agent: QualifiedBot User-agent: SemrushBot-SWA User-agent: WARDBot Disallow: / # Google-Extended permits both Gemini grounding and training. # This product token does not control Google Search ranking. User-agent: Google-Extended Content-Signal: search=yes,ai-input=yes,ai-train=yes Allow: / # Search and user-requested retrieval: access permitted, not a # guarantee that any service will index, cite or recommend this site. User-agent: OAI-SearchBot User-agent: Claude-SearchBot User-agent: PerplexityBot User-agent: Bingbot User-agent: ChatGPT-User User-agent: Claude-User User-agent: Meta-ExternalFetcher User-agent: Meta-WebIndexer Content-Signal: search=yes,ai-input=yes,ai-train=no Allow: / # PetalBot: keep inventory roots and pagination open while restricting # facet enumeration, including filters appended after the page number. User-agent: PetalBot Disallow: /cars/ Disallow: /cars? Disallow: /trailers/ Disallow: /trailers? Allow: /cars$ Allow: /cars/$ Allow: /cars?pg= Disallow: /cars?pg=*& Disallow: /cars/?pg=*& Allow: /cars/?pg= Allow: /trailers$ Allow: /trailers/$ Allow: /trailers?pg= Disallow: /trailers?pg=*& Disallow: /trailers/?pg=*& Allow: /trailers/?pg= # START YOAST BLOCK # --------------------------- User-agent: * Content-Signal: search=yes,ai-train=no,use=reference Disallow: Sitemap: https://www.freemanmotor.com/sitemap_index.xml # --------------------------- # END YOAST BLOCK