> ## Documentation Index
> Fetch the complete documentation index at: https://docs.gcore.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Block crawling of a CDN domain

> Block web crawlers from crawling a CDN custom domain by returning a disallow robots.txt response.