# Allow scanning 'Robots' free access to the whole site. # User-agent: * Disallow: