User-agent: * Disallow: # Allow only specific directories User-agent: ScoutJet Disallow: / Allow: /public