# only index.htm is allowed robot access User-agent: * allow: all Disallow: /logs