User-agent: * Allow: / Disallow: /login Disallow: /register Disallow: /checkout Disallow: /cart Disallow: /customer/ Disallow: /employee/