User-agent: Googlebot Disallow: /network/ Disallow: /mstore/ Disallow: /*dashboard.htm* Disallow: /*forwardv2.aspx* User-agent: Googlebot-Image Disallow: /mstore/ Disallow: /*dashboard.htm* Disallow: /*forwardv2.aspx* User-agent: Googlebot-Mobile Disallow: User-agent: Mediapartners-Google Disallow: User-agent: Googlebot-News Disallow: User-agent: Slurp Disallow: User-agent: MSNBOT Allow: / User-agent: Teoma Disallow: user-agent: Feedfetcher-Google Disallow: User-agent: twiceler Disallow: / User-agent: ia_archiver Disallow: User-agent: Spinn3r Disallow: / User-agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/20021130 Disallow: / User-agent: Mozilla/5.0+(X11;+U;+Linux+x86_64;+en-US;+rv:1.9.0.19;+aggregator:Spinn3r+(Spinn3r+3.1);+http://spinn3r.com/robot)+Gecko/2010040121+Firefox/3.0.19 Disallow: / User-agent: GurujiBot Disallow: / User-agent: discobot Disallow: / User-agent: * Disallow: /