mvhub-dev team mailing list archive

[Dan MacNeil <dan@xxxxxxxxxx>]

** Visibility changed to: Public

** This bug is no longer flagged as a security vulnerability

-- 
spiders access test code
https://bugs.launchpad.net/bugs/493208
You received this bug notification because you are a member of mvhub-
dev, which is a direct subscriber.

Status in MVHub, a directory of social services: In Progress

Bug description:
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

 affects mvhub
 assignee nobody
 importance low
 security yes

 status confirmed
 done

My test site and probably others is being spidered by search engines.

This is bad because it exposes us to people using google to search for
exploits which might exist in our development code

Worse, when people search for "shelter" they may come up with out of
date test data instead of the results they need.

ACTION
	google: robots.txt example

	create a branch with robots.txt in DocumentRoot
	that denies access to all/all
	
	add step change move to production procedure
	to remove robots.txt file as we do want to be
	spidered in production.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAksb0OgACgkQLzI3mETyffxhhgCgidhRR7Q+I/CD7CZCsWBWxFYX
ILUAn1Gzzw0qA+rAn2z4DPZE2eVGbs8k
=brvE
-----END PGP SIGNATURE-----