The NetBSD Project

CVS log for htdocs/robots.txt

[BACK] Up to [cvs.NetBSD.org] / htdocs

Request diff between arbitrary revisions


Keyword substitution: kv
Default branch: MAIN


Revision 1.4: download - view: text, markup, annotated - select for diffs
Sun Jul 27 20:31:16 2025 UTC (15 months, 2 weeks ago) by riastradh
Branches: MAIN
CVS tags: HEAD
Diff to: previous 1.3: preferred, colored
Changes since revision 1.3: +4 -0 lines
robots.txt: Request robots not to execute dholland's CGI scripts.

Admins RT#355993.

Revision 1.3: download - view: text, markup, annotated - select for diffs
Tue Dec 24 02:57:14 2013 UTC (12 years, 10 months ago) by mspo
Branches: MAIN
Diff to: previous 1.2: preferred, colored
Changes since revision 1.2: +1 -0 lines
also disallow donations/

Revision 1.2: download - view: text, markup, annotated - select for diffs
Tue Jan 15 15:28:45 2008 UTC (18 years, 10 months ago) by david
Branches: MAIN
Diff to: previous 1.1: preferred, colored
Changes since revision 1.1: +1 -0 lines
Ask Google not to index xml (source) files, because returning them as
search results is bad for users.

Note - a wildcard in the disallow statement is not valid robots.txt
usage, but Google supports it anyway.

Revision 1.1: download - view: text, markup, annotated - select for diffs
Thu May 22 18:30:16 2003 UTC (23 years, 6 months ago) by grant
Branches: MAIN
CVS tags: hrs-xmlcleanup-base, hrs-xmlcleanup
attempt to ask robots to not crawl /cgi-bin/.

Diff request

This form allows you to request diffs between any two revisions of a file. You may select a symbolic revision name using the selection box or you may type in a numeric name using the type-in text box.

Log view options

CVSweb <webmaster@jp.NetBSD.org>