Google macht mich grad irre... Oder die Suche nach der perfekten robots.txt

[kindspech]

Hi Leutes,

ich habe mich heute seit längerem mal wieder bei Google eingeloggt. Gleich auf der Übersicht springt mir ins Auge:

URLs durch robots.txt eingeschränkt: 4.505

Ein Blick auf die Details offenbahrt Schreckliches:

index.php 20mal mit XTCsid!
login.php ca. 3500mal mit XTCsid!

aber auch wirklich nur diese beiden mit Session-ID.

und das, obwohl in der robots.txt Disallow: /login.php steht...

Wie konnte es dazu kommen? Was kann man dagegen machen??

Liebe Grüße
Natascha

[Gecko6]

Hallo Natascha,

versuch es mal hiermit:

User-agent: *
Disallow: /*?XTCsid
Disallow: /address_book_process.php 
Disallow: /account.php 
Disallow: /account_edit.php 
Disallow: /account_edit_process.php 
Disallow: /account_history.php 
Disallow: /account_history_info.php 
Disallow: /address_book.php 
Disallow: /coID/3/content/AGB 
Disallow: /coID/4/content/Impressum
Disallow: /coID/7/content/Kontakt
Disallow: /coID/9/content/Wir-ueber-uns
Disallow: /coID/1/product/Versandkosten
Disallow: /checkout_process.php 
Disallow: /advanced_search.php 
Disallow: /advanced_search_result.php 
Disallow: /checkout_address.php 
Disallow: /checkout_confirmation.php 
Disallow: /checkout_payment.php 
Disallow: /checkout_success.php 
Disallow: /contact_us.php 
Disallow: /create_account.php
Disallow: /create_account_guest.php 
Disallow: /create_account_process.php 
Disallow: /create_account_success.php 
Disallow: /info_shopping_cart.php 
Disallow: /login.php 
Disallow: /logoff.php
Disallow: /password_double_opt.php
Disallow: /popup_image.php 
Disallow: /popup_search_help.php 
Disallow: /privacy.php 
Disallow: /product_notifications.php 
Disallow: /product_reviews.php 
Disallow: /product_reviews_info.php 
Disallow: /reviews.php 
Disallow: /shipping.php 
Disallow: /admin/
Disallow: /export/
Disallow: /download/ 
Disallow: /includes/ 
Disallow: /pub/ 
Disallow: /media/
Disallow: /images/

User-Agent: Googlebot
Disallow: /address_book_process.php 
Disallow: /account.php 
Disallow: /account_edit.php 
Disallow: /account_edit_process.php 
Disallow: /account_history.php 
Disallow: /account_history_info.php 
Disallow: /address_book.php 
Disallow: /checkout_process.php 
Disallow: /advanced_search.php 
Disallow: /advanced_search_result.php 

Disallow: /coID/3/content/AGB 
Disallow: /coID/4/content/Impressum
Disallow: /coID/7/content/Kontakt
Disallow: /coID/0/content/Widerrufsrecht
Disallow: /coID/2/content/Datenschutz
Disallow: /coID/10/content/Zahlarten
Disallow: /coID/1/content/Versandkosten

Disallow: /checkout_address.php 
Disallow: /checkout_confirmation.php 
Disallow: /checkout_payment.php 
Disallow: /checkout_success.php 
Disallow: /contact_us.php 
Disallow: /create_account.php
Disallow: /create_account_guest.php 
Disallow: /create_account_process.php 
Disallow: /create_account_success.php 
Disallow: /info_shopping_cart.php 
Disallow: /login.php 
Disallow: /logoff.php
Disallow: /password_double_opt.php
Disallow: /popup_image.php 
Disallow: /popup_search_help.php 
Disallow: /privacy.php 
Disallow: /product_notifications.php 
Disallow: /product_reviews.php 
Disallow: /product_reviews_info.php 
Disallow: /reviews.php 
Disallow: /shipping.php 
Disallow: /admin/
Disallow: /export/
Disallow: /download/ 
Disallow: /includes/ 
Disallow: /pub/ 
Disallow: /media/
Disallow: /*?XTCsid

User-Agent: Googlebot-Image
Disallow: /
Disallow: /*.gif$
Disallow: /*.jpg$
Disallow: /*.pdf$
Disallow: /*.zip$