What does your robots.txt look like?

[_20_]

As title states, what does your current robots.txt look like?

Here is mine:

User-agent: *
Allow: /

Sitemap: http://www.adverthelix.co.cc/sitemap.xml


Pretty simple. ^^

 

[Pixel Pirate]

Dunt have one....should I have one?

 

[Expired Account]

Dunt have one....should I have one?

Same, I don't have one either.

 

[Nuke]

That makes three of us.

And it's robots.jpg but it isn't an image it's a text file.

 

[Gimgak]

wtf are you talking about. It's robots.txt and nice rick roll

 

[Expired Account]

Thats a useless Rick Roll compared to http://www.smouch.net/lol 😛

 

[Gimgak]

lol don't post that, some might actually click that 😛

 

[Watch Me Sink]

Spoiler

Sitemap: http://disturbedmb.com/index.php?action=sitemap;xml
User-Agent: *
Disallow: /index.php?action=search
Disallow: /index.php?action=calendar
Disallow: /index.php?action=login
Disallow: /index.php?action=register
Disallow: /index.php?action=profile
Disallow: /index.php?action=stats
Disallow: /index.php?action=activate
Disallow: /index.php?action=help
Disallow: /index.php?action=admin
Disallow: /index.php?action=pm
Disallow: /index.php?action=mlist
Disallow: /index.php?action=notify
Disallow: /index.php?action=post
Disallow: /index.php?action=markasread
Disallow: /index.php?action=sendtopic
Disallow: /index.php?action=printpage
Disallow: /index.php?action=dlattach
Disallow: /index.php?action=reminder
Disallow: /attachments/
Disallow: /avatars/
Disallow: /beta/
Disallow: /dev/
Disallow: /Packages/
Disallow: /sitemaps/
Disallow: /Smileys/
Disallow: /Sources/
Disallow: /Themes/
Disallow: /wiki/
Disallow: /*sort=
Disallow: /*.msg

 

[Nuke]

wtf are you talking about. It's robots.txt and nice rick roll

I was kidding. UW's coder was once challenged at a site about hacking to hack their site and seek out robots.jpg; a text file.

He told me the story and I lol'd. Following the posting of this topic, I made that joke. Mainly for myself to lol.

 

[cityStatic]

Spoiler

Sitemap: http://otakubb.com/sitemap-index.xml

User-Agent: *
Disallow: /captcha.php
Disallow: /editpost.php
Disallow: /misc.php
Disallow: /modcp.php
Disallow: /moderation.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /ratethread.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /sendthread.php
Disallow: /task.php
Disallow: /usercp.php
Disallow: /usercp2.php
Disallow: /calendar.php
Disallow: /*action=emailuser*
Disallow: /*action=nextnewest*
Disallow: /*action=nextoldest*
Disallow: /*year=*
Disallow: /*action=weekview*
Disallow: /*action=nextnewest*
Disallow: /*action=nextoldest*
Disallow: /*sort=*
Disallow: /*order=*
Disallow: /*mode=*
Disallow: /*datecut=*
Allow: /