How to use "site:" in Google with Rolex Forums?

[enjoythemusic]

Originally Posted by brandrea

Whoa … good work

Naaaa, very easy stuff like MS DOS or an Atari BASIC Cartridge :)
robots.txt has been around on the web since, my gosh, feels like forever. My god, I looked it up:

"Part of the Robot Exclusion Protocol, robots. txt was created in 1994 by Martijn Koster after crawlers overwhelmed his website. Though not technically an 'internet standard,' many web developers consider it so, and search engines adopted it to help manage their server resources."

Note that not all search engines / etc follow the webmaster's / server/bandwidth provider's wishes in their robots.txt file.

Originally Posted by Paul C

Does this mean Google can't reference TRF?

Look at what the robots.txt file says. It is written in plain text, so should be easy to understand :)

[brandrea]

Originally Posted by enjoythemusic

Naaaa, very easy stuff like MS DOS or an Atari BASIC Cartridge :)
robots.txt has been around on the web since, my gosh, feels like forever. My god, I looked it up:

"Part of the Robot Exclusion Protocol, robots. txt was created in 1994 by Martijn Koster after crawlers overwhelmed his website. Though not technically an 'internet standard,' many web developers consider it so, and search engines adopted it to help manage their server resources."

Note that not all search engines / etc follow the webmaster's / server/bandwidth provider's wishes in their robots.txt file.




Look at what the robots.txt file says. It is written in plain text, so should be easy to understand :)

Right … super easy


Sent from my iPhone using Tapatalk

[Kevin of Larchmont]

Originally Posted by enjoythemusic

Look at what the robots.txt file says. It is written in plain text, so should be easy to understand :)

Sure, just go ahead and remove the appendix. Everyone knows you cut right about here….

[CaptT]

Originally Posted by enjoythemusic

Look at what the robots.txt file says. It is written in plain text, so should be easy to understand :)

Could someone translate for the uneducated here?! More context would be helpful; why use a robots.txt concept, why do any of this, the benefits/drawbacks of limiting what google can search on the forum, the motivation behind it, etc? Thanks in advance.

[VictorGMT]

Originally Posted by CaptT

Could someone translate for the uneducated here?! More context would be helpful; why use a robots.txt concept, why do any of this, the benefits/drawbacks of limiting what google can search on the forum, the motivation behind it, etc? Thanks in advance.

robots.txt prevents Google and others from indexing a site.

Pro: I do not know.

Con: Users cannot search site using Google, they are limited to the lobotomized search the site features.

I do not get it. Doesn't mean there is not a great reason. Doesn't mean the site owner should not be able to allow/restrict search as they prefer. It is literally the owners data.

[CaptT]

Originally Posted by VictorGMT

robots.txt prevents Google and others from indexing a site.

Pro: I do not know.

Con: Users cannot search site using Google, they are limited to the lobotomized search the site features.

I do not get it. Doesn't mean there is not a great reason. Doesn't mean the site owner should not be able to allow/restrict search as they prefer. It is literally the owners data.

Understood, makes sense, thanks for this info.

I suppose another pro or con depending on who you are…..could this be seen as perhaps convenient for Rolex if there was a controversial topic that maybe didn’t reflect well on Rolex, something that they didn’t want easily searched via the most widely utilized search engine?