Thai version  
Home page About us Products and Services Clients Articles Downloads Useful Link Contact us    
 
   
 


Thailand Hotel Search (ภาษาไทย)
Thailand Hotel Search

PARTHNERS

Pacific Linux Co.,Ltd
Brillint Infomation Technology
Itmelody Thai Developer Network
Siam-Shop.com
Thai Webdesigns

Professional Web Site Redesigns

If you have a functional website but the design is less than professional, why not get a website redesign? For an inexpensive price you can give your website a whole new look.

RxThai Dot Com can take your existing website text and insert it into a professional custom made website design. Just give us examples of what your business style is and we'll be happy to work on your web design project. The cost of your sites redesign will depend on how many pages your website contains, the type of design you'd like and if you want to add any additional information.

How we work

Web Site Maintenance

ARTICLES

Using a robots.txt File

This is a useful file that keeps search engines from indexing pages you do not want spidered. Why would you not want a page indexed by a search engine? Perhaps you want to display a page that shows an example of spamming the search engines. This type of page might include an example of repeated keywords, hidden tags with keywords, and other things that could get a page or an entire site banned from a search engine.

The robots.txt file is a good way to prevent this page from getting indexed. However, not every site can use it. The only robots.txt file that the spiders will read is the one at the top html directory of your server. This means you can only use it if you run your own domain. The spiders will look for the file in a location similar to these below:

http://www.pageresource.com/robots.txt
http://www.javascriptcity.com/robots.txt
http://www.mysite.com/robots.txt

Any other location of the robots.txt file will not be read by a search engine spider, so the file locations below will not be worthwhile:

http://www.pageresource.com/html/robots.txt
http://members.someplace.com/you/robots.txt
http://someisp.net/~you/robots.txt

Now, if you have your own domain- you can see where to place the file. So let's take a look at exactly what needs to go into the robots.txt file to make the spider see what you want done.

If you want to exclude all the search engine spiders from your entire domain, you would write just the following into the robots.txt file:

User-agent: *
Disallow: /

If you want to exclude all the spiders from a certain directory within your site, you would write the following:

User-agent: *
Disallow: /aboutme/

If you want to do this for multiple directories, you add on more Disallow lines:

User-agent: *
Disallow: /aboutme/
Disallow: /stats/

If you want to exclude certain files, then type in the rest of the path to the files you want to exclude:

User-agent: *
Disallow: /aboutme/album.html
Disallow: /stats/refer.htm

If you are curious, here is what I used to keep an article from getting indexed:

User-agent: *
Disallow: /zine/article002.htm

If you want to keep a specific search engine spider from indexing your site, do this:

User-agent: Robot_Name
Disallow: /

You'll need to know the name of the search engine spider or robot, and place it where Robot_Name is above. You can find these names from the web sites of the various search engines.

So, if you need to exclude something from search engine indexing, this is the most effective tool recognized by the search engines- so use it to keep the spiders out of any part of your web you want them to avoid.

  สร้างหน้าเว็บแนะนำธุรกิจ สินค้าและบริการได้ง่ายๆ ในคลิ้กเดียว
FEATURED CLIENT


Project Details  
Project: rXthai
Description:  desc
Web Site:  www.cpe.or.th

DOWNLOAD

RealPlayer 8.0
Windows Media Player 7.1
Winamp 2.80
ACD see 4.01
CuteFTP (32-bit) 4.2.5
GetRight 4.5d
WS_FTP LE (32-bit) 5.08
FTP Voyager 9.0.0.6
SmartFTP 1.0.966

Home | About us | Products and Services | Clients | Articles | Download | Useful Link | Contact us