Using TITLE Tags effectively

Date: 2011.02.24 | Category: Search Engine Optimization, WebDesign | Response: 0

Microsoft Internet Explorer has supported the TITLE attribute for links since version 4.0. Netscape began supporting it in version 6.0

The TITLE attribute allows you to enter descriptive text about a link that’s displayed when the mouse moves over the link. For an example, move your mouse over the link below:

The HTML source code for this link is shown below:

<a href="http://www.europeanwebmasters.com"
  title="Click Here To Learn Foreign Adult Marketing">European Webmasters</a>

If your browser supports the TITLE attribute you should see a small popup box appear, similar to the way alternate text for images is displayed when you move your mouse over the image.

This attribute is similar to the ALT attribute for the IMG tag, both in its appearance and its limitations. The value of the attribute must be inside quotation marks, and it can only contain plain text (no HTML tags). You can include carriage returns in the title, and these will be displayed in the text. The maximum length of the TITLE text for Internet Explorer is very large; we’ve tested it with over 500 characters. Try to keep your descriptions below 25 words, though; any more than this can be hard to read and, because the search engine spiders can read this text you may be considered as spamming the engines.

The TITLE attribute is useful in places where your HTML design limits the length of your link text. That’s often the case for links in a navigation bar, especially if your page has a multi-column layout. Try using the TITLE attribute to give your visitors extra navigation information.

In addition you can also use the TITLE tag on standard text for extra information where you just don’t have the space to be as affluent as you would like. An example of this is shown below:

Use of the TITLE tag on plain text

The HTML code for this is also shown below:

This attribute is part of the HTML 4.0 standard. Internet Explorer, Netscape 6.x and Opera (Version 3.0 or higher) support it. However, the attribute degrades gracefully, visitors with non-supporting browsers (like Netscape 4.x) would see the link as if you hadn’t used the attribute.

As you can see from the above examples by using the TITLE tags effectively you can double, if not treble your use of keywords however, caution should be paid when using these features of the tag so that you don’t inadvertently spam the search engines.

Article Written By Lee

Moving To A New Hosting Company

Date: 2011.02.23 | Category: Hosting | Response: 0

Moving to a new hosting provider does not have to be a frustrating task if done properly.

Adult webmasters usually have to upgrade their hosting services once their respective Web sites become popular, usually because their current host cannot provide an effective level of scalability or technical support or, perhaps even the cost of bandwidth becomes to high.

In order to transfer service efficiently, in the event that it becomes necessary, webmasters should ensure that all their content, including Web pages, databases and scripts, are properly archived.

You should always back up your data at regular intervals in case of unexpected data loss or hardware failure. Ensure that all data is archived recursively. This will ensure that all your data is archived and compressed in its original directories, which is very important if you want to retain the full working integrity of your Web sites.
You may also find that your new hosting company may be able to transfer the files directly from your old server to the new one you are getting with them, ask before hand if this is something that they can do for you as it is generally a lot quicker for them to do it than for you to upload the files yourself for instance, Web Air will do this work for you.

Once you have recursively archived your site, make arrangements to purchase your new hosting services. Make sure that any new solution you select includes basic services that approximate and excel the service that you where obtaining with your previous hosting provider. It makes no sense to replace your present hosting service with another Web hosting solution that equally cannot fulfill your technical or financial requirements.

The best resource to use to find a better hosting firm specific to the adult hosting industry is Adult Hosting Companies, the largest adult Web hosting resource directory with currently over 250 hosts listed.

Once your new solution is activated, upload your archived Web pages, database and scripts to the new host. You will be allocated an IP number from the new hosting company. Take time to debug and test the new site from the individual IP number, not forgetting things like your cgi scripts may need altering.

Once your site is entirely debugged and you verify that all site functionality is operative, then transfer your domain name service (DNS) servers over from your old server to your new server.

During this DNS transition period, which is referred to as the “propagation period,” your Web site will be resolved by both your new and old host, as the new DNS information about your Web site filters through the Internet globally. It typically takes about 10 days for the transfer to fully propagate around the Internet; so keep your old site running in case you get visitors whose ISP’s have cached your site on the old server.

It is important however that you retain both your old and new hosting services during your propagation period of 10 days. You will need to check your e-mail from both hosting providers since different regions of the Internet will remit e-mail to your original host while other regions will remit mail to the new server during this time.

Once a week or two have elapsed, cancel the account with the previous hosting company. Only cancel your old account when e-mail stops arriving from your old hosting provider.

If you follow these steps carefully, then your host change should be easy and stress free.

Article written by Lee

Seasons Greetings For The Adult Surfer

Date: 2011.02.24 | Category: General, Promotion, WebDesign | Response: 0

How do the national and, international holidays affect our sponsors sales? More than you would think especially if you can offer your surfers something ‘seasonal’ when they hit your site. However, that said, when should you start planning for these holidays and, more importantly, how can you ensure that once you have implemented your seasonal marketing campaigns that they actually work?

Seasonal Marketing – The Basics.

Seasonal marketing is, in effect a method of changing your marketing approach around different times of the year to affect both the volume of sales you make and, more importantly, the uniqueness of the product you are offering your surfers. A good example of this is at Christmas time, many of the sponsors will provide their webmasters with banner with a holiday feel to them, perhaps using scantily clad men in Santa outfits or half naked women in elves costumes. By offering a seasonal marketing approach to your site surfers you actually increase the chances of making a sale.

Holiday Porn.

One of the best ways to offer your surfers a fresh marketing angle is to ensure that you plan for all of the major holidays throughout the year in advance so for example, as mentioned above, Christmas is a big holiday as are, New Years, Easter, Thanksgiving (US), Independence Day (US) and, Halloween. By building sites specifically for these holidays you are increasing the chances not only of building your sales but, of gaining additional traffic that you might otherwise lose out on. It has been said certainly over the last four years i have worked in the adult industry that many webmasters experience an increase in search engine traffic searching on keywords such as ‘Christmas Porn’ and, ‘Ghost Porn’ around the various holidays, build now for next year and, when the holiday season arrives, you will be one step ahead of your competition.

Seasonal Marketing Overview.

As already mentioned the holiday season especially Christmas time, can be a great way to gain additional traffic, not only from those surfers specifically looking for Christmas Porn but, also the newbie adult surfers who have perhaps only just got their first computer on Christmas day, by adding to your collection of seasonal porn sites year after year you will not only learn a lot about the way the various holidays and seasons affect your sales but, you will also be able to profit from your surfers in a way that not many other webmasters do.

Article written by Lee

Fighting Back Against Computer Viruses

Date: 2011.02.22 | Category: General | Response: 0

Only 10 years ago, the only way that a virus could have infected your computer was through you physically putting a floppy disk into your hard drive and running the program file that initiated the virus however, today’s viruses have become more complex in how they operate and, can spread like wild fire if they are not recognized as a virus doing damage not only to your computer but that of your associates and peers.

So how do we minimize the risk of virus infection on our computers which, lets face it, for the Adult Webmaster are our livelihood and, need to be protected at all cost. This is what we will take a brief look at in this article, how to minimize the risk of getting a computer virus and, heaven forbid, how to deal with a virus if you actually have one on your machine already.

Computer Viruses – A Little History.

1981 – The first widely accepted computer virus is recognized. The ‘Elk Cloner’ virus was spread through floppy disks and, whilst by today’s standards, it was not a high risk virus it, non the less was still a virus, in fact, all this first virus did was to display a message on your computer screen.

1991 – The ‘Tequila’ virus was the first recognized ‘polymorphic virus’ meaning, it was the first virus which actually altered its state once on your machine in order to remain undetected.

2001 – 2001 saw the spawn of several highly potent ‘worm’ orientated viruses from the ‘Gnuman’ virus, the ‘LogoLogic Worm’ and the famed (is that the right word?) ‘Nimda worm’. These ‘worms’ were the first of their kind to actually spread themselves across the World Wide Web through infecting users email clients (specifically Outlook Express) and sending itself to every email address the infected machine had in the address book.

Virus Infections – Prevention Better Than Cure.

So we now have a little background on the main viruses over the last 20 years we will take a look at the ways in which we can prevent viral infections on our computers after all, as the subtitle for this paragraph says, a prevention is far better than having to find a cure.

Here are a few simple ways you can help to prevent the spread and infection of computer viruses.

1) Install a good anti-virus software package on ALL of your computers, Norton and, Mcafee, both have some good products to aid you in preventing viral infections of your PC. Also, you should ensure the software package you do install has updated virus definitions, a new virus is created almost every week so you need to ensure your software keeps up-to-date on the latest infections.

2) Scan any and all email attachments you receive, irrespective of whether you know the sender or not, anything that you get sent in an email should be scanned, as mentioned above, there are complex viruses that can ‘send’ themselves from other peoples email address book, what happens if you are on the address book of an infected users computer? Can you afford not to be online?

3) Ensure that, once you have an Anti virus program installed on your machine that you have it setup to start each and every time that your computer boots, the first thing that should be loading on your machine is an anti-virus program, you only have one chance to prevent infection.

4) Avoid downloading .exe and .com files to your desktop unless, you know the person you are downloading the files from and, even then, before you launch or open the files ensure you scan them independently.

Virus Prevention – Overview.

Hopefully this article will have given you some insight into how you can protect both your computer and the computers of your associates and peers from computer viruses and, hopefully, by following the guidelines within this article your time spent online will be productive and virus free. One thing you should remember however is that no matter how hard we all try to remain virus free, someone will create a new program that ultimately, could infect our machines no matter how hard we try.

Article written by Lee

Niche Marketing – What Is A Niche?

Date: 2011.02.23 | Category: Promotion | Response: 0

The first step as webmasters we must take to become successful is to discover what our niche specialty is however, many webmasters still do not realize exactly what a niche is.

In fact, from the webmasters I have spoken to it would seem that a ‘niche’ is just another word for the main topics of pornography, Teen, Asian, Fetish, Gay, Straight, the list goes on and, whilst this list is never ending they are all niches in themselves however, you need to look beyond the top level niche and start to develop a feel, a stance of your own as to what niche you will work on for example, Asian Midgets, you probably cant get more niche than that in this day and age however, realistically, the chances of you a) being able to find the content for this niche and b) Being able to find a sponsor are remarkably thin.

That said, if you can find a niche that you like personally, whether that be she-male, midgets, straight or, gay, this will give you a solid foundation to market your sites on especially if you build on your already vast knowledge of what turns you on.

Now, onto breaking down the niche you are comfortable working in..

Lets say for arguments sake that you have chosen to concentrate on the ‘Gay’ market,, within this market (as with any other) there is a remarkable amount of ‘sub-niches’ and, these are what you need to build your business around whether you want to or not, the ‘sub-niches’ of any given adult market is where the $$$ can be earned.

Now using the gay market as an example the first few niches that come to mind are:

Twink’s – Young looking hairless 18 – 20 year olds.
Bear’s – Hairy men over the age of 20.
Hunk’s – Muscular looking guys in the age group of 20 – 30 .
Straight Guys – Yes, that’s right, gay men get off on looking at straight guys.

As you can see from the above four examples we can now start targeting our market audience a lot better.

The next thing we need to do now that we have found the niche and the sub-niche we will be working is to look for a sponsor that complements the niche of our choice, this is the hard part. Many webmasters will go directly to the highest paying sponsor and throw links up to their ‘sub-niche’ pay site not even looking at the sites tour or members area. This is a huge mistake, the first thing you NEED to do is to look over the sponsors paysites and, more importantly, the sponsors site tour AND members area. What point is there sending your surfers who are after Twink’s if, your sponsors tour has images of a load of guys over the Twink age bracket?

From this point on and, after you have chosen a suitable tour to send your traffic to you need to build up a flow of ‘niche’ traffic the chances are, if you submit your TGP gallery to an ‘all gay’ TGP that you will receive a substantial amount of unfiltered traffic making your hard work in choosing your sponsors tour worthless.

So how do you choose a traffic source that is right for you? Simple, you need to experiment, start of with your niche TGP’s, Top Lists, Links Lists etc and see what happens, how much traffic are you being sent from your chosen traffic source and, more importantly, how much of this traffic is actually clicking through to your sponsors tour. Once you can get an idea of what traffic you are being sent from what traffic source you have won more than half of the battle already.

Record EVERY possible detail about your traffic sources that you can, how much traffic they send a day, how many visits your sponsor gets, how many sales you made, what content you were using etc, etc.

Once you have a working list of data to use you can start to abuse and filter your traffic like you would have not thought imaginable, if one of your sponsors has a higher payout on Bear traffic, then you instantly know what traffic source gives you traffic for that niche and, you can utilize that information to your benefit.

The most important thing to remember however when marketing a niche is that you need to have patience, you need to use a process of trial and error and, more importantly, you need to experiment, just because TGP A sends you 100,000 hits of Twink traffic one day, it doesn’t mean you will get the same quantity of niche traffic the next.

Article written by Le

Converting Japanese Traffic – The Niche Paysites That Work

Date: 2011.02.21 | Category: Traffic | Response: 0

Up to this point we have only looked at the European traffic sources and what niches convert for them however, we will now take a look at the Japanese specific adult surfers and, see just what makes them tick when they come to look online for porn.

Japanese Adult Traffic – Dispelling The Myths.

Contrary to popular beliefs Japanese porn surfers are not all looking for Bukakke or Hentai orientated adult sites in fact, the results we saw far from backed this up. Also, many webmasters believe Japanese traffic is worthless again, from our results this is simply not the case.

Japanese Adult Traffic – The Niches.

We were extremely pleased with the results we found from the Japanese traffic we got to our hub sites in fact, we altered the type of sponsors we used on our Japanese hubs so that we could see just how well this type of international adult traffic converted and, i think you will see the results are worthy of you sending your Japanese adult traffic to sites that do not encompass dialers as the only means of revenue for those surfers after reading this article.

Asian.

We set up a small niche specific ‘Asian’ hub trap that we could use to primarily filter our Japanese traffic through and, as we expected, very little of the traffic actually purchased memberships to these sites that were supposedly made specifically for Japanese surfers instead, all but 2 sales came from sites outside of this ‘Asian’ specific hub.

Ebony.

By far our best converting niche on Japanese traffic, the sales figures we saw from a join perspective were enough to warrant that we altered the rest of our hub site to ensure maximum exposure of the Ebony niche sites we were using to get them in front of the Japanese surfer as quickly as possible.

Anime / Hentai / Toon.

Again another surprise, the sales we saw on these niche paysites were lower overall when compared to sites in completely different niches what was also surprising about this is that the vast majority of adult webmasters will actively push their Japanese traffic to sites in this niche.

Bukakke.

Finding a Japanese Bukakke sponsors was impossible for us, instead, we opted to send the traffic to a US only paysite and, as expected, we had no sales for this niche on the Japanese traffic we saw flowing through our sites. As mentioned above with the Anime niche, this is often the first type of site adult webmasters will send their Japanese speaking traffic too and, as we thought, this is wrong.

Teen.

The teen niche converted really well for us, not as well as the ebony niche did but non the less, we received a steady amount of signups each month, this steady signup rate was also added to by recurring incomes from the previous months signups towards the end of our three month test period.

Gay.

As with the Bukakke niche paysite we received absolutely no sales to the Japanese gay paysite we used in our hub site this was surprising as even with the other international traffic we had gotten at least one sale a month but, alas, it seems the vast majority of Japanese surfers do not want to see naked men online.

Amateur.

Specifically amateur web cam sites converted for us on our Japanese traffic and again, this was good because of the rebills at the end of the month in fact, we still have some rebills continuing now some 5 months after our test period ended.

Japanese Adult Surfers – An Overview.

As expected at the start of the test period, Japanese adult surfers are not primarily interested in Bukakke and Anime sites in fact, it would appear they were primarily interested in the Ebony paysites we had to offer them. This is interesting in itself because, when offered ‘Asian’ niche paysites we only achieved 2 sales a month compared to the vast amount of sales to the Ebony niche, I think it might be worthwhile re-visiting Japanese traffic at a later date so we can evaluate exactly what preferences they have over time.

One other thing we discovered when testing the Japanese traffic was that, as we have been saying for a long time, Japanese surfers do hold credit / debit cards and, will use them online if their needs can be matched. This is good as if, like us, you use recurring sponsors on this type of traffic you will see some good long term residual income.

Article written by Lee

Building A Surfer Trap – Stage 3

Date: 2011.02.21 | Category: Traffic | Response: 0

Building A Surfer Trap – Stage 3.

You should hopefully by now have a basic looking surfer trap ready on your server and on your hard drive.

Now we need to start to ‘dirty’ this surfer trap up a little.

We have already added 1 pop-up console to each of the FPA’s including the Multi-Site FPA.

For the next step in this ‘dirtying’ process we need to add some additional links onto each of the FPA’s including the Multi-Site FPA.

On the FPA’s what you need to do is create a ‘no thank you’ link so, if your surfer does not want to visit the site for the FPA you have sent them to you can send them to an alternative.

This no thank you link can go to one of two places, you need to decide where you feel the traffic can be best utilized however, from my experience i would highly recommend using this first method:

Link the ‘no thank you’ text on each of the single site FPA’s to another DIFFERENT niche FPA in your surfer trap so, as an example, if your surfer is on the All Petite FPA in your trap, the ‘no thank you’ link would lead to Just Toon’s. If they decide not to go with the Just Toon’s site, the ‘no thank you’ link on this FPA would go to Gay Ultra and so on, you need to ensure however, that the ‘no thank you’ link goes to a completely different niche to the one of the FPA the surfer is currently on.

The second option you have is to link the ‘no thank you’ text to the ARS POTD (picture of the day) program. This will be your last chance at selling the surfer to one of the ARS pay sites.

In addition to the ‘no thank you’ link on each of the FPA’s you also need to add a small table to the Single-Site FPA’s. ideally this should be four columns across and 2 rows down. This will give you 8 places to put a one or two word link going to another different niche FPA than the one the surfer is currently viewing however, you also need to ensure that these 8 links are going to a different FPA than the ‘no thank you’ link you have created.

The above stage is where we could potentially start to lose people in the instructions therefore if you have ANY questions or queries regardless of how small they may be please post on the forums.

This stage should hopefully only take you a couple of hours to complete and, once you have tested all of the links and uploaded the FPA’s to your server you are all set for the next MAJOR step in this project…. Generating Fresh Traffic.

Article written by Lee

The Gay Opinion – Obscenity Laws and the Gay Market

Date: 2011.02.23 | Category: General | Response: 0

Let me begin by saying this is not a legal dissertation, but a collection of opinions on the recent comments and events inside the industry.

Obscenity Laws have always been the “fly in the ointment” for adult. Not knowing when, if or how the government will act toward webmasters or companies.

So what do I think? Every indicator out there says something or someone is coming. Big Brother is on the prowl. But, how will webmasters in the gay market act to ward off the evil?

While discussing this with a number of webmasters, I found that the gay opinion is spread as wide as a gigolo’s legs on payday. The thoughts that have been shared vary from ultra conservative to down right militant. And once again, I find myself stuck dead in the middle.

Here is a sampling of the opinions at large:

I’ve heard from some webmasters who have a “come and get me attitude”. Their approach is the government has done enough damage to the gay community over time.

Their attempts to sanction the gay adult industry will be simply another shot at taking us down – and that attempt will garner a public/media fight of the government acting as a bully. Now does this have anything to do with adult? No matter how I look at it, the one subject isn’t related to the other. Personally, the government’s reaction/treatment to the gay community has little to do with the government’s action towards adult. Yes, I can totally see how they got there, but it’s not enough for me.

There is the “what else is new” set. This is a group of webmasters who own pay and/or free sites, have been doing this for a long time and they have adapted their companies and their marketing to sell memberships to the surfers. They use softcore and stories already on their feeder sites, have webmaster programs and they are happy with the results and will not change a thing. Their methods work – methods are not blatantly sexual but more sensual and the conversions are a testament to that. By the way, this is where I stand (right in the middle). The general thought is nothing has happened yet. Work smart and don’t panic.

The other side of this is the “oh shit’ers”. These webmasters are re working their entire networks of gay porn to follow a well-established method of softcore only. Make them Pay for the Meat! They are reacting by taking down all hardcore images from their sites in order NOT to stir up any government dirt. Well as far as I’m concerned, they should have been doing this to begin with… sell the hardcore to members don’t give it away on a free site. For this, group the panic is on.

Finally I spoke with the “fuck ’ems”. Now their idea isn’t that the government is suppressing the gay community. They look at this totally as a first amendment issue of freedom speech and expression. They use both hardcore and softcore to resell for webmaster programs and frankly, they feel that they will prevail over any government attack simply by way of Bill of Rights. They’re making money and they don’t care who knows about it.

What does this all mean? Well here’s my take…

First, it’s apparent that the opinions are just as varied as webmasters working the straight market.

There is a general feel of, don’t panic – more than I have seen with straight market webmasters. I honestly, think this comes from our years of battle against the government on many other issues. Until the rumors become fact we will move as we always have – then deal with what is concrete rather than the abstract.

Overall, the most resolute business people I have heard from, all said the same thing. If you use common sense, use methods that work and that do not go overboard there will be no need to panic. The hobbyist who is trying to make a million will leave out of fear, the “over the top” websites will be the target and those businesses run with common sense will continue with no major issues. I think my favorite statement to come out of these conversations is, “The government will bite, if you give them the bone. Don’t feed them and they go hungry.”

I see the same “proceed as usual” attitude out there, as I have always seen in the gay community. Deal with the facts and only and not rumors.

Once again, this is totally based on opinion and by no means a legal stance. If you have any doubts, concerns or questions about obscenity laws in your area or in general, please consult your attorney.

Article written by Gary-Alan

Adult Exit Traffic

Date: 2011.02.21 | Category: Traffic | Response: 0

How Do You Use It?

I honestly do not think there is a webmaster working in the adult industry to date who has not seen a warning page for a free or avs site with both an enter and an exit link, the enter link goes to the main body of the site in question whilst the exit link goes to some other link, normally disney.com or google.com or some other url where the webmaster in question is quite literally throwing their traffic and money away.

Instead of wasting your exit link traffic to a site that doesn’t make you a cent why not utilize this traffic to feed additional revenue streams, for example, most of the larger adult sponsors now have penis pill programs or dating sites, you could include your affiliate id in the exit link and send your traffic there, after all, the surfer you have on your site isn’t looking for porn so, offer them an alternative which, can still add to your bank balance.

So What Are The Alternatives?

The alternative types of sponsors you should be using on your exit links can vary widely however, the best type of site to send them to would be a sponsor offering products and services such as penis enlargement programs, online pharmacies, history eraser type products or, even a link to a site like amazon.com if the program you use allows for that.

Basically you should try to maximize all the traffic you get to your site whether that be by using exit consoles or links, make sure that for each and every surfer you send to the front page (warning) of your site that if they decide to back out or click on a link to leave that you send them somewhere to give them the option of spending money and ultimately earning you revenue.

Article written by Lee.

Robots.txt – Control The Robots That Crawl Your Sites

Date: 2011.02.24 | Category: Search Engine Optimization, WebDesign | Response: 0

By writing a structured text file you can indicate to robots that certain parts of your server are off-limits to some or all robots. It is best explained with an example:

# robots.txt file for general use on web servers.

User-agent: webcrawler
Disallow:

User-agent: googlebot
Disallow: /

User-agent: *
Disallow: /cgi-bin
Disallow: /logs
The first line, starting with ‘#’, specifies a comment.

The first paragraph specifies that the robot called ‘webcrawler’ has nothing disallowed: it may go anywhere.

The second paragraph indicates that the robot called ‘googlebot’ has all relative URLs starting with ‘/’ disallowed. Because all relative URL’s on a server start with ‘/’, this means the entire site is closed off.

The third paragraph indicates that all other robots should not visit URLs starting with /cgi-bin or /log. Note the ‘*’ is a special token, meaning “any other User-agent”; you cannot use wildcard patterns or regular expressions in either User-agent or Disallow lines.

Two common errors:

Wildcards are not supported: instead of ‘Disallow: /tmp/*’ just say ‘Disallow: /tmp’.
You shouldn’t put more than one path on a Disallow line (this may change in a future version of the spec)
Ultimately, without the use of robots.txt files on your servers/domains, you are risking a variety of potential problems including, unauthorized access to your cgi directory, unauthorized viewing of your site stats, possible spamming of the search engines by accidental crawling of doorway pages.

One distinct advantage however of having a robots.txt file on your server is that, quite simply, you will be able to tell when and where your site has been indexed or potentially indexed as, all robots will automatically call for the robots.txt file BEFORE any other page on your server so, as long as you keep an eye open for any calls of this file, you can see who is knocking at your site for indexing purposes.

Below is a robots.txt example that you can copy and paste into a text document to use on your own server:

<!–Start Copy Below This Line–>

User-agent: *
Disallow: /cgi-bin
Disallow: /logs

<!–End Copy Above This Line–>

The above will allow all spiders to crawl all of your site except the subdirectory’s ‘cgi-bin’ and ‘logs’ which, may be altered to suit any subdirectory’s you do not wish the spiders to crawl on your server.

Article written by Lee