Converting French Traffic – The Niche Paysites That Work

Date: 2011.02.21 | Category: Traffic | Response: 0

In our last article we took a look at a three (3) month period of international traffic stats and, what niches worked on German adult traffic. In this article we will do the same again except we will be analyzing what niche paysites worked best on French porn surfers.

French Traffic – Quick Analysis.

It would seem that for many of the surfers we managed to grab and filter from France that their primary interest was in Teen and the Amateur niches although, that said, we did get a few conversion on some fetish paysites, specifically fetish sites that had ‘watersports’ and ‘BDSM’ featured on the paysites tour pages.

French Adult Traffic – The Niches.

As with the German traffic we targeted in the previous article we also filtered our French adult traffic to some niche specific hub sites as well as some general hub sites to better judge which niches converted the best on French surfers the results we experienced are as follows.

Teen.

Our conversions on French teen sites were not as good as what they were for German surfers however, that said, they were good non the less. With a ratio of around 1:192 over the three month period we analyzed the French adult surfers we managed to get to our sponsors sites worked well for us.

Amateur.

With our amateur conversions the one thing we noticed was that tours that featured teens as the main focus were the ones which converted consistently, with this in mind, we did change a couple of the Amateur tours we used to see how that would affect sales towards the end of the 3 month period and, sales did drop slightly, this would backup the statements in the Teen niche made above in that, French surfers are looking primarily for Teen orientated paysites.

Asian.

The two Asian niche paysites we used didn’t have many sales overall however, we did notice that the little traffic that we sent to them converted well, as above, Asian niche sites that featured teens were again the better converters on the French traffic we received.

Ebony.

I think it is worth mentioning the ebony niche, especially when you take into account we sent less than 100 hits to French ebony paysites and, managed to get 2 sales from those hits. Unfortunately, we did not anticipate the amount of traffic that wouldn’t choose the ebony niche so we have no solid figures that are worth mentioning here or, any explanation behind how we made the sales.

Fetish.

Our French fetish traffic seemed to like the more niche specific type of tours, making us sales on Watersports, BDSM and even general fetish paysites that said, the figures we achieved with the fetish pay sites we used were disappointing as we had thought this would be the ideal niche for the French markets.

Gay.

The sales we achieved with our gay French traffic were reasonable overall, the surfers chose to signup to gay sites that featured ‘twink’ like models on the tours again, this would lend favor to the fact that overall French surfers seem to be interested in the younger generation to get their kicks.

French Traffic – The Results.

Overall we were happy with the majority of the results we received on our French adult traffic with the exception of a few bad choices on our part trying to concentrate on the Fetish side of the industry. We certainly learnt that it would appear French adult surfers are looking for Teen orientated sites over the other niches.

Article written by Lee

Becoming A Webmaster – Communication Home Truths

Date: 2011.02.21 | Category: General | Response: 0

Ok, we are ALL guilty of the things that are going to be mentioned in this article in one way or another, this article isn’t going to be a ‘see I told you so’ session rather an explanation of how and why certain things happen from time to time in the adult industry and, how they can be overcome.

Get ready, his may make you realize the way you have been managing your time this far has been completely and utterly wrong.

Message Boards.

A great tool to the webmaster, virtually every resource site owner and their friend has one but, there is one thing that you are not being told as often as you should about them, they ARE counter productive to YOUR work schedule. Think about it, how often do you access a discussion forum on a daily basis? Two, three, four times? maybe more? That time you could be using more effectively, coming up with new ideas, putting sites together, tweaking your traffic sources etc.

I would whole heartily agree that there IS a need for forums but, at the same time, what would happen if every time we went to post a message we left it and posted a selection of them in some time put aside for doing so? Another thing regarding message boards, they are there to benefit the webmaster, we can let our sponsors know when we have issues, we let other webmasters know when we have issues with them and, we also ask for help and advice, as I say a great tool to the webmaster but also one that should IMHO be used with a little modicum.

Instant Messaging Clients.

Again, another great global communications tool for webmasters, we get in touch with our sponsors, our peers and our friends and family but, how many of us spend countless hours a day conversing back and forth about things that, quite frankly, are of little or no importance? Who can honestly say they have time set aside each day to purely log onto your messaging client to just communicate with people? I know I am guilty of keeping my client on 24/7 and answering messages almost instantly whilst also bugging my peers for idle chit chat.

Email.

The Bain of every webmaster, speaking from personal experience, if I don’t check my email 50 times a day I check it 100, first thing I do in the morning, check my email, last thing I do before I go to bed? Check my email. I realize there is absolutely no need for me to do this but, non the less I do, its almost as if I have become addicted to checking my mail. I’m sorry to say it but, again, this is one thing that we probably couldn’t live without but, we can certainly cut down the time we check our email each day. If I never had to reply to an email again, I would be happy, as it is I get close to 200 business related emails on a daily basis and, lets be honest, I rarely reply to them the same week.

Sponsor Statistics.

Again, another GREAT tool that we are kindly given by our sponsors but, again, even this simple tool can become a Bain to the webmasters workload. How many times do you check your stats on a daily basis? Hell, even I will admit to checking them 3 times a day and, yes, I know even this is to many times. Some sponsors now have stats by email, again, this is better than logging into your stats each day but, it also adds tot he problem with email checking above. Basically, there is only a need to check your stats once a day if that. I used to check them every hour then, for whatever reason, I checked them once a week, then I slowly got back into the phase of checking them morning, noon and, night. The stats are still there every time I look so why do I bother? I guess that’s one of the mysteries of life but, I know I spend far to much time checking them and waiting to see an additional sign up or two on top of what I already have.

Anyway, I’m going to leave this article alone at this point, as, the above would seem to be the most popular methods of wasting time on a daily basis, we all know we waste our time and we all know that what we need to do is manage it better but, how and when, getting our time management sorted out takes time in itself.

Article written by Lee

Sample Adult Model Release Form

Date: 2011.02.21 | Category: Forms & Contracts | Response: 0

For many webmasters the option of being able to shoot their own content is a wholly viable one as such, you should ensure that the models you are using sign a suitable release form. Below we have set together a pretty industry standard model release form which you may duplicate if you so wish. European Webmasters would however, recommend that you get professional legal advice in respect of this matter and that this is no substitution for proper legal advice.

I, (Please Print) ____________________ (Model), for good and valuable consideration, the receipt of which is acknowledged, give to [INSERT YOUR LEGAL NAME HERE] (Photographer), his legal representatives, successors, and all persons or corporations acting with his permission, unrestricted permission to copyright and/or use, and/or publish photographic portraits or pictures of me, and the negatives, transparencies, prints, or digital information pertaining to them, in still, single, multiple, moving or video format, or in which I may be included in whole or in part, or composite, or distorted in form, or reproductions thereof, in color or otherwise, made through any media in his studio or elsewhere for art, or any other lawful purpose.

I hereby waive any right that I may have to inspect and approve the finished product or copy that may be used in connection with an image that the Photographer has taken of me, or the use to which it may be applied.

I further release the Photographer, or others for whom he is acting, from any claims for remuneration associated with any form of damage, foreseen or unforeseen, associated with the proper commercial or artistic use of these images unless it can be shown that said reproduction was maliciously caused, produced and published for the sole purpose of subjecting me to conspicuous ridicule, scandal, reproach, scorn and indignity.

I acknowledge that the photography session was conducted in a completely proper and highly professional manner, and this release was willingly signed at its termination.

I certify that I am not a minor under the laws where I live, and am free and able to give such consent.

Model’s signature:_________________________ day___/month___/year_____ Address:___________________________________ City:______________________________________ State/Province:______________________________ Country:___________________________________
Zip/Postal Code:_____________________________
Country area code and home telephone number:(______)____________________________
Witness (non family member):___________________________________
Witness (non family member):___________________________________
This form will be retained with the negatives, transparencies, digital media, and/or contact sheets. day___/month___/year_____ {INSERT YOUR LEGAL NAME HERE}.

The above model release form is to be used as a mere example form and, when entering into any contractual agreement with any model for photographic / video work you should always seek proper legal advice.

Article written by Lee.

What Is The Golden Ratio?

Date: 2011.02.24 | Category: Sponsors | Response: 0

Its a little known marketing technique that say that, as long as the longest side on any oblong is 1.6 times the length of the shortest side of the same oblong people will be more likely to prefer that shape over any other shape.

Why do they prefer this size? Because it occurs naturally and, subconsciously EVERY LIVING PERSON is attracted to this trait.

An example of this is as follows:

1) Stand Up
2) Measure the distance from your head to your feet and write this measurement down
3) Measure the distance from your Navel write this figure down.

The length of your ENTIRE body is 1.6 times longer than from your Navel to your feet!!

The same is also true for the length of your arm from shoulder to finger tip, then from elbow to finger tip.

The same is true for credit cards, the longest side is 1.6 times longer than than the shorter side!

Think about this for a second, banner ads, what shape are they? Oblong except, they don’t employ the ‘golden ratio’ what if, just what if, you used some banner ads that employed this ‘golden ratio’ who says banners have to be 468×60 in size?

Why not try making some ‘basic’ banners in paint or a decent graphics program utilizing the 1.6 rule and see if your click thru’s increase, personally, I will bet my earnings last month that they will.

On the same way of thinking towards marketing, table ads, money bars, etc, why not incorporate this idea into them also? It cant hurt and who knows it may just work.

the math to work this ‘golden ratio’ out is as follows for Image a above:

shortest side (60) x 1.6 = (90) Longest side

You don’t even need to be a genius to make your own ads using this method as the people at Microsoft supplied you with a calculator.

Article written by Lee

Adult Webmaster Health

Date: 2011.02.21 | Category: General | Response: 0

Sounds to me like you are a webmaster. Most of us realize that working at a computer everyday can and often is, bad for our health in one way, shape or, form. However, how do we alleviate these potential problems with our health?

Well in this article I will detail some of the things that can often affect the webmasters in our industry and how they can be solved.

RSI (Repetitive Stress Injuries) are the results of, as you may have figured out already, the effects of constantly doing the same movements over and over again using specific parts of your body. One of the most common of these that webmasters are aware of is CTS (Carpal Tunnel Syndrome) which is a result of typing a lot.

So, how do you combat the effects of CTS? First and foremost, if you experience any form of pain at all, your first port of call should be the doctor, the pain you are feeling could be an indicator of a bigger problem. If you think your pain might be caused by use of the computer then an occupational therapist might also be a good person to visit.

CTS is often attributed to use of your digits and poor hand positioning when you type one way to solve this problem is to go to Office Depot and purchase a wrist rest, this will ensure your wrist has ample support whilst you are working throughout the day.

You might also like to try re-positioning your monitor, as a general rule of thumb, having your monitor placed about 20 inches away from your face will usually result in good posture and that in itself can often be a solution to the potential medical problems. One other thing on your posture, get a good chair, one with a high back may be good, these generally offer you more support and, can stop that awkward habit of leaning into your keyboard when you type.

Eyestrain, Eyestrain is another common problem that the webmaster faces, often it leads to things such as excessive headaches, fatigue and, blurry vision, the most acceptable relief from eyestrain is the use of screen filter that will reduce the glare your monitor emits.

There of course, some other things you can do to alleviate this problem such as, Adjusting your monitor so the top of the screen is no higher than eye level, as already mentioned, keeping the monitor a safe working distance from you, usually between 18 and 30 inches is recommended by doctors.

We know computers are machines and tend to forget that our own bodies are complex machines which, should be looked after just as our computers should be, we often forget that sitting at the PC building what was meant to be a 10 minute site can turn into an hours worth of ‘online work’. Take some time every now and again to stand up and walk for 5 minutes, even if it is just to the local store to buy some more smokes, you are actually getting some exercise and, even though the tar in your smokes will end up killing you anyway, you’ll at least be able to work a little longer without getting any problematic computer related medical symptoms.

This article is not meant as an alternative to visiting your physician and, should you think that any of the above are relevant to you then it is recommended that you visit your doctors without delay and follow any advice that they give you.

Article written by Lee.

Guaranteed Marketing – Power Words

Date: 2011.02.22 | Category: Search Engine Optimization, Writing | Response: 0

How many webmasters do you think actually pay attention to what they are writing so far as their sales copy go? Furthermore, if you actually think about it, how much time do you put into choosing the words in which you use on your websites? With the help of this brief article hopefully, you will start to choose the words in which you use a little more carefully, let me explain.

Power Words – What Are They?

Power words are a set of roughly 10 words that can invoke interest in a person, object or, in our case, a product which we would like to sell however, they are also much more than that. When used in the correct manner power words can become a webmasters greatest selling tool. However, everyone has their own unique set of power words that will appeal to them over everybody else, the good thing is, for the most part there are at least 25 words which almost everybody will look positively towards.

Power Words – The List.

The following list is compiled from research at Yale University consisting of the most popular power words amongst a demographic of 1000 individuals of mixed sex. The words are, Discover, Easy, Guaranteed, Health, Love, Money, New, Proven, Results, Safety, Save and, You. By using these words in a variety of ways when writing our sales text we can almost be certain that we will keep the surfers attention and enable us to put the power of our marketing to good use.

Power Words – Uses.

As already mentioned, the best use for the most common power words on our sites is to use them within our text links either at the start of the sentence or, the absolute end. Take a look at the following example to see what i mean.

1) High Converting Affiliate Program.
2) Guaranteed To Convert Your Traffic.
3) Turn Your Traffic In To Cash – Guaranteed.

You can see from the three examples above the the first example doesn’t really catch your attention whilst examples number 2 and 3 somehow seem to pull you into the ‘spirit’ of the site itself without even knowing what affiliate program it is.

By using this power word marketing technique as often as possible on your text links you can not only give your site visitor information but, compel them to click on your link.

Power Words – An Overview.

Hopefully you have seen from this brief article the ways in which power words can improve not only your text links pulling power but also how with the right marketing combination you can also use them to increase your sales.

Article written by Lee

How To Use ALT Tags On Your Sites

Date: 2011.02.24 | Category: WebDesign | Response: 0

One simple technique can improve your search engine rank, make site navigation easier, and increase the accessibility of your site to disabled visitors. Yet, as many as 78% of sites don’t use it! Boost your site’s profile with human visitors and search engine spiders with the <ALT> tag.

Inserting ALT Text

Adding <ALT> descriptions to your <IMG> tags is quick and easy. You don’t have to do any complex HTML coding. If you can describe your image or link, then you can add ALT tags to your code.

We’ve used some examples below:

<img src="thumbnails/porn.jpg" 
  width="100" height="78" ALT="Explicit Teenage Sex Pictures">

You can also include an ALT tag when your image is a link:

<a href="porn.html"> 
<img src="thumbnails/porn.jpg" 
width="100" height="78" ALT="Explicit Teenage Sex Pictures"></a>

Ideally, your ALT text descriptions should be complete sentences, rather than a list of keywords or obscure phrase like “company logo small 2.” Remember that all visitors are likely to see (or hear) some version of your ALT text so be sure that it’s meaningful.

Optimize ALT Descriptions For Search Engines

Besides helping human visitors, ALT descriptions help you rank higher in some search engines. AltaVista and Google are two of the search engines that use ALT descriptive text when they rank Web sites. The growth of search engine/directory partnerships means that a high rank in one engine can often translate into an improved rank on its partner sites.

Search engine algorithms calculate the number of times keywords are repeated and give higher rank to pages that use them often. Keywords in the ALT descriptive text help you increase their frequency on the page. Search engines assume the terms are more relevant and important if they’re used in the page content, not just listed in the META tag.

For instance, the descriptive text in the example code uses keywords and keyword phrases from the META keyword tag: Explicit Teenage Sex Pictures. Since these are relevant to the site’s content, they’re easy to include as descriptive text.

If you’re having problems choosing relevant, targeted keywords, refer to this article, How To Pick Your Keywords. It provides helpful tips about selecting keywords and using them to improve your search engine ranking.

Make Your Web Site Sticky

ALT tags help you promote your site in another way too: they help make it “sticky.” Sticky means that visitors stay at your site longer so they see your advertising and purchase your memberships. Visitors who feel comfortable at a site will stay longer – and hopefully return more often to make further purchases.

Disabled visitors who use text-only or spoken word browsers rely on the ALT text for clues about the image’s content and function. This can be a lucrative audience: they represent a worldwide audience of 750 million and spend twice as much time online as the average user. But it isn’t just a disability issue: ALT tags make your site more accessible to everyone.

Visitors see your ALT text while the images are downloading or when they mouse over images. The descriptive text helps them decide if they want to wait for an image to download or move on to a different page. If your image is also a link, then visitors can read the explanatory text and quickly jump to the section they want.

Site navigation is easier, so impatient visitors are less likely to leave the site.

Don’t Follow The Crowd

ALT tags are a small addition to your HTML code that can make a big impact on your site. Since many of your competitors don’t use them, give your site and edge and include them on all images.

Article Written By Lee

Outsourcing – Becoming More Profitable Online

Date: 2011.02.24 | Category: Employment | Response: 0

As webmasters we already do a lot of outsourcing from hosting our sites to design and marketing to getting traffic which we send to our sponsors. However, many of us are missing out on opportunities to outsource even more of our work and, by missing these opportunities, we are losing money.

Outsourcing work can consist of anything from translations, design, scripting, marketing, seo, site submissions and pretty much anything and everything in between.

However, before we outsource some work to others there are several factors that need to be taken into consideration these are what will be addressed in this article.

Cost.

Ensuring we work ‘cost-effectively’ is one thing we all want to do, we need to make a profit whilst still being able to develop our business further. One good way to find out if the costs of outsourcing outweighs the cost of keeping the work in house to make a simple list of both the time and financial involvements both in and out of house. For example, in house you may have employees that need paying to do the work, you will almost certainly need to spend a lot of your own time on the project and, more likely than not you will need to research the work you want to undertake, all of this can become costly when looked at in detail a good reason to outsource your work to another company or individual.

Benefits.

How will outsourcing benefit you and your business? As with the cost example above make a list of things that will benefit you from the time saved on the project to the monetary benefits of outsourcing the work and the completion times often, by outsourcing your work you can have it done in much less time than if you handled it yourself ‘in-house’ so to speak.

Flexibility.

What are the indirect benefits of you outsourcing your work? Not necessarily the money saved but more along the lines of time management. if you give a designer a list of ideas and suggestions you WANT your work to have, chances are, they will get it right the first time whereas, if you amble along experimenting with what you actually create you may, in effect, take much longer to complete the task in hand. By saving yourself time what else can you get done, whether it is building more sites or marketing your existing sites further the indirect benefits all weigh up more often than not, these benefits will be favorable to outsourcing the work.

Risk.

This is probably THE most important thing to take into account when considering outsourcing your work, what happens if, you pay for the outsourcing and, overnight the company who is doing the work for you goes out of business? What happens if someone you have in your employ decides that they would rather be doing the work rather than you outsourcing it? Financially can you afford to outsource the work? All of these factors need to be considered before undertaking any form of outsourcing.

Basically, what I am trying to tell you is that, if you spend a few moments actually running the numbers as oppose to the ideas you have in respect of your workload you will see that outsourcing can be come a valuable asset to your business and, more importantly, your bottom line profits.

Article written by Lee

Censored Gay Adult Pornography

Date: 2011.02.21 | Category: General | Response: 0

You’ve heard it said over and over “Make them pay for the pink” or in the case of the gay market “make ’em pay for the MEAT”. But how far can you get without hardcore on a gay site?

Depending on the method you use to get your traffic softcore verses hardcore can make a big difference. If you’re working the SE’s, you set the tone by way of your descriptions and keywords – and you hope that they get you the rankings and the surfers. On the other side of the fence, when you use link lists and categorized directories, their categories will dictate where your site will go. Thus, you are totally out of the loop when it comes to its placement.

For the past six months I have been conducting a test. I built ten free sites, all to derive their traffic from link lists. Five were strictly softcore and the others a mix of softcore images and “selective” hardcore images. Each had 40 pics in order to play to the larger LLs and directories.

Let me give you a little background. The reason I started this test was to track the traffic trends in the gay market as it applied to the notion of “make ’em pay for the meat”. It was something I had done with my straight sites, but something I totally avoided with my gay sites. The reason for that one a statement I made a while back “If I wanted to see softcore I could look in the mirror when I got out of the shower.” While this is a totally narcissistic comment, it does demonstrate my ongoing point about selling to gay men.

Now don’t get me wrong in the scheme of thing I do like softcore images of the right person, but as a surfer who is looking to get off, I want what I can’t normally have. And that idea is going to send me to a site that will has what I want, OR in the case of this test, THINK that I want.

Now back to the test sites. For my softcore sites, I took various images of single men in different phases of undress from stripping to provocative poses. For the hardcore I was much more selective. I used what I call US Cable or Int’l Tele guidelines. What that means is, what do I see if I turn on a cable station or one of the satellite channels from around the world. I found “simulated sex”. Just like an R rated movie, there were scene where two guys are together with no close ups of actual penetration. So, when I went through my web images I looked for similar scenes. The images were sexual but nothing so blatant as up close penetration but suggestive enough to arouse a surfer – the taunt factor I would need to sell my sponsor sites.

With my distinct sets of sites, I began to submit to the Link Lists. 99% of the sites were accepted for each of there categories (the one that didn’t get accepted had a hardcore description and softcore images – oops). But after making the correction it was accepted.

The traffic started to come in. In the first day, the difference I anticipated was right there. I decided I wouldn’t effect anymore change in traffic so I didn’t submit to any other link lists. I wanted to test this out. At the end of the month the trends I expected were in fact there. The total of all the traffic generated 10% came in to Softcore sites. The remaining 90% came in through the hardcore sites. So this tells me that most gay surfers are hitting the hardcore categories on the LLs. It confirmed my previous assumptions.

What’s the sense of doing all of this and not watch all avenues, right? Now having scrutinized where the traffic was coming from and how, I wanted to trace how it was going out.

I used an older cgi program to track the hits out. It’s one of those standard programs that I learned to use years ago and can’t get rid of. Now remember, all of the sites are pretty much the same with wording, sponsors, color schemes, etc. The only real difference was the pics.

Based on the numbers collected from the program I found that approximately 75% of all the traffic coming into the softcore sites left on a link to one of the link lists. I had 20% go out on a sponsor’s link and the remaining 5% did not resolve (which in this program I was using tried to count the click but was unsuccessful).

Now reviewing the information from the hardcore sites, I found a distinct difference. I will not lie to you. I expected a difference. I don’t want you to think I was awestruck LOL. But, I was surprised with what I found. This time the majority went out to my sponsors – 50% went to a sponsor site, 20% went out to the reciprocal links, 19.9% went to a free gay email site (which wasn’t enough to mention on the softcore sites), 5% did not resolved. The remaining 5.1% I have no idea – they probably whacked off and logged off (I hope it was good for them LOL)

While it is not the point of this article, I will add that the traffic produced reasonable well at the sponsor end.

Let me say that my “trends in gay adult traffic” research is by no means complete. However, over the period of six month these ten sites were enough to say there is marked difference between softcore and hardcore sites. So does “make ’em pay” work in the gay market? For now, there is a definite factor depending on where you get your traffic. If links lists are your specialty, then the answer is yes.

My next step in the evolution of this is to submit these sites into the search engines. With all things considered, I’m looking forward in tracking that information. I’m off to submit. I will share the data I collect from that test soon.

Now, I just hope DMOZ doesn’t give me a hardcore time ; )

Article written by Gary-Alan.

Robots.txt – Control The Robots That Crawl Your Sites

Date: 2011.02.24 | Category: Search Engine Optimization, WebDesign | Response: 0

By writing a structured text file you can indicate to robots that certain parts of your server are off-limits to some or all robots. It is best explained with an example:

# robots.txt file for general use on web servers.

User-agent: webcrawler
Disallow:

User-agent: googlebot
Disallow: /

User-agent: *
Disallow: /cgi-bin
Disallow: /logs
The first line, starting with ‘#’, specifies a comment.

The first paragraph specifies that the robot called ‘webcrawler’ has nothing disallowed: it may go anywhere.

The second paragraph indicates that the robot called ‘googlebot’ has all relative URLs starting with ‘/’ disallowed. Because all relative URL’s on a server start with ‘/’, this means the entire site is closed off.

The third paragraph indicates that all other robots should not visit URLs starting with /cgi-bin or /log. Note the ‘*’ is a special token, meaning “any other User-agent”; you cannot use wildcard patterns or regular expressions in either User-agent or Disallow lines.

Two common errors:

Wildcards are not supported: instead of ‘Disallow: /tmp/*’ just say ‘Disallow: /tmp’.
You shouldn’t put more than one path on a Disallow line (this may change in a future version of the spec)
Ultimately, without the use of robots.txt files on your servers/domains, you are risking a variety of potential problems including, unauthorized access to your cgi directory, unauthorized viewing of your site stats, possible spamming of the search engines by accidental crawling of doorway pages.

One distinct advantage however of having a robots.txt file on your server is that, quite simply, you will be able to tell when and where your site has been indexed or potentially indexed as, all robots will automatically call for the robots.txt file BEFORE any other page on your server so, as long as you keep an eye open for any calls of this file, you can see who is knocking at your site for indexing purposes.

Below is a robots.txt example that you can copy and paste into a text document to use on your own server:

<!–Start Copy Below This Line–>

User-agent: *
Disallow: /cgi-bin
Disallow: /logs

<!–End Copy Above This Line–>

The above will allow all spiders to crawl all of your site except the subdirectory’s ‘cgi-bin’ and ‘logs’ which, may be altered to suit any subdirectory’s you do not wish the spiders to crawl on your server.

Article written by Lee