Robots.txt – Control The Robots That Crawl Your Sites

Date: 2011.02.24 | Category: Search Engine Optimization, WebDesign | Response: 0

By writing a structured text file you can indicate to robots that certain parts of your server are off-limits to some or all robots. It is best explained with an example:

# robots.txt file for general use on web servers.

User-agent: webcrawler
Disallow:

User-agent: googlebot
Disallow: /

User-agent: *
Disallow: /cgi-bin
Disallow: /logs
The first line, starting with ‘#’, specifies a comment.

The first paragraph specifies that the robot called ‘webcrawler’ has nothing disallowed: it may go anywhere.

The second paragraph indicates that the robot called ‘googlebot’ has all relative URLs starting with ‘/’ disallowed. Because all relative URL’s on a server start with ‘/’, this means the entire site is closed off.

The third paragraph indicates that all other robots should not visit URLs starting with /cgi-bin or /log. Note the ‘*’ is a special token, meaning “any other User-agent”; you cannot use wildcard patterns or regular expressions in either User-agent or Disallow lines.

Two common errors:

Wildcards are not supported: instead of ‘Disallow: /tmp/*’ just say ‘Disallow: /tmp’.
You shouldn’t put more than one path on a Disallow line (this may change in a future version of the spec)
Ultimately, without the use of robots.txt files on your servers/domains, you are risking a variety of potential problems including, unauthorized access to your cgi directory, unauthorized viewing of your site stats, possible spamming of the search engines by accidental crawling of doorway pages.

One distinct advantage however of having a robots.txt file on your server is that, quite simply, you will be able to tell when and where your site has been indexed or potentially indexed as, all robots will automatically call for the robots.txt file BEFORE any other page on your server so, as long as you keep an eye open for any calls of this file, you can see who is knocking at your site for indexing purposes.

Below is a robots.txt example that you can copy and paste into a text document to use on your own server:

<!–Start Copy Below This Line–>

User-agent: *
Disallow: /cgi-bin
Disallow: /logs

<!–End Copy Above This Line–>

The above will allow all spiders to crawl all of your site except the subdirectory’s ‘cgi-bin’ and ‘logs’ which, may be altered to suit any subdirectory’s you do not wish the spiders to crawl on your server.

Article written by Lee

Designing A 404 Error Document

Date: 2011.02.21 | Category: WebDesign | Response: 0

Designing A 404 Error Document.

Now that we know how to use .htaccess let’s get into how exactly to effectively design a 404 error document page. Here are a few tips when building your document:

Keep The Design Constant.

That is, whatever design your web site supports, consider keeping that design when building your error document. This is not mandatory, however. If you have a good reason to stray from your design, then do so. Otherwise, keep it constant.

Use Attractive Dialog.

Do not use the word error. Error signifies something is terribly wrong, and while that may be so, you should give that information to your visitor in a very friendly way. Instead, consider writing “Sorry, the page you were looking for is not available at the moment”.

Include Contact Information.

Obviously, you want to fix the error, so give the user every opportunity to e-mail you about the error. Some users will not bother to do so, but you still need to give them the opportunity.

Keep The Visitor Moving.

Often, 404 error pages are like road blocks, or brick walls that the user cannot pass through. You need to break through the barriers and allow the visitor to keep traveling through your web site. If your web site supports a search capability, include a form on your error document to let them search for the information they were originally seeking. At the very least, include a link to your home page.

Give Them A Site Map.

When the user clicks upon a page that is no longer available, or was mistyped by the webmaster, consider adding a link to a site map page, or include your site map right on your 404 error document, so the user can get their bearings within your site, and can locate their desired content quickly and easily.

Give Them Help.

List tips on your error document page to help the visitor diagnose the error. For example, ask them to double check the URL in their browser’s address bar. If it’s correct, politely ask them to e-mail you to report the error. Also suggest that they visit your home page (or search utility) to find the information they are after.

List Some Popular Links.

Provide the user with a few links to your most popular content areas of your web site, as it is more likely they were searching for that content than anything else.

As you have seen, error documents are more important than you may think. Merely having a custom error page shows you have put forth effort on your web site and want to help the user find the information they need. Error documents are easy to create and adds professionalism to any web site.

Article written by Lee

Protecting Your HTML Code With JavaScript

Date: 2011.02.24 | Category: Scripts, WebDesign | Response: 0

We all know that source code theft is wrong and covered by copyright never the less some webmasters will inevitably try to steal the work that the honest ones amongst us create.

Unfortunately, there is no sure fire way to stop people from stealing our HTML code but, we can make it hard for them.

The following JavaScript coding, when placed in your <body> tag can make it harder for the opportunistic webmaster to steal your coding.

Simply copy and paste everything below into your body tag and change the text in the var message=”” field.

<!–Start Copy–>
<SCRIPT language=”JavaScript”>
<!–
var message=”Copyright 2000 by Your Site. WARNING ! All content contained within this site is protected by copyright laws. Unauthorized use of our material is strictly prohibited.”;
function click(e) {
if (document.all) {
if (event.button==2||event.button==3) {
alert(message);
return false;
}
}
if (document.layers) {
if (e.which == 3) {
alert(message);
return false;
}
}
}
if (document.layers) {
document.captureEvents(Event.MOUSEDOWN);
}
document.onmousedown=click;
// –>
</SCRIPT>
<!–End Copy–>

Whilst this is not a sure fire way to stop the occurrence of HTML theft as mentioned already it will deter those webmasters who perhaps were there for the simplistic reason of viewing your source code.

Article written by Lee

10 Ways To Promote Your Site

Date: 2011.02.21 | Category: Promotion | Response: 0

As we all know, getting productive traffic to your site can be a long and tedious task of course, there are ways to generate ‘optimized’ traffic at very little cost and time involvement. Below are just a few suggestions about how you can increase traffic to your
site and, inevitably, there are hundreds of different variations of these that will work for your site, I think the key to getting a successful traffic source is dependant on how much effort you put into it and, if you work hard and play little, you will reap the benefits tenfold.

1. Create an email discussion list. The list should be related to your web site’s subject. Place your ad on all posts and it will remind people to visit your site.

2. Prove your site is a bargain. Add a lot of free stuff to your offer or, if you’ve sold the product for a higher price before, show them the difference or, show them how much your competitors charge.

3. Make your web site more useful. Sell ad space, generate hot leads, answer visitor questions, offer free content, be news friendly, etc.

4. Make the most of each visitor. Sometimes your price is to high. You should provide a variety of similar products at different price ranges.

5. Test and redesign your banner ads till you get your desired click through rate. Once you do, join many banner exchanges and buy ad space.

6. Use holidays as a reason to get free publicity. Write a press release or article about the current holiday. It’ll have a high chance of being published.

7. Utilize the free content on the internet. Publish one article on a single web page and your main web site link then upload it as a doorway page.

8. Test your new products on the bottom of your home page. You don’t want to take away hits from your best selling products until others are proven.

9. Make commissions without joining an affiliate program. Just propose a joint venture offer to web sites that don’t have affiliate programs.

10. Persuade other web sites to link to yours. It can improve your search engine ranking. Just offer them something of value in return.

Article written by Lee.

Geo Targeting – What Exactly Is It?

Date: 2011.02.22 | Category: General, Promotion | Response: 0

As the adult industry reaches further and further across the online global community we are beginning to realize the importance of our foreign surfers, gone are the days of shifting them off to a dialer site instead, we find more and more companies actually using geo-targeting techniques to filter and monetize this profitable traffic more but, how does geotargeting work and, more importantly, is it any good? They are the questions we will look at in this article.

GEO::IP – The Basics.

The Geo::ip module is a relatively simplistic database of IP addresses and, the matching country to which the IP address belongs. This means that the GEO::IP module can be used for a variety of purposes including automatically selecting the language and countries of your visitors, for credit card fraud detection, and for software export controls.

Geo Targeting – The Basics.

As described above, the GEO::IP module is what drives any and all forms of geographical location targeting system (geo targeting). Geo targeting is the method most commonly used in the adult industry to either send a surfer to a localized version of a paysite or, send them off to a dialer in an attempt to monetize them it works by checking either the surfers browser language, country ip address or, both of these.

Putting Geo Targeting To Work.

Despite what most webmasters may think about the complexities of geo targeting and the GEO::IP Module for Perl they are easy to use and implement and, furthermore, there are cost free and highly effective ways of using geo targeting on your sites to monetize your international traffic. Lets look at two easy free solutions for webmasters to geo target their traffic.

JavaScript.

Using JavaScript you could add the following code between your HTML <head> and </head> tags to redirect international traffic to a specific url on your server:

<SCRIPT LANGUAGE=”JavaScript1.2″>
<!– Begin
if (navigator.appName == ‘Netscape’)
var language = navigator.language;
else
var language = navigator.browserLanguage;

if (language.indexOf(‘en’) > -1) document.location.href = ‘english.shtml';
else if (language.indexOf(‘nl’) > -1) document.location.href = ‘dutch.shtml';
else if (language.indexOf(‘fr’) > -1) document.location.href = ‘french.shtml';
else if (language.indexOf(‘de’) > -1) document.location.href = ‘german.shtml';
else if (language.indexOf(‘ja’) > -1) document.location.href = ‘japanese.shtml';
else if (language.indexOf(‘it’) > -1) document.location.href = ‘italian.shtml';
else if (language.indexOf(‘pt’) > -1) document.location.href = ‘portuguese.shtml';
else if (language.indexOf(‘es’) > -1) document.location.href = ‘Spanish.shtml';
else if (language.indexOf(‘sv’) > -1) document.location.href = ‘swedish.shtml';
else if (language.indexOf(‘zh’) > -1) document.location.href = ‘chinese.shtml';
else
document.location.href = ‘english.shtml';
// End –>
</script>

Php.

Using .php you can add the following to your sites pages to redirect traffic based on their browser language.

<?
$user_lan = $HTTP_ACCEPT_LANGUAGE;

if($user_lan==’de’) {
## German
$redir_url = “http://www.germanlanguagepageurl.com”;

} elseif($user_lan==’fr’) {
## French
$redir_url = “http://www.frenchlanguagepageurl.com”;

} elseif($user_lan==’it’) {
## Italian
$redir_url = “http://www.italianlanguagepageurl.com”;

} elseif($user_lan==’es’) {
## Spain
$redir_url = “http://www.spanishlanguagepageurl.com”;

## US traffic or Rest of world not defined above
} else {
$redir_url = “http://www.yourmainpageurl.com”;

}

header(“Location: $redir_url”);
exit;

?>

As you can see from the above two examples, monetizing your international foreign traffic is a relatively easy step and, with the right sponsors to send this traffic to you will be able to reap the profits of countries that other webmasters are not targeting yet.

Geo Targeting – Overview.

When all is said and done geo targeting can be a cost effective way to increase your bottom line profits, whether using a free method as described above or, using one of the many filtering services available on the net you should start to monetize your global surfers. One thing you should also consider however is that far from sending your international traffic to a dialer you should search around and find a good mix of adult affiliate programs with a variety of localized paysites, this in itself will enable you to see just how much traffic you have been wasting by using dialers in the past and, it will also allow you to realize the full potential of your new found geo targeted adult traffic.

Article written by Lee

Building A Surfer Trap – Stage 1

Date: 2011.02.21 | Category: Traffic | Response: 0

The last 2 weeks I have had a LOT of webmasters email and ICQ me regarding traffic and, not getting any sales.

So, I thought it would be a good idea to make a step by step tutorial on building your own surfer trap.

Now these are some of the arguments I have heard why people haven’t already built one over the last few weeks…

* To complicated to follow.
* I want surfers returning to my site.
* Don’t have the time.

The first two however seem to be the ones that I hear over and over again.

First of all, a surfer trap IS NOT complicated, in fact, it is probably one of, if not THE easiest type of site to build.

Secondly, Why get a surfer visiting your site over and over again if they are not paying for trial memberships? All you are doing is wasting your bandwidth.

Thirdly, A surfer trap can be built over a period of time, my very first trap was built within 1 hour my next was built in a day and my next one was built in a week.

So onto the start of building our surfer trap…

The first thing that I want you to do is to look at the Multi-Site FPA’s that ARS in the marketing section and choose ONE of them.

Download it, optimize the keywords on the FPA, make sure you add meta tags, titles descriptions and Alt tags on all images.

Once you have done this, you now need to search through ALL of the single site FPA’s and download and optimize one for each of the ARS sites that you have on your Multi-Site FPA. (Even the gay sites!)

This should take you 2-5 minutes for EACH FPA, any longer than that and you are doing TOO much work!

Once you have all of the single FPA’s downloaded, optimized and uploaded onto your server that is the first stage completed.

Article written by Lee

Building A Surfer Trap – Stage 3

Date: 2011.02.21 | Category: Traffic | Response: 0

Building A Surfer Trap – Stage 3.

You should hopefully by now have a basic looking surfer trap ready on your server and on your hard drive.

Now we need to start to ‘dirty’ this surfer trap up a little.

We have already added 1 pop-up console to each of the FPA’s including the Multi-Site FPA.

For the next step in this ‘dirtying’ process we need to add some additional links onto each of the FPA’s including the Multi-Site FPA.

On the FPA’s what you need to do is create a ‘no thank you’ link so, if your surfer does not want to visit the site for the FPA you have sent them to you can send them to an alternative.

This no thank you link can go to one of two places, you need to decide where you feel the traffic can be best utilized however, from my experience i would highly recommend using this first method:

Link the ‘no thank you’ text on each of the single site FPA’s to another DIFFERENT niche FPA in your surfer trap so, as an example, if your surfer is on the All Petite FPA in your trap, the ‘no thank you’ link would lead to Just Toon’s. If they decide not to go with the Just Toon’s site, the ‘no thank you’ link on this FPA would go to Gay Ultra and so on, you need to ensure however, that the ‘no thank you’ link goes to a completely different niche to the one of the FPA the surfer is currently on.

The second option you have is to link the ‘no thank you’ text to the ARS POTD (picture of the day) program. This will be your last chance at selling the surfer to one of the ARS pay sites.

In addition to the ‘no thank you’ link on each of the FPA’s you also need to add a small table to the Single-Site FPA’s. ideally this should be four columns across and 2 rows down. This will give you 8 places to put a one or two word link going to another different niche FPA than the one the surfer is currently viewing however, you also need to ensure that these 8 links are going to a different FPA than the ‘no thank you’ link you have created.

The above stage is where we could potentially start to lose people in the instructions therefore if you have ANY questions or queries regardless of how small they may be please post on the forums.

This stage should hopefully only take you a couple of hours to complete and, once you have tested all of the links and uploaded the FPA’s to your server you are all set for the next MAJOR step in this project…. Generating Fresh Traffic.

Article written by Lee

Converting Chinese Adult Traffic – The Niche Paysites That Work

Date: 2011.02.21 | Category: Traffic | Response: 0

Unspoken Secrets

Date: 2011.02.24 | Category: General | Response: 0

here is a belief among new webmasters that there is a set of golden rules among those of us whom have been at this business for many years to making money well guess what, these are those unspoken secrets….

Secret #1.

There are no secrets to becoming an adult webmaster. One of the most common reasons why so many new webmasters give up in this business is because they hear about the money that the big guys make, submit two TGP galleries to The Hun, get a $200 hosting bill and no signups. They then figure that the affiliate they are using is rubbish and then spend the next 2 months surfing the Net looking for the “be all and end all” of affiliate programs which is going to net them $2 million within the next 6 months. The fact of the matter is, that genie in the lamp you are looking for doesn’t exist. It all comes down to hard work, perseverance and common sense this is a business venture you have started like it or not and, it needs to be treated as one.

Secret #2

Don’t give up. You need to treat what your doing as a business. Of course, you can have fun with it but, at the same time you need to be making continual business plans for your development in much the same way as if you were self employed. Which, of course as soon as you start to make some money you will be.

Secret #3

Stay focused. There are a million and one ways to make money in the industry. You could build free sites, TGP galleries, AVS sites, pay sites, search engine pages, the list goes on. There are many different avenues to drive traffic. The key is to try everything. Eventually you will find the one venue that your are very good at. Continue with this until you know this in your sleep – work it so often and well that you master it. One other thing to remember, it wont make you money overnight, if you think it will, your starting out for the wrong reasons, putting it simply, Adult web mastering isn’t for you.

Secret #4

Build it and, it (And they) will come, don’t spend time worrying about your keywords, meta tags, the amount of images you are using, just because someone tells you this is what is required of your sites. Just build a site or gallery submit it, forget about it and get started on building your next, and the next, and the next site after that. Just keep on moving forward, if you forgot to do something on one of your sites don’t worry, add it to the next site that you build.

Secret #5

Start to network. Other webmasters are great for bouncing new ideas off, a group of webmasters who start at the same time all communicating with each other are going to develop more than a sole webmaster on their own. Networking is a big part of any successful webmasters daily routine. Make the most of the people you meet on the boards or aim or icq, it will benefit you long term.

Secret #6

This one you will probably hear day in, day out for the rest of your business life. “It’s too late for newbies to make money” I am sorry to be the one to tell you this but, this is rubbish. As long as you follow the basic rules above and work at it, you can and will make money in this still thriving industry.

Now you have heard the “secrets” you have wanted to know its up to you to put them to good use.

Article written by Lee

Displaying Special Characters On Your HTML Pag

Date: 2011.02.22 | Category: WebDesign | Response: 0

In order to display certain characters within your HTML pages, you must use a special code. The codes below display the HTML code and the character when displayed on your web page. To use any of the characters displayed within the chart, copy & paste the HTML code to the left of the character you would like to use.

Whilst the above list is by no means complete, it should contain the most useful characters and codes for you to build your sites using the special characters with ease.

Article written by Lee