Robots.txt – Control The Robots That Crawl Your Sites

Date: 2011.02.24 | Category: Search Engine Optimization, WebDesign | Response: 0

By writing a structured text file you can indicate to robots that certain parts of your server are off-limits to some or all robots. It is best explained with an example:

# robots.txt file for general use on web servers.

User-agent: webcrawler
Disallow:

User-agent: googlebot
Disallow: /

User-agent: *
Disallow: /cgi-bin
Disallow: /logs
The first line, starting with ‘#’, specifies a comment.

The first paragraph specifies that the robot called ‘webcrawler’ has nothing disallowed: it may go anywhere.

The second paragraph indicates that the robot called ‘googlebot’ has all relative URLs starting with ‘/’ disallowed. Because all relative URL’s on a server start with ‘/’, this means the entire site is closed off.

The third paragraph indicates that all other robots should not visit URLs starting with /cgi-bin or /log. Note the ‘*’ is a special token, meaning “any other User-agent”; you cannot use wildcard patterns or regular expressions in either User-agent or Disallow lines.

Two common errors:

Wildcards are not supported: instead of ‘Disallow: /tmp/*’ just say ‘Disallow: /tmp’.
You shouldn’t put more than one path on a Disallow line (this may change in a future version of the spec)
Ultimately, without the use of robots.txt files on your servers/domains, you are risking a variety of potential problems including, unauthorized access to your cgi directory, unauthorized viewing of your site stats, possible spamming of the search engines by accidental crawling of doorway pages.

One distinct advantage however of having a robots.txt file on your server is that, quite simply, you will be able to tell when and where your site has been indexed or potentially indexed as, all robots will automatically call for the robots.txt file BEFORE any other page on your server so, as long as you keep an eye open for any calls of this file, you can see who is knocking at your site for indexing purposes.

Below is a robots.txt example that you can copy and paste into a text document to use on your own server:

<!–Start Copy Below This Line–>

User-agent: *
Disallow: /cgi-bin
Disallow: /logs

<!–End Copy Above This Line–>

The above will allow all spiders to crawl all of your site except the subdirectory’s ‘cgi-bin’ and ‘logs’ which, may be altered to suit any subdirectory’s you do not wish the spiders to crawl on your server.

Article written by Lee

Traffic Filtering – Country Specific Redirects

Date: 2011.02.21 | Category: Traffic | Response: 0

To some, actually marketing to foreign surfers is a waste of time rather than a business practice. Unfortunately, they are missing out on additional revenue. We are already beginning to see some of the major sponsors in the adult industry embracing these foreign markets and, not just by utilizing dialers.

However, filtering your traffic base is often the hardest part of this money making equation. That is where the following piece of PHP coding can come in handy.

PHP FILTERING CODE

<?
$user_lan = $HTTP_ACCEPT_LANGUAGE;

if($user_lan==’de’) {
## German
$redir_url = “http://www.germanlanguagepageurl.com”;

} elseif($user_lan==’fr’) {
## French
$redir_url = “http://www.frenchlanguagepageurl.com”;

} elseif($user_lan==’it’) {
## Italian
$redir_url = “http://www.italianlanguagepageurl.com”;

} elseif($user_lan==’es’) {
## Spain
$redir_url = “http://www.spanishlanguagepageurl.com”;

## US traffic or Rest of world not defined above
} else {
$redir_url = “http://www.yourmainpageurl.com”;

}

header(“Location: $redir_url”);
exit;

?>

So, we know that the above piece of coding can redirect surfers based on their country of origin however, in order for you to maximize this to its full potential you will need to know the country specific codes (Also called ISO 639 codes) for each of the main browser languages. Some of these are as follows.

da | Danish
de | German
en | English
es | Spanish
fi | Finnish
fr | French
it | Italian
jp | Japanese

The problem you now have is finding where to send your filtered country specific surfers to. Of course, there is always the dialer option however, this is not going to be as lucrative to your wallet as what most people will have you believe.

In fact, I very rarely use a dialer on my foreign traffic instead, I tend to send them to a language specific tour page from one of the big sponsors and, if they do not sign up to that sponsors site, this is the point where I throw a dialer at them and, if the dialer still doesn’t make any money off the surfer I then recycle the surfer for a fresh one through a toplist or banner exchange heavy page.

In doing this I find it is often more productive than ‘regular’ English speaking traffic as, if you give the surfer something they are looking for, they will be more inclined to buy.

Hopefully this article has given you some insight into filtering and using your foreign traffic as oppose to just sending them off to a dialer program.

Article written by Lee

Filtering Adult Traffic For More Sales

Date: 2011.02.22 | Category: Traffic | Response: 0

When webmasters build sites there seems to be the train of thought that just because they use one of the top converting sponsors site they will make sales regardless of what type of traffic they are sending.

Unfortunately, this is often not true.

One of the first steps that we should take as webmasters when it comes to creating a new site, whether it be a free, avs or a TGP site is to learn the art of targeting our sponsors tour with the content and, more importantly, the traffic we are going to use.

taking it to the simplistic levels, a straight teen sponsors wont convert on a site that gets mostly mature traffic, the niches, although complementary, are so far apart its unrealistic.

That said, lets take a look at some options we can all implement on our sites to better target and filter our traffic to ensure optimum conversions.

One of the simplest ways to target and filter your traffic is to build yourself a hub or a surfer trap. Of course, we also have to take into consideration the type of traffic we are currently receiving to our site and, that we ‘could’ receive in the future.

Just because we receive 10,000 hits to our teen TGP doesn’t mean that ALL of that traffic IS looking for a teen site, this is where our surfer trap or hub site can come into play.

Even if your main focus is the teen niche, you should make sure that the first thing the surfer see’s when visiting any type of site you build is a multi-site FPA (Full Page Ad) where applicable.

This then starts your filtering process. If they know that they can find other niches than teen on your TGP then chances are, they will go to them either because that is what their niche is or, they are curious about that niche.

Another thing we can do as webmasters is to ensure we use the headers and footers of our pages in the proper fashion, offer our surfers a choice of the main niches, Asian, Gay, Ebony, Teen, Ect using only text links and, you will probably find that by lining these text links to your hub or surfer trap that you actually have a diverse range of traffic available to you.

In addition, rather than sending our surfers directly to our sponsors, send them via a filter page whether this is an FPA, or a page full of text links you made yourself detailing the benefits of the sponsor you are going to send them to, again, you will let the surfer know where they are going and, give them a choice as to whether they want to continue to that site or, choose an alternative.

Overall, webmasters who target their surfers by niche can, for the most part have some excellent sales with a variety of sponsors that otherwise they would not be able to see.

Target, Filter, Micro-Niche, however you do it, make sure your traffic is not wasted and, more importantly, make sure your sponsor is able to offer your surfer what you are telling them is inside the site.

Article written by Lee

Marketing to Foreign Surfers

Date: 2011.02.22 | Category: Promotion | Response: 0

Marketing to Foreign Surfers.

What would you do if I told you that there are 3 million plus new surfers last year that you did not market too? You probably marketed your product or adult site to those that could read English well enough to be searching with English terms. How about the growing numbers of surfers with English as their second language?

According to Nielsen/Net Ratings, from September 2000 to 2001, Italy’s online population grew by 3,540,970 users: about one new user every ten seconds. Italy is just one of the non-English speaking countries that is coming online at lightening fast speed.

Are you relying on these surfers searching for your English keywords? Are you thinking that every language uses the words “porn and hardcore” and what about the finer niches like “bisexual and titties”? The best conversion is with newbie surfers just online for the first time and wanting to see adult sites and products. Those that have been around a while find out about the plethora of free porn. This means that websites do their best marketing with search engine placements of their main sites or feeder sites. If you are on your money, you are trying to work every engine for every related keyword. Now think of the keywords that you could be going for in all the worlds’ languages!

Do a bit of research in some of the common languages. If I was Italian and new to the net, the first place I would be searching is in an Italian search engine. Go to http://arianna.iol.it/ and search using the word porn and you will find 10 listings come up all in Italian. Not one is English. Even http://it.yahoo.com/ Yahoo Italia does NOT serve up your English porn site in its results.

So how do you get a piece of this pizza pie? You need at least a doorway written in Italian. You need to visit a site like http://www.adult-site-translation.com/ and find out how affordable it is for a doorway page that is put together by a foreign translator. Not only is the text for your doorway sites or even complete tours with the proper keywords but the graphics are redone where necessary. You really cannot rely on a text translator. We all have been on a site where it was obvious that the webmasters first language was NOT English and felt bad for their awkward use of words. This is not how to make a sale.

You need to be careful that you choose a professional service for your translating needs. You need to know that the translators are top notch and can not only translate your existing page/site keeping your marketing angles but they can also advise you on such things as proper wording and what a surfer from that culture would find erotic. Languages do not translate word for word. A service like Adult Site Translation has hired translators who also know how to market adult sites. They will tell you the search terms your page should be listed under and can assist you with foreign search engine optimization.

Remember the days where you were the only site in a category or niche? It was like being a pioneer and it was very lucrative. Do you want to be first to market to these growing pockets of millions of new surfers? There are new frontiers out there and finally sites like Adult Site Translation can assist you to conquer them successfully!

Article written by Susanna

Doorway Pages

Date: 2011.02.22 | Category: Traffic, WebDesign | Response: 0

A doorway page is built to rank high for a particular keyword or search phrase. When your doorway page is visited by the searcher it simply has a “click me” button which links to your web site. The major search engines accept these pages as long as the end result does provide what the searcher is looking for. If you are discovered to be using doorway pages for irrelevant keywords you can expect to have your entire domain unlisted. For instance, one of our doorway pages is built to rank high for the search term -Adult Content—which is quite acceptable because when the searcher gets here he can find links to adult content providers from our site. If however, he couldn’t find links to adult content then we would risk the wrath of the all powerful search engines.

Once you have selected your keywords and phrases (about 50 would be the normal) you need to build a doorway page for each keyword and ideally, for each major search engine. All the major engines look for different keyword density in the text, title and description so you need to do some research by doing a search using your chosen phrase or keyword and studying the top 10 results at each engine (if you can spot them, study high ranking doorway pages).

Make notes of how many times the phrase or keyword is used in the title, description and body text. Is it used in header text etc? Once you have built a picture of what your doorway page should look like you can build it using your favorite html editor. Once you have done one for a particular engine the other 50 or so pages can be done by simply replacing keywords for keywords. After you have done a page for each keyword move on to the next search engine. Remember that your body text is not important but make each page unique or it may be considered spamming. It is your keyword or phrase density that you are attempting to get right. The page, when visited by a person, will be recognized for what it is, simply a link to the real content so don’t worry too much about what it looks like. When a search engine spider visits the page it is only interested in counting the keyword density in your body text.

As you have probably worked out there is quite a lot of work involved. 50 phrases or keywords=50 pages X the top 8 search engines= 400 pages. In reality though, you are only creating 8 doorways, 1 page for each search engine. For all the other pages you simply have to substitute the keyword for the next and alter the text around so as not to finish with 50 identical pages. OK, nearly finished but the next step is crucial if your doorways are to work.

Put all your pages in a folder on your server e.g. Mydomain/doorways/. Then create 2 more pages that have a link and a small description to each of your doorways (200 on each) and to each other. These are called corridor pages because the spider travels down them, visiting each page linked off them. Call these 2 pages index and home and place them in the folder with your doorway pages. Then place links to these two pages from your main index page so that a spider will be able to find them and list all your doorways. Submit only your index page and your 2 corridor pages. Do not submit your doorways to the engines.

Ideally, and if you can afford it, you should set up a new domain and host for your doorways. This isn’t essential but it does have benefits. These are: If you do get over zealous with your doorways and an engine does ban you for spamdexing at least your real site will be safe. Engines rank sites higher if they have lots of links to them from other domains. You can put your most important keywords in your new domain name, which will increase the ranking of the doorway pages containing those keywords.

Now all you have to do is wait for the engines to update their databases. We have had the best results with Google.

Article written by Lee

The Negative Marketing Technique

Date: 2011.02.24 | Category: Promotion | Response: 0

Negative marketing is a wonderful thing in its own right however, negative marketing can, surprisingly enough have a NEGATIVE effect on your sales.

How many times have you seen a site that has, about half way down the page some text telling the surfer no to click on anything because ‘these are only counters’?

Counters in themselves can be VERY useful tools to the adult webmaster however, counters are given to us for free because of one simple reason, the graphics used on them are made in such a way that they will actually draw clicks from your traffic.

Most of the time however, these counters that take your hits are helping you much more than you know, from giving you addition traffic, valuable surfer stats and many other things.

Now, the same is also true for banner exchanges as is for counters, they are a useful addition to the variety of tools available for adult webmasters however, many webmasters, as mentioned above tell the surfer NOT to click on them, something i just never seemed to be able to get my head around. As you reading this post kind of proves, tell someone not to do something and you can guarantee they WILL do it

However, as i started off this quick article saying, Negative marketing is a good thing, after all, you have now got the proof to tell you that it works why not put this to use on your site?

For example, rather than telling a surfer…

‘Click Here For The Hottest Porn Site On The Web’

Tell them…

‘DO NOT CLICK HERE’

Wonder what they will do

Article written by Lee

Domain Name Registration Services What To Look For

Date: 2011.02.22 | Category: Domain Names | Response: 0

Once upon a time, if you wanted to register a domain name, you could only do it by visiting Network Solutions at http://www.networksolutions.com/ and paying them whatever they asked for, about $35.00 per year.

Then ICANN, http://www.icann.org/, The Internet Corporation for Assigned Names and Numbers (ICANN) that is the non-profit corporation that was formed to assume responsibility for the IP address space allocation, protocol parameter assignment, domain name system management, and root server system management functions previously performed under U.S. Government contract by IANA and other entities, decided to change the rules.

The initial testing phase of the new competitive Shared Registry System for the .com, .net, and .org domains quietly began to take place in April of 1999.

It started with five participants who were the first to implement the new system for competition in the market for .com, .net, and .org domain name registration services.

Previously, registration services in the .com, .net, and .org domains were provided by Network Solutions, Inc. under an exclusive contract with the United States government.

In the two years since this program began, things have really changed.

Just this last week, ICANN reported that two of their registrars, Tucows and New York-based Register.com, had recorded more new registrations for Top Level Domains (dot-com, dot-net and dot-org) than VeriSign’s Network Solutions.

This marks the first time ever that VeriSign’s Network Solutions was out-sold by any of the registrars and signals that their past dominance of domain name registration is certainly fading.

Why?

Because besides others being allowed to make domain name registrations, these new registrars are also cutting prices.

The Rules have most certainly changed.

The Shared Registration System (“SRS”), ICANN’s accredited registrars program, allows people to submit application to become a registrar along with a non-refundable $1000 filing fee.

After someone is accepted into the program then they must pay a yearly fee of $5000 to maintain their status as an accredited registrar.

This situation has created a very competitive environment which can only be beneficial to all of us as the price to register a domain name has fallen like a rock from a very tall building.

However, if you plan to register a new domain name using a virtual unknown registrar, make certain they do indeed have the legal accreditation from ICANN by visiting the ICANN web site and viewing their posted list of ALL accredited vendors:
http://www.icann.org/registrars/accredited-list.html

It will only take you a few moments to make sure you are dealing with a reputable vendor of domain names. Those few moments will make the entire process legal and worry-free.

Article written by Lee

Obscenity – Put It To The Test

Date: 2011.02.23 | Category: Writing | Response: 0

Regardless of how long any of us have been an adult webmaster we all need to be
aware of obscenity laws and, in particular how they affect our businesses
whether we think a hardcore photoset is ‘obscene’ or not ultimately, if you get
taken to court on obscenity charges the one thing you should be aware of is how
the courts will decide whether the images you are using will be classified as
obscene or not.

Testing Obscenity – The Miller Test.

The Miller test was developed in the 1973 court case of Miller vs. California
and in comprises of three parts ALL of which MUST be satisfied on order for
something to be deemed obscene by the courts. The Miller test is the ‘official’
method used by the United States Supreme Court for determining whether an
expression or a speech can be determined as obscene and, if deemed obscene, it
is not protected under the First Amendment and is therefore prohibited by law.

The Miller Test – Part One.

Part one of The Miller Test states something may be obscene if ‘the average
person, applying contemporary adult community standards, would find that the
work, taken as a whole, appeals to the prurient interest’ In essence, this
means that if the ‘average’ person on a jury or on the bench finds the work to
be deemed obscene then, it is. However for the court to rule something as
obscene it also has to be deemed obscene by the standards set in part two and
part three below.

The Miller Test – Part Two.

Part two of The Miller Test states that something is potentially obscene is
‘the average person, applying contemporary adult community standards, would
find that the work depicts or describes, in a patently offensive way, sexual
conduct’. Basically this is saying that if the images or speech is something
which is not practiced in a manner befitting your local community standards
then again, it may be obscene. However, as with part one of The Miller Test for
a court to find something obscene it needs to fall below the standards in part
three below.

The Miller Test – Part Three.

Part three of The Miller Test states that something is potentially obscene if,
‘a reasonable person would find that the work, taken as a whole, lacks serious
literary, artistic, political, or scientific value.’ This is pretty much where
you could potentially come unstuck after all, everyone has different sexual
tastes and because of this, just because something that may be widespread such
as ‘bare backing’ (to use as an example) could potentially be considered as
obscene if you happen to have a jury who are devout practicers of safe sex.

The Miller Test – Overview.

In essence The Miller Test is a useful guideline for webmasters when it comes
to operating our sites and specifically, when it comes to choosing the types of
content we utilize on them however, for the most part The Miller Test itself is
outdated. Since the early 70’s when this test was devised there have been many
sexual practices that were once deemed obscene that have become more a part of
everyday life and accepted in to society as whole thus, what once would (or
could) have been deemed obscene would no longer be in the same sense as
something that may be deemed obscene today could be found not to be in 5 years
time.

Article written by Lee

Redirecting To A Different Page Using JavaScrip

Date: 2011.02.24 | Category: Scripts | Response: 0

There are times when a simple JavaScript redirection from one page to another can come in handy and, the following JavaScripting will enable you to do this.

When a page contains this javascript, it will be redirected to another page that you specify in the “window.location=”. You can change the number of refresh seconds by changing the “move()’,1000 to the number of seconds you’d like.

Example:

1000 = 1 second
2000 = 2 seconds
3000 = 3 seconds

Place this JavaScript code between the <head> and </head> tags

<script language=”JavaScript”>
<!–hide from old browsers
var time = null
function move() {
window.location = ‘http://www.yourdomain.com’
}
//–>
</script>

Place this JavaScript code in your <body> tag

<body onload=”timer=setTimeout(‘move()’,1000)”>

You should now have a page that will redirect to a new url when it loads in the surfers browser window.

Article written by Lee

Mixing Business With Pleasure

Date: 2011.02.23 | Category: General | Response: 0

Regardless of your status in the world of web mastering there will come a time when you will want to attend one of the numerous webmaster seminars. However, what should you do to plan for the day you attend your first seminar, are there some things you should aim for and things you shouldn’t? Well in this article we will take a look at planning your conventions.

Before attending the convention of your choice there are a few things that you should prepare these are.

Exercise.

get out for half an hour each day at least two weeks before the day of your journey to the convention. You will be surprised at how much time you will spend walking around the convention floor and, by getting some basic exercise in before hand you wont feel the strain of being on your feet for hours at a time instead of being sat in front of your computer.

Contacts.

Make a list of people that you want to see and arrange with them in advance a time to meet up and have a chat. Most people who attend these conventions are busy for the entire course of the show. You may not get a chance to pop by their booth and talk tot hem if someone has already beaten you by booking a time to chat with the person you want to meet. It is also a good idea to trade hotel and cell phone information before leaving for the show, this way, if anything happens to make you miss a possible appointment you can call or leave a message informing them you will either be late or canceling.

Seminars / Parties.

Take a look at the events and seminars happening at the convention before you go, plan which ones you will want to attend make a list and take it with you. This will save you countless hours of wandering around aimlessly hoping to make all of the seminars and get to as many parties as you can in three days.

Booths.

Look at who is exhibiting at the convention, find out their booth number and make a note of it. List any specific details you may want to speak to the booth owners about. You can guarantee if you go unprepared you will miss out that important question or selling opportunity you wanted to make.

Baggage.

When packing your suitcase for the convention make sure you leave plenty of room for convention give a ways, You will be surprised at what you will be given for free at these shows, t-shirts, toys, books, flyers, you name it, you will be offered it.

So, you have done the pre check, what do you do when you actually arrive at the convention?

Food.

Eat at every opportunity you get. Most people will end up not eating for the entire length of the convention. perhaps even arrange to meet up with someone you want to talk to in a restaurant and grab a bite to eat whilst talking business.

Business Cards.

Take them and lots of them. Everyone and anyone will ask you for your contact details, if you have a bunch of business cards with you at all times, you can just hand them out. Make sure you include your full contact details, your name, nickname, email, icq and, aim contact details. The more ways you give someone to reach you, the more chance you have of them actually attempting to get in touch with you.

Clothing.

Wear comfortable, clothing and shoes. Think casual but, also think business, shorts and t-shirt may be good for comfort but, it doesn’t portray a good business image and, that’s the sole reason you are attending the convention, to do business.

Parties.

If you get offered an invite to a party, take it, plans change so quickly at the conventions, your friends may suddenly feel tired and you have nothing left to do, attend a party, then you have another opportunity to network some more.

Behavior.

Although the conventions are a fun atmosphere, don’t forget that they are in the first instance a place to do business, treat it as such, you may miss out on the ideal business opportunities if you are acting like a drunk ass hole. This will reflect badly on you long term.

You have taken in all the events you can handle, you have made your way back home what next? how exactly do you put this information and your new found contacts to use?

Business Cards.

Go through all the business cards you have been given and send your new found contacts a quick email thanking them for their time. This will be a good way for you to give them another reminder of what you spoke to them about and, I have personally gotten more business from the shows using this follow up method than if I had just waited for them to contact me.

Notes.

If you made any notes at the show, take a few minutes to re-write them, keep them safe in a notepad, you never know when one of these bits of information may come in handy.

Well, that’s pretty much it for the basics of the adult conventions, obviously there is more to it than this but, if you are attending your first convention you will have a bit of insight into the work involved.

Article written by Lee