Robots.txt – Control The Robots That Crawl Your Sites

Date: 2011.02.24 | Category: Search Engine Optimization, WebDesign | Response: 0

By writing a structured text file you can indicate to robots that certain parts of your server are off-limits to some or all robots. It is best explained with an example:

# robots.txt file for general use on web servers.

User-agent: webcrawler
Disallow:

User-agent: googlebot
Disallow: /

User-agent: *
Disallow: /cgi-bin
Disallow: /logs
The first line, starting with ‘#’, specifies a comment.

The first paragraph specifies that the robot called ‘webcrawler’ has nothing disallowed: it may go anywhere.

The second paragraph indicates that the robot called ‘googlebot’ has all relative URLs starting with ‘/’ disallowed. Because all relative URL’s on a server start with ‘/’, this means the entire site is closed off.

The third paragraph indicates that all other robots should not visit URLs starting with /cgi-bin or /log. Note the ‘*’ is a special token, meaning “any other User-agent”; you cannot use wildcard patterns or regular expressions in either User-agent or Disallow lines.

Two common errors:

Wildcards are not supported: instead of ‘Disallow: /tmp/*’ just say ‘Disallow: /tmp’.
You shouldn’t put more than one path on a Disallow line (this may change in a future version of the spec)
Ultimately, without the use of robots.txt files on your servers/domains, you are risking a variety of potential problems including, unauthorized access to your cgi directory, unauthorized viewing of your site stats, possible spamming of the search engines by accidental crawling of doorway pages.

One distinct advantage however of having a robots.txt file on your server is that, quite simply, you will be able to tell when and where your site has been indexed or potentially indexed as, all robots will automatically call for the robots.txt file BEFORE any other page on your server so, as long as you keep an eye open for any calls of this file, you can see who is knocking at your site for indexing purposes.

Below is a robots.txt example that you can copy and paste into a text document to use on your own server:

<!–Start Copy Below This Line–>

User-agent: *
Disallow: /cgi-bin
Disallow: /logs

<!–End Copy Above This Line–>

The above will allow all spiders to crawl all of your site except the subdirectory’s ‘cgi-bin’ and ‘logs’ which, may be altered to suit any subdirectory’s you do not wish the spiders to crawl on your server.

Article written by Lee

Online Billing Alternatives – Token Payment Systems

Date: 2011.02.24 | Category: Billing Solutions | Response: 0

In this article we will continue our look at the various payment solutions that are available to webmasters for use on a global scale and, this time we will look at the ‘Token’ system of generating income to our sites.

Token Payments – What Are They?

Token payments, as they name suggests is a way by which your surfers can access your members area by using pre-purchased tokens as a cash alternative. These tokens are available in a variety of values ranging from US$1 to US$5 and above.

Token Payments – What Are The Costs?

The cost to the surfer (as mentioned above) can vary from solution to solution however, on average the tokens which are redeemed for payment are bought in amounts ranging from US$1 to US$5 and above, these tokens then grant the surfer access to any of the sites that uses the specific token system the surfer purchased ‘credits’ for.

Token Payments – Price Comparisons.

Okay so based on our previous articles we will again say that access to your members area costs an average of US$30 for a months access, now, using the token payment method, you are now able to set certain ‘restrictions’ immediately on the level of ‘access’ your new member can have although, the reality of it is, these restrictions are set by the token provider themselves.

Lets say a surfer has gained access to your site using a US$5 token, what can they get actually have access too – not a lot. Your surfer only has access to as much of the content in your site that his ‘credits’ or ‘tokens’ will allow him to, in fact, the token system itself is much like the current pay-per-view model only, IMHO, not as satisfying to the surfer.

back to the issue at hand, how much will you make from this surfer with the US$5 token who has just accessed your site, well, if your members area is good and you have enough content to keep the surfer there until their tokens run out of credit, then, you will make upto 95% of the initial US$5 token purchase.

The good thing about this payment solution from a webmasters perspective however, is that YOU can actually set how much time each token will last on your site. Therefore, the reality of it is, you could have a surfer join your site with a US$5 token and only see one movie file whereas, a surfer who joined with a Credit card for 30 days access, could in effect strip your site of its content and move onto the next paysite.

Token Payments – Overview.

All in all, i strongly feel that there is a place in todays adult industry for the token payment solution after all, webmasters have to limit access to the amount of content surfers are able to see for free (or cheaply) and start to ‘educate’ todays sufer that they need to spend some money in order to access ‘the good stuff’.

By allowing webmasters to control the content and value of the token payments on their sites this payment solution could, somewhat start this education process for the surfers. Whether this will be a good or, a bad thing however, will depend entirely on the amount of use these relatively new payment solutions get from both webmasters and, ultimately, surfers.

Article written by Lee

Marketing to European Surfers

Date: 2011.02.22 | Category: Promotion | Response: 0

Marketing to European Surfers.

Today we’ll try to answer couple of questions regarding dialers and how to market them to European traffic.

How to get traffic to your European market targeted site?

Pretty much the same way as for all the other sites, lets German market for example (Germany, Austria, Switzerland) use SE’s, German link-lists, TGPs,… feed site with your own traffic, and don’t forget to use exit-consoles.

Is your site translated into specific language?

Yes, of course you won’t get far using English template on German/Spanish.. sites… You can always contact Adult Site Translation if you need help with translations.

What sponsor should you use?

That is pretty hard to say. Practically since almost every European based sponsor offers dialers so it doesn’t really matter which one you choose. It’s the same with per sign-up sponsors: It depends how good you are in sending traffic to them. And as always try couple of them and see which one works best for you. Most of the sponsors will offer to your surfers to pay by CC, bank account and dialers.

Me personally, I don’t really advertise dialers. I go for sign-ups because most if not all European sponsors are recurring and it brings more money in the long run. But if a surfer wants to pay the (admittedly) high phone bills – that’s fine with me In fact, sometimes I get more money from a 0190-number (dialer number in Germany starts with 0190) than I’d get if the surfer would sign-up with his CC and would cancel his membership after the first payment.

Why are dialers so successful in the German/European market?
Well, I can think of 3 reasons for this:

1.) 0190-numbers are very common in Germany. Many support-hotlines use them, you can download logos for your cell phone via 0190, you can get health-tips via 0190, fax-numbers, etc… Germans see those numbers everywhere and get used to them. Of course they know that they are expensive but I think they tend to forget this because they are so common.

2.) Much of my income from dialers is from Swiss and Austrian people. Especially surfers from Switzerland LOVE dialers (Some of them spend hours/nights with dialers and in the end if i get 50% of that for me is not bad, isn’t it? I think they love dialers because they hesitate to give out the information on their CC (if they have any) and they can’t/don’t like to transfer their money via bank transfers. So dialers are actually their only way to get into the members-area.

3.) Credit cards are not very common in Germany. I would guess only some 30% have one and many who have one don’t believe that CC transactions on the internet are secure. So most of the surfers have only 2 options left: Paying by bank account or using a dialer. The bank account has 2 disadvantages in the eyes of the surfers: 1st “The sponsor knows my name, my account number, where I live and that I’m a greasy little wanker who pays for porn. -Maybe this sponsor is going to tell my neighbors about it-” 2nd “How can I explain this to my wife?” On the other hand the dialer has advantages: 1st It is anonymous. Nobody knows who and where the surfer is. 2nd The dialer is faster than typing all the necessary information needed for a bank transaction. A few seconds for a 35kb download and the surfer is ready to go. 3rd You can always find a reason why there’s this 0190-number on the phone-bill. “Well darling, you know, I had problems with my new graphic card and I had to contact the customer-support. Those damn bastards are on a 0190-number what what can I do?”

Article written by Lee

Adult Webmaster Conventions

Date: 2011.02.21 | Category: General | Response: 0

Networking Overload

Using .htaccess Effectively

Date: 2011.02.24 | Category: WebDesign | Response: 0

The .htaccess file is an ASCII text document that can be placed in any directory on your site. It can be used to control access to files and directories, and customize some server operation in your site. A .htaccess file can be created in any word processor but must be saved as text only. You must use FTP software in ASCII mode to upload or edit your .htaccess file. For the examples provided here, place the .htaccess file in your root directory.

There are a variety of functions that you can control using .htaccess some of the more useful of these are explained below:

Custom Error Messages.

Add the following to the .htaccess file::

ErrorDocument 404 /notfound.html

After “ErrorDocument” specify the error code, followed by a space, and then the path and filename of the .html file you would like to be displayed when the specified error is generated, each specific error code is detailed below with the recommended codes to be used in the .htaccess file in bold :

200 OK
206 Partial content
301 Document moved permanently
302 Document found elsewhere
304 Not modified since last retrieval
400 Bad request
403 Access forbidden
404 Document not found
408 Request timeout
500 Internal server error
501 Request type not supported

Using the codes above your error section of the .htaccess file should look like this:

ErrorDocument 301 /notfound.html
ErrorDocument 400 /notfound.html
ErrorDocument 403 /notfound.html
ErrorDocument 404 /notfound.html
ErrorDocument 500 /notfound.html
ErrorDocument 501 /notfound.html

Redirect to a Different Folder.

Add the following to the .htaccess file:

RewriteEngine on
RewriteRule ^/oldfolder(.*)$ /newfolder/$1 [R]

This redirects the user from /oldfolder/anyfile.html to /newfolder/anyfile.html, when the .htaccess file is uploaded to the otherwise empty “/oldfolder” directory.

Denying User Access.

Add the following to the .htaccess file:

<Limit GET>
order allow,deny
deny from 000.00.00.
deny from 000.000.000.000
allow from all
</Limit>

This is an example of a .htaccess file that will block access to your site to anyone who is coming from any IP address beginning with 000.00.00 and from the specific IP address 000.000.000.000 . By specifying only part of an IP address, and ending the partial IP address with a period, all sub-addresses coming from the specified IP address block will be blocked. You must use the IP addresses to block access, use of domain names is not supported

Redirect a Machine Name.

Add the following to the .htaccess file:

RewriteEngine On
Options +FollowSymlinks
RewriteBase /
# Rewrite Rule for machine.domain-name.net
RewriteCond %{HTTP_HOST} machine.domain-name.net $
RewriteCond %{REQUEST_URI} !machine/
RewriteRule ^(.*)$ machine/$1

This will redirect requests for the machine name machine.domain-name.net to the directory machine on the site domain-name.net.

Different Default Home Page.

Add the following to the .htaccess file:

DirectoryIndex filename.html

Then a request for http://domain-name.net/ would return http://domain-name.net/filename.html if it exists, or would list the directory if it did not exist.

To automatically run a cgi script, add the following to the .htaccess file:

DirectoryIndex /cgi-local/index.pl

This would cause the CGI script /cgi-bin/index.pl to be executed.

If you place your .htaccess file containing the DirectoryIndex specification in the root directory of your site, it will apply for all sub-directories at your site.

Preventing Hot Linking.

Add the following to the .htaccess file:

# Rewrite Rule for images
RewriteCond %{HTTP_REFERER} <URL of page accessing your domain>
RewriteRule ^(.*)$ http://<same as above URL>

You would replace the <URL of page accessing your domain> above with the domain name and path of the page that is referring to your domain. For example: www.theirdomain.com/users/mypage/

The RewriteCond directive states that if the {HTTP_REFERER} matches the URL that follows, then use the RewriteRule directive. The RewriteRule directive will redirect any reference back to the referring web page.

Using the above you should, safely be able to publish your sites on the internet knowing that you will not be privy to bandwidth thieves via hotlinking and also, that you will not lose any traffic through pages that are ‘not found’.

Article Written By Lee

Time Management – Organizing Your Content Purchases

Date: 2011.02.24 | Category: Content | Response: 0

From time to time it is inevitable that as adult webmasters there will be two things that will happen:

1) You will buy some licensed content.

2) You will use this content for a gallery.

However, unless your content is organized you can end up spending to much time to make a 10 pic gallery page. This article is going to offer you some sound advice on how to organize your content from the second you take delivery of it which, will save you a lot of time long term.

So we have taken delivery of our adult content either by download or, on cdrom what next, we could just file it away on cdrom but, by taking a little extra time to organize your content from the start you will end up not only building sites MUCH quicker but also saving time all round.

Here are some helpful hints to get you on the way to content organization.

1) Unzip all your content sets and, if applicable, separate them into model and niche sets.

2) Create folders for each model and, each set of 10 images within the main model sets.

3) Rename all your images in the 10 pic sets starting from pic1.jpg through to pic10.jpg.

4) Crop, compress and thumbnail each image within each set of 10 that you have.

5) create a html page that calls your thumbnails and main pics using relative urls i.e. /set1/gallery1/image1.jpg for the larger image and /set1/gallery1/thumb1.jpg for the thumbnail image.

6) Inside each of your 10 pic/thumbnail folders place this HTML page you have just created.

7) Burn each of the gallery folders to cdrom.

Lets now look at what an hour spent has enabled us to do.

Instant Galleries.

Say we want to build a 10 pic gallery to add into a free site or an AVS site that we are building, we know we have all the galleries already made, its just a case of finding the correct gallery and uploading it to our server.

Image Swapping.

What happens if we need to swap an image from one of our pages to a more appropriate one for the niche we are marketing to, simple, you go to the image set you want, look for the image name and simply change the image without having to upload it as, you will now know the EXACT location on your server of the image you are changing to e.g., /set6/gallery8/image9.jpg would change to set24/gallery2/image2.jpg.

There are of course other ways this can benefit you for example, you can plug in your galleries to any site you own if you have them all uploaded to a central content location domain.

The benefits of organizing your content from the instant you take delivery are endless, the above is just a sample of how I have successfully saved time and effort by becoming more organized, the only limitations you have with your organizational skills are those that you impose on yourself.

Article written by Lee

Calling Complete JavaScript’s With One Line Of HTML Code

Date: 2011.02.21 | Category: WebDesign | Response: 0

We all know that some JavaScript coding can be excessive and add considerable amounts of additional coding to our pages making them both slower and less search engine friendly however, what if I told you there was a way you could call the EXACT same JavaScript functions you are calling now by using a single line of code and, in the process you would NEVER have to find a specific piece of JavaScript again as you would instantly know where it was saved.

You would probably think the above is in fact very time consuming but, it actually takes no time at all.

The secret is to copy and paste the JavaScript into a plain text file and save that on your server somewhere. However, instead of saving it as a .txt extension save this file as a .js extension and, to make it easier still to find, when you upload this file to your server place it in a directory called /JavaScript/.

That’s pretty much it, easy huh?

Now comes the part of actually getting the JavaScript to work on your web pages, what you need to do instead of using the complete JavaScript coding that you usually would if you wanted to make a pop-up console appear is to use the following coding placed between your <head> and </head> tags:

<script language=”JavaScript” src=”../JavaScript/popup.js”></script>

That will now call the popup.js file or whatever it was you called it from your server and make the JavaScript function work for your surfers with JavaScript enabled in their browser.

As you can see, not only does using this method save you a considerable amount of time but, it will also make your pages more search engine friendly as spiders will not have to work their way through a lot of heavily JavaScript before they get to your SE content.

Converting Italian Adult Traffic – The Niche Paysites That Work

Date: 2011.02.21 | Category: Traffic | Response: 0

Continuing with our article series of country specific traffic and which niches work for the various global markets in this article we will take a look at some of the most complicated traffic to ‘work’ Italian Adult Surfers. The reason I say most complicated is for the simple reason that, to date there are very few Italian paysites this makes it harder for us as webmasters to tap into these markets especially if we ourselves, do not know what the Italian surfer is after. That said, lets get on with the article.

Italian Traffic – Quick Analysis.

As already mentioned surfers from Italy are hard to pre-qualify given that there are very few sites catering to this European market at the present time, this means that there are no sources of background information to look at or, statistical analysis’s available from other paysites.

Italian Adult Surfers – The Niches.

For one of the most affluent international markets going it comes as a surprise to see that there are almost no localized pay sites for the Italian market this made our initial filtering of the Italian traffic much harder opting for translated free sites over paysite tour pages to send the traffic to itself then, once they hit the free sites either choosing to send them back into our central hub or, to the US version pay site of the niche free site they were visiting. That said here are the results from the previous 3 (three) months of traffic that we observed.

Ebony.

The Ebony niche would appear to be the most consistent converting niche on Italian traffic however, given that almost all of the niches we used on the Italian surfers were quite evenly spread for sales (Ebony was only 5 sales in front) this, I am sure is not a good indicator and, likewise with the Japanese and Chinese traffic, this is an area of international adult marketing that should ideally be re-visited at a later day.

For Women.

Even more surprising than the fact there are very few localized paysites for Italy was the fact that the ‘For Women’ niche converted just as well as the other niches we used for our Italian traffic, of course, this at first would seem to indicate that the vast majority of surfers we had on our sites from Italy were female however, as we all know, the Straight male niche is big in gay so, there is a chance the sales we got from our Italian traffic to the For Women niche paysites we used were equally male and female.

Softcore General.

(Softcore Adult Tours) The other strange thing we noticed was that paysites we offered to our Italian surfers that were Hardcore in nature didn’t convert as well as the paysites that had softcore tours, this would lend itself to the fact that Italian porn surfers are not looking for hardcore – quite different to most other country traffic sources.

Tranny.

The transsexual niche paysites that we offered to the Italian surfers also had some good results again, this is strange given that almost every other countries surfer we sent to a tranny site didn’t convert. One other thing that comes up with this and, given the fact that the for women niche paysites we used had good results would be that perhaps the Italian surfers are interested in the more obscure niches available on the adult internet.

Italian Adult Traffic – An Overview.

All in all, as stated at the beginning of this article the Italian surfers would certainly appear at first glance to be more varied and obscure in their sexual preferences than other countries whom appear to have clear cut, well defined ‘types’ of site that interest them.

I think as mentioned above Italian traffic needs to be looked at in more depth in a future article as, to my surprise the traffic didn’t work on the niches that previously converted well for the same amounts and quality of traffic.

Article written by Lee

Domain Name Registration Services What To Look For

Date: 2011.02.22 | Category: Domain Names | Response: 0

Once upon a time, if you wanted to register a domain name, you could only do it by visiting Network Solutions at http://www.networksolutions.com/ and paying them whatever they asked for, about $35.00 per year.

Then ICANN, http://www.icann.org/, The Internet Corporation for Assigned Names and Numbers (ICANN) that is the non-profit corporation that was formed to assume responsibility for the IP address space allocation, protocol parameter assignment, domain name system management, and root server system management functions previously performed under U.S. Government contract by IANA and other entities, decided to change the rules.

The initial testing phase of the new competitive Shared Registry System for the .com, .net, and .org domains quietly began to take place in April of 1999.

It started with five participants who were the first to implement the new system for competition in the market for .com, .net, and .org domain name registration services.

Previously, registration services in the .com, .net, and .org domains were provided by Network Solutions, Inc. under an exclusive contract with the United States government.

In the two years since this program began, things have really changed.

Just this last week, ICANN reported that two of their registrars, Tucows and New York-based Register.com, had recorded more new registrations for Top Level Domains (dot-com, dot-net and dot-org) than VeriSign’s Network Solutions.

This marks the first time ever that VeriSign’s Network Solutions was out-sold by any of the registrars and signals that their past dominance of domain name registration is certainly fading.

Why?

Because besides others being allowed to make domain name registrations, these new registrars are also cutting prices.

The Rules have most certainly changed.

The Shared Registration System (“SRS”), ICANN’s accredited registrars program, allows people to submit application to become a registrar along with a non-refundable $1000 filing fee.

After someone is accepted into the program then they must pay a yearly fee of $5000 to maintain their status as an accredited registrar.

This situation has created a very competitive environment which can only be beneficial to all of us as the price to register a domain name has fallen like a rock from a very tall building.

However, if you plan to register a new domain name using a virtual unknown registrar, make certain they do indeed have the legal accreditation from ICANN by visiting the ICANN web site and viewing their posted list of ALL accredited vendors:
http://www.icann.org/registrars/accredited-list.html

It will only take you a few moments to make sure you are dealing with a reputable vendor of domain names. Those few moments will make the entire process legal and worry-free.

Article written by Lee

Source Code – Eliminating HTML Margins

Date: 2011.02.24 | Category: WebDesign | Response: 0

Since the inception of the very first HTML document, margins existed that surrounded the document, like in the case with this document.

The margins are there to act as a cushion between the edges of the browser and the contents of the page, so it’s easier to read the content.

As good as margins are, wouldn’t it be nice to be able to eliminate them in some cases, where the design of the page calls for their termination? While most webmasters think it is not possible to “flush out” the default margins of a HTML document, it actually is, although only possible in IE 3+, and NS 4+. In this tutorial, I’ll show you how.

Eliminating The Document Margin In IE 3+

To get rid of the document margin in IE 3 and above, so content presses right against the edges of the browser, use the IE exclusive “leftmargin” and “topmargin” attributes:

<body leftmargin=”0″ topmargin=”0″>

It’s as simple as that!

Eliminating The Document Margin In NS 4+

To get rid of the document margin in NS 4 and above, use the NS 4 exclusive “marginwidth” and “marginheight” attributes instead:

<body marginwidth=”0″ marginheight=”0″>

Putting It All Together.

By putting the two techniques together, we can create a document that flushes out its’ margins in both IE 3+ and NS 4+:

<body leftmargin=”0″ topmargin=”0″ marginwidth=”0″ marginheight=”0″>

Try out the above coding on your page, and you’ll see what I mean.

Article written by Lee