Robots.txt – Control The Robots That Crawl Your Sites

Date: 2011.02.24 | Category: Search Engine Optimization, WebDesign | Response: 0

By writing a structured text file you can indicate to robots that certain parts of your server are off-limits to some or all robots. It is best explained with an example:

# robots.txt file for general use on web servers.

User-agent: webcrawler
Disallow:

User-agent: googlebot
Disallow: /

User-agent: *
Disallow: /cgi-bin
Disallow: /logs
The first line, starting with ‘#’, specifies a comment.

The first paragraph specifies that the robot called ‘webcrawler’ has nothing disallowed: it may go anywhere.

The second paragraph indicates that the robot called ‘googlebot’ has all relative URLs starting with ‘/’ disallowed. Because all relative URL’s on a server start with ‘/’, this means the entire site is closed off.

The third paragraph indicates that all other robots should not visit URLs starting with /cgi-bin or /log. Note the ‘*’ is a special token, meaning “any other User-agent”; you cannot use wildcard patterns or regular expressions in either User-agent or Disallow lines.

Two common errors:

Wildcards are not supported: instead of ‘Disallow: /tmp/*’ just say ‘Disallow: /tmp’.
You shouldn’t put more than one path on a Disallow line (this may change in a future version of the spec)
Ultimately, without the use of robots.txt files on your servers/domains, you are risking a variety of potential problems including, unauthorized access to your cgi directory, unauthorized viewing of your site stats, possible spamming of the search engines by accidental crawling of doorway pages.

One distinct advantage however of having a robots.txt file on your server is that, quite simply, you will be able to tell when and where your site has been indexed or potentially indexed as, all robots will automatically call for the robots.txt file BEFORE any other page on your server so, as long as you keep an eye open for any calls of this file, you can see who is knocking at your site for indexing purposes.

Below is a robots.txt example that you can copy and paste into a text document to use on your own server:

<!–Start Copy Below This Line–>

User-agent: *
Disallow: /cgi-bin
Disallow: /logs

<!–End Copy Above This Line–>

The above will allow all spiders to crawl all of your site except the subdirectory’s ‘cgi-bin’ and ‘logs’ which, may be altered to suit any subdirectory’s you do not wish the spiders to crawl on your server.

Article written by Lee

HTML Page Load Times – Making Them Quicker

Date: 2011.02.22 | Category: WebDesign | Response: 0

Surfers on the web are here for one thing and one thing only, they want information, they want it to be correct and, more importantly, they want it now. We cant always help when it comes to getting the information however we can help them so far as making sure that when one of the surfers clicks on our pages they load quickly.

Taking Control Of Speed.

For many webmasters hand coding their HTML pages is an often timely and costly method and, because of this they turned to the WYSIWYG (What You See Is What You get) editors such as Dreamweaver and Frontpage to create their pages for them however, even this in itself requires some manually intermission on the webmaster part. Many of the older style WYSIWYG Editors added a fair amount of un-needed code to the HTML so, spending a few minutes after you have your pages created to physically go through the HTML code and clean up the junk html can in effect, cut down your page size by up to 25% in some instances.

HTML Quotations And Hyphens.

In addition to un-needed HTML tags you may also want to consider removing any quotation marks or hyphens from your HTML code, both of these can quickly clutter up a page and laden it down with more code than is actually required.

For example, ‘HTML Coding’ makes just as much sense as me telling you HTML Coding when read in sequence. The trick with using quotations and hyphens is actually knowing at what point in your text you can ‘get away’ with removing them and, this is only something you will know yourself after proofing your completed page.

Hyperlinks.

If you are only going to provide links from one page of your site to another then, why use absolute paths? http://www.domain.com/linking.html is the same as /linking.html when you use it in a link from one page on your site to another and, well, in all honesty you have increased the load time of your page by only linking to the relative url instead of the absolute and that’s what we are trying to do here right? Make our pages load faster.

White Space.

White space on a web page can be a good marketing tool however, white space in your HTML code is a bad thing, placing spaces between certain parts of your HTML code can quickly bog down your load times instead, try to use the tab key to separate certain parts of code likewise, keep the use of &nbsp to a minimum, this can quickly become the most relevant term on your page if used in excess.

One other benefit of making your pages as small as possible is that a webmaster wanting to steal your HTML code is going to have a harder time finding the exact piece of coding if the HTML is all on a single line than they would if the code was laid out nicely however, this in itself is only a deterrent and it wont stop those webmasters determined to steal your HTML code.

Page Load Time Overview.

Hopefully this brief article has given you some idea of ways in which you can practically reduce the load time of your pages without affecting the overall look and feel of your site and, who knows, if your page loads quicker, then you have a better chance of your surfer getting to your sponsor quicker.

Article written by Lee

Niche Marketing – What Is A Niche?

Date: 2011.02.23 | Category: Promotion | Response: 0

The first step as webmasters we must take to become successful is to discover what our niche specialty is however, many webmasters still do not realize exactly what a niche is.

In fact, from the webmasters I have spoken to it would seem that a ‘niche’ is just another word for the main topics of pornography, Teen, Asian, Fetish, Gay, Straight, the list goes on and, whilst this list is never ending they are all niches in themselves however, you need to look beyond the top level niche and start to develop a feel, a stance of your own as to what niche you will work on for example, Asian Midgets, you probably cant get more niche than that in this day and age however, realistically, the chances of you a) being able to find the content for this niche and b) Being able to find a sponsor are remarkably thin.

That said, if you can find a niche that you like personally, whether that be she-male, midgets, straight or, gay, this will give you a solid foundation to market your sites on especially if you build on your already vast knowledge of what turns you on.

Now, onto breaking down the niche you are comfortable working in..

Lets say for arguments sake that you have chosen to concentrate on the ‘Gay’ market,, within this market (as with any other) there is a remarkable amount of ‘sub-niches’ and, these are what you need to build your business around whether you want to or not, the ‘sub-niches’ of any given adult market is where the $$$ can be earned.

Now using the gay market as an example the first few niches that come to mind are:

Twink’s – Young looking hairless 18 – 20 year olds.
Bear’s – Hairy men over the age of 20.
Hunk’s – Muscular looking guys in the age group of 20 – 30 .
Straight Guys – Yes, that’s right, gay men get off on looking at straight guys.

As you can see from the above four examples we can now start targeting our market audience a lot better.

The next thing we need to do now that we have found the niche and the sub-niche we will be working is to look for a sponsor that complements the niche of our choice, this is the hard part. Many webmasters will go directly to the highest paying sponsor and throw links up to their ‘sub-niche’ pay site not even looking at the sites tour or members area. This is a huge mistake, the first thing you NEED to do is to look over the sponsors paysites and, more importantly, the sponsors site tour AND members area. What point is there sending your surfers who are after Twink’s if, your sponsors tour has images of a load of guys over the Twink age bracket?

From this point on and, after you have chosen a suitable tour to send your traffic to you need to build up a flow of ‘niche’ traffic the chances are, if you submit your TGP gallery to an ‘all gay’ TGP that you will receive a substantial amount of unfiltered traffic making your hard work in choosing your sponsors tour worthless.

So how do you choose a traffic source that is right for you? Simple, you need to experiment, start of with your niche TGP’s, Top Lists, Links Lists etc and see what happens, how much traffic are you being sent from your chosen traffic source and, more importantly, how much of this traffic is actually clicking through to your sponsors tour. Once you can get an idea of what traffic you are being sent from what traffic source you have won more than half of the battle already.

Record EVERY possible detail about your traffic sources that you can, how much traffic they send a day, how many visits your sponsor gets, how many sales you made, what content you were using etc, etc.

Once you have a working list of data to use you can start to abuse and filter your traffic like you would have not thought imaginable, if one of your sponsors has a higher payout on Bear traffic, then you instantly know what traffic source gives you traffic for that niche and, you can utilize that information to your benefit.

The most important thing to remember however when marketing a niche is that you need to have patience, you need to use a process of trial and error and, more importantly, you need to experiment, just because TGP A sends you 100,000 hits of Twink traffic one day, it doesn’t mean you will get the same quantity of niche traffic the next.

Article written by Le

Marketing Sites With Slogans

Date: 2011.02.22 | Category: Promotion | Response: 0

With the constant changes happening in the adult industry webmaster need to look towards alternative ways of marketing not only their own sites but the sites of their sponsors. This is where something that we have all seen daily can come in handy, what is this marketing tool? Simple, Slogans.

Slogans – What Are They?

A slogan is a short, memorable advertising phrase for example, ‘Just Do it’ – Nike. By utilizing a slogan on your site you are not only giving your surfers something other by which they can remember your site by but, you are actively building up your brand which, in turn, can mean more repeat traffic and ultimately, more sales.

How To Make A Slogan.

So now you know what a slogan is how do you go about creating one? Simple, you should think of something short, usually three to four word slogans work the best again, as with the Nike example above ‘Just Do it’ its short, sweet and memorable, try to make your own slogan fit within this guideline and you are half way done. Another thing that you may like to consider is making your slogan practical or humorous, something witty can often stay in a persons mind a lot longer than something serious, play on peoples memory and ensure they remember your brand.

Where To Use Your Slogan.

Now that you have thought up a slogan which you feel will work on your traffic and sites you need to consider the places where you can use it for maximum impact, the most obvious place to use your slogan is on your site design, either at the top or the bottom of your pages, make it clear and more importantly, make it stand out. In addition, if you have any banners or buttons created, ensure you utilize the slogan on those creatives, the goal is to have your slogan seen by as many people, as quickly as possible.

Article written by Lee

Building A Surfer Trap – Stage 8 – Final Stage

Date: 2011.02.21 | Category: Traffic | Response: 0

Ok people we have hit the final stage in our surfer trap, Stage 8.

All we are really going to do in this stage is a brief recap over what we have done so far along with checking that our trap is working properly.

In order for us to check our trap is working properly we need to upload it to our server if we haven’t already done so, therefore, you should do this now.

Once the surfer trap has been uploaded we now need to go to the first page, the Multi-Site FPA.

Depending on how you set up your Multi-Site FPA you should either get a pop up or not.

You should also have a counter AND a banner exchange code loading at the bottom of the page below your ‘no thanks’ link.

If this works how you want it to then this stage is working ok.

The next thing we need to check is that ALL of the links off this Multi-Site FPA are working so expect to get a lot of pop-ups while we check this.

You should click on each of the Single-Site FPA’s in turn ensuring that for every one you have a pop-up console appear.

In addition to checking the Single-Site FPA links you should now click on the ‘no thanks’ link along with the counter code and the banner exchange code on your Multi-Site and Single-Site FPA’s.

If these all load fine then this stage of the checking is complete.

Next, we need to close down any and all of the FPA’s we may have open including the Multi-Site FPA.

You should now be left with a couple of consoles, again, follow the links on your consoles including any to the counter you chose along with any banner exchange code you utilized on your consoles.

Again if these work how you expected them to, this section of the checking process is now complete.

For the next step, you need to log into your counter AND banner exchange account, you want to make sure that you have gained additional impressions and rankings from your banner and counter impressions and clicks.

Be aware however, that some counters and banner exchanges will not count multiple views and click from the same IP address so you may only show one or two additional clicks, impressions, or rankings. This is perfectly normal.

If your accounts have gained additional ranks, impressions, and clicks then this stage is completed.

Close down your consoles, you should now get the blur consoles that you created (if you used them) again, as before, check that all of the links from this consoles work.

If they do then you now have a fully complete Surfer Trap to use.

So, what next? Well there are a couple of options, you can mirror this surfer trap to experiment with your sponsors different tour pages, link your first mirror to the second tour page, your third to console free tour pages, etc.

Another good thing that you can do is to create additional Multi-Site FPA’s however, this time, create them by niche so where we have a general Multi-Site FPA at the moment you could use this same method for a Gay, Asian, Teen, etc Multi-Site FPA using the same methods we did when we created this trap.

You should always sign up for a new counter and banner exchange code for each variation of your surfer trap. This way, you get to see performance based on a new working model enabling you to decide which version of the trap works best for you.

I hope this tutorial has given you some insight into how we can generate, filter and trade traffic whilst marketing our sites effectively and, that it has given you some ideas on how you can implement even the simplest item provided to you by your sponsor to generate sales.

For those of you who have been following this tutorial I would like to thank you and wish you all the best with your new found marketing skills.

If you have any questions as always, feel free to post on the forums and we will endeavor to help you out.

Article written by Lee.

Mirroring Adult Sites – Stage One.

Date: 2011.02.23 | Category: Promotion, Tutorials | Response: 0

In this next series of tutorials I will be exploring the benefits of utilizing your existing content to build more sites in the least amount of time possible, in fact, after you have completed the steps in this tutorial series you should be able to build over 20 types of site within 5 minutes using a single set of 50 pictures.

So, onto the start of our tutorial.

Stage one in this tutorial is something we have ALL done before, so what you need to do is this…

Build a 50 pic free site, this is using a lot more content than a ‘standard’ free site however, what we are actually going to be making is a set of AVS sites and several TGP galleries, along with some SE pages and also some links list mirrored pages using this set of 50 images by building just ONE site! Sounds impossible? It isn’t… read on….

Your site should have the following on it:

1) Warning Page (index.html)
2) Menu Page (menu.html)
3) Gallery Pages (5 galleries of ten pictures called gallery1.html, gallery2.html etc)
4) HTML Large image pages x 50 (picpage1.html, picpage2.html, etc.)
5) Multi Site FPA (fpa.html)

Now lets break these individual pages down into sets of instructions for each:

Warning Page.

This should have your standard warning text placed on it, along with an enter AND an exit link. The ‘enter’ link should link to your Multi Site FPA and the ‘exit’ link should go to a program such as the ARS Discreet Browser tour page.

Menu Page.

This should be a page containing an odd sized banner, links to your 5 gallery pages, plus text links at the bottom of the page ideally, these text links should be in the same style as the niche tables we created for the surfer trap except they should only contain 4 cells instead of 8. These links should go to a different ‘niche’ as the one you are building your current site for and, link to the existing FPA’s of your surfer trap.

Gallery Pages.

On your gallery pages, ALL of the thumbnails should be linked to the relevant HTML page with a text link at the top and at the bottom of the HTML page (No Banners are to be used on the gallery pages!) Also, the file names of the images should be pic1.jpg, pic2.jpg, etc for the full sized images and, thumb1.jpg, thumb2.jpg etc for the thumb nailed images. your images MUST be named this way!!

Multi Site FPA.

This should link to the individual FPA’s that you should already have on your server if you followed the surfer trap tutorial series (If you did not create this surfer trap the tutorials can be found at this link) as well as linking to the Single Site FPA’s this should also have a ‘no thank you’ link which goes to your Menu Page.

Images.

You need to have 50 images, you also need to have 50 thumbnails for the content you will be using on this site. I usually select my content by the niche I am building for, rename the images using The Rename then, once renamed I use Thumbnailer from Smaller Animal to create the thumbnails for each of the renamed images. This will give you 50 full sized pictures with 50 thumbnails named respectively for the larger image.

They are the basics, now onto the good stuff…

Once you have created these pages you need to create some folders on your Hard Drive which will be the SAME structure you will have on your server. This folder structure should look somewhat like this once you have saved each of the pages we have just created into their respective sub folders:

FreeSite/index.html
FreeSite/AVS/
FreeSite/FPA/fpa.html
FreeSite/Galleries/gallery1.html, gallery2.html, gallery3.html, etc, etc.
FreeSite/Images/pic1.jpg, etc.
FreeSite/Images/Thumbs/thumb1.jpg, etc.
FreeSite/LinkList/
FreeSite/Menu/menu.html
FreeSite/PicPage/picpage1.html, picpage2.html, etc.
FreeSite/Recips/
FreeSite/Engine/
FreeSite/TGP/

This will give you 5 folders with HTML pages in them, one folder with the full sized images, one with thumbnails in it and five empty folders.

At this point we will end the first stage in this tutorial as this should take you a couple of hours to complete.

Article written by Le

International Billing Alternatives – Premium Phone Billing

Date: 2011.02.24 | Category: Billing Solutions | Response: 0

In the last article i wrote in respect of international billing options we took a closer look at the SMS Billing method and its pitfalls and benefits when charging our surfers for access to our sites. In this article we will take a look at another option we can offer our international surfer base – Phone Billing.

Phone Billing – What Is It?

Phone billing, as the name would suggest is a method of applying a ‘charge’ to a surfers normal land-line telephone. This charge is often around the cost of $35 (US).

Once the surfer has called the premium rate number displayed on your websites join page, they are given a code to enter into a form, again, this form could be on your join page or on a separate site.

Phone Billing – What Are The Costs.

To be perfectly honest with you this is all dependant on to many variable factors to give you a good solid answer. However, as mentioned above the standard cost would seem to be in the region of $35 (US) but, this can often vary depending on factors such as the country in which the surfer is calling the premium rate line from, How much the surfers telephone company charges for a call, How much the paysite charges for access, How much the premium rate phone line provider charges, etc etc.

Generally speaking however, the cost to the surfer is almost always made into profit in your pocket, if a call costs $35(US) you will almost certainly make $35(US) from that surfer minus a small percentage (depending on the provider) again however, this figure may vary slightly.

Phone Billing – Overview.

As with SMS Billing, Premium Rate Phone Billing offers a good alternative for your international surfers to access a paysite however, this doesn’t come without its drawbacks. Unless your members area is updated regularly and is of high quality you are going to make $35(US) approximately of each surfer unless, that is, they decide to call the premium rate number again for access to your site for another month.

That said, if you do not want to offer your foreign surfers the option of having credit card or debit card access to your sites Premium Phone Billing would almost certainly be my second choice to make money from them at the present time.

Article written by Lee

Viral Marketing – Catching The Marketing Bug

Date: 2011.02.21 | Category: Viral Marketing | Response: 0

The term viral marketing is offensive. Call yourself a viral marketer and, people will often take two steps back. I know I would do. It is a sinister thing, the simple virus is fraught with doom, not quite dead yet not fully alive, it exists in that nether region somewhere between horror movies and disaster films.

That said however, you have to admire the skills of the viral marketer. They have a way of winning by sheer weight of numbers alone. They piggy back on everyone else and use their resources to grow their own. In the right circumstances the viral marketer can grow exponentially. A virus doesn’t have to mate, it just replicates itself again and, again and, again increasing its power, doubling its effect with each replication.

I
I I
I I I I
I I I I I I
I I I I I I I I

In a few short generations, a viral marketing population can boom as seen in the diagram above.

Viral marketing defined.

What does a virus have to do with viral marketing? Viral marketing describes any strategy that encourages individuals to pass on a marketing message to others, creating the potential for mass growth in the messages exposure and influence.

Like viruses, such strategies take advantage of rapid multiplication to explode the message to hundreds, even thousands in a relatively short period of time.

Before the advent of the internet viral marketing was often referred to as ‘word of mouth’. However, for better or for worse, the term viral marketing has infected.

One classic example of this marketing technique is Hotmail.com one of the first free web based email services. Their strategy was simple.

Give away free email addresses and services.
Attach a simple tag at the bottom of every free message sent out.
Watch people email their friends, colleagues and family.
Watch these same friends colleagues and family join up to their service.
See the message propelled to an ever increasing audience, all for free.

In closing viral marketing is like watching the tiny ripples of a single pebble dropped pond, one small splash can create ever increasing circles which in turn could create ever increasing revenues.

Article Written By Lee

Favicon.ico – What Does It Do?

Date: 2011.02.22 | Category: WebDesign | Response: 0

Favicon.ico is the name of the graphic Internet Explorer 5+ uses in the address bar and when someone views their favorite bookmarks. There should be one beside the address of this page now if you are using IE5+. If you want to see favicon.ico in action among your favorites bookmark our site now by right clicking and selecting ‘Add to favorites’.

Internet Explorer looks for this file in the same directory as the HTML page currently being displayed, if it cant find favicon.ico it will then display the default Internet Explorer icon in the address bar. As for viewing of favorites, IE will check its temporary folder to see if favicon.ico is there again, if it is not located it will display the default white background with a blue ‘e’ icon.

For a webmaster there are three main advantages to using the favicon.ico ‘trick’.

The first, is that it helps to brand your site with a nice little icon that is easy to recognize.

The second, is that it makes your website more professional.

The third, is that your entry will stand out in surfers bookmarks over the others. This is especially good as, if you can get a surfer back to your site then you have another chance at making a sale.

Many internet users have a multitude of site bookmarks so, you need to use favicon.ico to give you an edge. I highly recommend using it and, now I’m going to tell you how.

First, you will need to create an icon file which is exactly 16 x 16 pixels. If the icon is larger or smaller IE5+ will just ignore it. As for the colors in it, 16 is standard. You can use more colors if you want but, the more colors you use, the larger the .ico file becomes and, the longer it takes to load.

You now know the standards the favicon.ico file has to be, now to actually create this file you can take one of two routes.

The first is to convert and existing 16 x 16 BMP or GIF graphic with 16-32 colors into an .ico file using converter software making sure to save it as favicon.ico.

You know the standards the favicon.ico file has to be, now to actually create favicon.ico . The easiest way of creating a favicon.ico file is to convert an existing 16 X 16 BMP or GIF graphic with 16 – 32 colors into a .ico file using converter software making sure to save it as favicon.ico.

Once you have created your favicon.ico file all you need to do is to upload it to any directory on your server that contains html pages. This way, when IE5+ searches for favicon.ico it will be bale to find it regardless of which page you are on.

That’s nearly all the areas of favicon.ico covers apart from, what if you want different icons for different parts of your website? Can this be done? The answer is yes it can. All you have to do is place the following HTML code between the <head> and </head> tags of your web page.

<LINK REL=”SHORTCUT ICON” HREF=”differenticon.ico”> (SHORTCUT ICON should be kept in uppercase).

Now when someone adds a web page with that code to their favorites, IE5+ will not look for favicon.ico but will look for differenticon.ico and if it’s there it will display it, if not the default icon will be displayed.

Using favicon.ico or the SHORTCUT ICON code is nice way to add a unique touch to your site, and of course will result in more repeat visitors than if you were not using it – which is always good for any webmaster.

Article Written By Le

Bandwidth Explained

Date: 2011.02.21 | Category: Hosting | Response: 0

Bandwidth is the total amount of data that can be sent in a given time between two computer devices. The more bandwidth that is available, the faster the server.

Any webmaster expecting a decent amount of traffic to their adult site will require a web hosting package that includes a large amount of bandwidth. This is so important, especially with the growth of your online business and, ultimately your sites. The more bandwidth your server has, the larger the number of surfers who will be able to view it at the same time, and the access it quickly will be. If you don’t have enough bandwidth, surfers will not be able to access your site as quickly, and that may turn them off which in turn, will mean they will leave your site.

For this reason alone, it is important to select a hosting company that can offer you a great deal of bandwidth. As an example, larger hosting providers will have T1 lines or fiber-optic relays to access the Internet; these will provide a fair amount bandwidth. Another way is to get a dedicated server which, in turn, gives you exclusive access to your server’s connectivity instead of sharing it with others, as such allowing for maximum hardware performance.

To calculate your bandwidth needs, you must know how large each page on your site is, including the graphics and any script usage you may have. Then, you multiply that by the number of views you expect the site to get every month.

For example, say you have three 5k images on your page and a 2k HTML file – you would have 17k of data on that page. Multiply that by your expected page views (let’s say in this case it is 100,000 per month), and you get 1.7 G of data to be transferred that month for that page alone. Now calculate this for each page, and you will know approximately how much bandwidth your entire site requires.

The best way of using bandwidth efficiently is to keep the size of your html pages low. In other words, ensure your HTML programming is adequate enough to use minimal amounts of coding for the purpose you want and, that your photos and graphics are small. To reduce photo file sizes you should always use JPEG format, which can reduce files up to 5% of its original size. Make sure to use the GIF format for graphics, as opposed to TIFFs or BMPs, which are generally much larger in file size.

If you attach URLs to your IMG SRC that link to another person’s images without their permission, this is known throughout the online industry as hotlinking which, costs the person you are linking the image of money and not yourself. For this reason, hotlinking, is looked upon dimly.

The unfortunate truth is that hotlinking is rife in the online industry. However, lets not let that deter you, by utilizing a file called .htaccess on your server, you can prevent other dishonest webmasters hotlinking your images.

As with most things in this industry, you need to shop around to find the best prices available to you. However, that said, as a general rule of thumb, a gig of transfer can cost between $1 and $5 these are usually thought to be good prices for a gig of bandwidth. You can also get certain hosting packages that have a specific amount of bandwidth included in the price, however, the one draw back of these types of deals is that, if you go over that limit, you will either need to pay and excess bandwidth usage fee or, upgrade your hosting plan.

Article Written By Lee