Robots.txt – Control The Robots That Crawl Your Sites

Date: 2011.02.24 | Category: Search Engine Optimization, WebDesign | Response: 0

By writing a structured text file you can indicate to robots that certain parts of your server are off-limits to some or all robots. It is best explained with an example:

# robots.txt file for general use on web servers.

User-agent: webcrawler
Disallow:

User-agent: googlebot
Disallow: /

User-agent: *
Disallow: /cgi-bin
Disallow: /logs
The first line, starting with ‘#’, specifies a comment.

The first paragraph specifies that the robot called ‘webcrawler’ has nothing disallowed: it may go anywhere.

The second paragraph indicates that the robot called ‘googlebot’ has all relative URLs starting with ‘/’ disallowed. Because all relative URL’s on a server start with ‘/’, this means the entire site is closed off.

The third paragraph indicates that all other robots should not visit URLs starting with /cgi-bin or /log. Note the ‘*’ is a special token, meaning “any other User-agent”; you cannot use wildcard patterns or regular expressions in either User-agent or Disallow lines.

Two common errors:

Wildcards are not supported: instead of ‘Disallow: /tmp/*’ just say ‘Disallow: /tmp’.
You shouldn’t put more than one path on a Disallow line (this may change in a future version of the spec)
Ultimately, without the use of robots.txt files on your servers/domains, you are risking a variety of potential problems including, unauthorized access to your cgi directory, unauthorized viewing of your site stats, possible spamming of the search engines by accidental crawling of doorway pages.

One distinct advantage however of having a robots.txt file on your server is that, quite simply, you will be able to tell when and where your site has been indexed or potentially indexed as, all robots will automatically call for the robots.txt file BEFORE any other page on your server so, as long as you keep an eye open for any calls of this file, you can see who is knocking at your site for indexing purposes.

Below is a robots.txt example that you can copy and paste into a text document to use on your own server:

<!–Start Copy Below This Line–>

User-agent: *
Disallow: /cgi-bin
Disallow: /logs

<!–End Copy Above This Line–>

The above will allow all spiders to crawl all of your site except the subdirectory’s ‘cgi-bin’ and ‘logs’ which, may be altered to suit any subdirectory’s you do not wish the spiders to crawl on your server.

Article written by Lee

Do You Keep The Surfers Attention?

Date: 2011.02.22 | Category: Traffic, WebDesign | Response: 0

A new discovery says that people are born to respond to information a certain way. It also indicates that when we use our in-born or natural style to process information, we relax and feel good. The same research also indicates that 92% of thousands tested have changed that style to one they think works better. The change causes stress. So 92% of the viewers of your site are stressed. Because people often visit your site and click off almost instantly, you face the problem of getting their attention and keeping it long enough to persuade them to buy.

The fact is that people today have shortened attention spans. If you don’t get them in the first few seconds, you lose them! You can either build a terrific web site — or just end up with “click thrus.” Many site owners think it enhances a site to add animation or cool sounds. But the answer is to make your site appeal to the individual. Great sites of the future will know how to “individualize” their message.

Even though we all have to learn how to use a computer, high tech has not made people think the same way. You are not battling high technology; you are fighting to keep the attention of three (3) basic in-born styles. This may sound overwhelming, but it is really a simple matter of anticipating a viewer’s response before he or she gets to your site. Anticipation of responses makes or breaks your site.

So how do you anticipate how a viewer responds before it happens? It is really simple. You start by learning how you personally respond to information. Why is this the beginning place? It is because you and the way you react when receiving or giving out information influences everything about your site. Next you learn about the other ways people respond to information. It is easy to begin anticipating reactions as you get a whole new perspective on how people are born to process information. Things start to make sense to you and people are no longer such a mystery.

These conclusions are drawn after over 20 years of research. The research verifies that it is possible to appeal to most views rather than 2 – 4 in a thousand. So, when someone tells you how to write killer copy, or make your site jazzy with new technology, you are hearing from only one of the basic in-born styles. Take everything with a grain of salt until you evaluate it according to the simple guide that lets you appeal to ALL styles rather than only one.

Article written by Lee

The Lost Traffic Source – Picture Posts

Date: 2011.02.24 | Category: Pic Posts | Response: 0

Back in the day, pic posts were all the rage, taking less time for webmasters to build for and, less time maintaining however, in recent times we seldom hear of these traffic sources as more and more webmasters turn to the TGP’s in an effort to get traffic ‘quantity’ over ‘quality’ my personal feelings are that the pic posts of the past will soon start to make a comeback.

The Basics.

So, we know the history behind the Pic Post but what about the dynamics? How exactly do they work? That’s easy, you take an image, give it a HTML page and add the recip to the PP (Pic Post) you are submitting the page / image too along with a banner leading to your site. At this time, it would be prudent to add that, if you will be submitting to PP’s on a regular basis, you might also like to add the url to your main domain on the image in the lower right or left hand corner.

One other thing to take into consideration when using PP’s is that softcore is often better. With the readily available hardcore content on TGP’s the chances are, that the surfer has decided to visit the PP because there is not as much widely available hardcore content.

Cost Balance.

In addition to the relatively minimal amount of work required to create pages for the PP’s there are several other factors that make them much better then TGP’s and Free Sites the main one is that bandwidth usage is relatively low for a start, not to mention the fact that you can knock out hundreds / thousands of PP pages a day compared to the tens / hundreds of TGP and Free Sites.

Also, when looking at cost, the one factor people often forget is the submission time and, unlike the TGP model of traffic the vast majority of PP’s will actually encourage or, in some instances, prefer automated submissions, this means that you can target hundreds of PP’s in less time than it takes to submit a TGP or Free Site.

Marketing Basics.

Of course, as with any type of site that we build as webmasters, the main reason that surfers will visit our sponsors is the marketing ‘spin’ we give them, this is where the use of Alt Tags and Text can become extremely useful, bearing in mind, the surfer can already see the ‘larger picture’ on your PP page by utilizing Alt Tags and other SEO methods you can actually entice the surfer to click through to your sponsor and, get some very good rankings in the search engines at the same time.

Housekeeping.

Now you have started to use Picture Posts, as with any form of traffic you need to ensure you keep ‘accurate’ records of who is and who isn’t accepting your pages along with details stats on the amount of traffic each PP sends you and, you ultimately send off to your sponsors site.

Adjust everything you can. trial and error plays a MAJOR part in using PP’s just because you use softcore images one day and get 1000 hits to the page you created, that doesn’t mean that by using hardcore images the next day you will receive more or, less traffic, also being niche specific, unlike with the TGP game can have its disadvantages, use images that appear at first glance, to be ‘generalized’ then, over time adjust your advertising methods to reflect the niche of surfer you are targeting.

In addition to keeping records of the pages you create for the picture posts, you should also be sure to keep a record of where else you have used them, just because you are using them for the PP’s specifically, this doesn’t mean that you can not interlink these pages together and get some traffic of your own to them, does it?

Hopefully this article has given you some more insight into the world of the Picture Post and, if you try an experiment with this little known source of quality traffic, I feel certain you will be pleasantly surprised with the results you see.

Article written by Lee

Using Basic Server Side Includes (SSI)

Date: 2011.02.24 | Category: WebDesign | Response: 0

Server side includes are what their name sounds like.  A way to include the contents of another file into your current web page BEFORE the web page gets sent off to the surfer.  Not only does this include contents of a static file but you can also include the results of a CGI program and on some web servers, you can even have it display the current date and time.

Now, many web hosts do not normally have server side includes turned on. You will have to ask your host if they have SSI turned on and if they do, what is the file name extension for SSI.  By default, SSI files have an .shtml extension.

Sometimes, you can turn SSI on yourself.  If you host doesn’t have SSI turned on for you already, you can try adding the following two lines to your .htaccess file.  Then create a file with the .shtml extension, include a SSI command and see if it works.

AddType text/html .shtml
AddHandler server-parsed .shtml

When you use SSI commands, you place them exactly in the location within your web page where you want the output of the SSI command to appear when you finally browse the page.  If you have SSI, then you can use the following command to include a file.  When you include a file, you can either give it a path name to the file or you can give a URL to the file. I’ll list both here.

<!–#include file=”/some/path/above/my/web/to/my/header.html” –>

This is an example of how to include a file based on its path name.  Now,
here’s the same file put included with its URL.

<!–#include virtual=”/to/my/header.html” –>

And this is an example of how to use a URL.  With a URL however, it cannot be a complete URL such as http://www.somesite.com/somefile.html.  It has to be within your current website.  You can also use the URL method to run a CGI script!  Here’s an example of that:

<!–#include virtual=”/cgi-bin/somescript.cgi?myfirstarg=1amp;mysecondarg=2″
–>

As you can see, we can even pass arguments to the CGI script just as if you typed it into your browser!  There is also another way of running a CGI script but this is not as widely used any more and you should use the #include virtual method instead.  Here is the same example so that you will know what it means when you see it.

<!-exec cgi=”/cgi-bin/somescript.cgi?myfirstarg=1amp;mysecondarg=2″ –>

As I mentioned earlier, you can use SSI to display the current time and date. Here’s how:

<!-echo “$DATE_LOCAL” –>

This will display the current date and time. SSI is usually used when you  want to have a standard header or footer on each page.  It’s also used for displaying rotating banners or page counters. As you see above, you can also  use it to display the current date and time or the date when the page was  last modified.

SSI has also been used for cloaking and some tracking  software uses SSI to track each incoming hit to the web page.  If you would  like more information about SSI, go to
http://www.apache.org/docs/mod/mod_include.html.  This is the definitive guide on SSI on the Apache web server.

Most other web servers that use SSI also follow these conventions.

Article written by Lee

HTML Page Load Times – Making Them Quicker

Date: 2011.02.22 | Category: WebDesign | Response: 0

Surfers on the web are here for one thing and one thing only, they want information, they want it to be correct and, more importantly, they want it now. We cant always help when it comes to getting the information however we can help them so far as making sure that when one of the surfers clicks on our pages they load quickly.

Taking Control Of Speed.

For many webmasters hand coding their HTML pages is an often timely and costly method and, because of this they turned to the WYSIWYG (What You See Is What You get) editors such as Dreamweaver and Frontpage to create their pages for them however, even this in itself requires some manually intermission on the webmaster part. Many of the older style WYSIWYG Editors added a fair amount of un-needed code to the HTML so, spending a few minutes after you have your pages created to physically go through the HTML code and clean up the junk html can in effect, cut down your page size by up to 25% in some instances.

HTML Quotations And Hyphens.

In addition to un-needed HTML tags you may also want to consider removing any quotation marks or hyphens from your HTML code, both of these can quickly clutter up a page and laden it down with more code than is actually required.

For example, ‘HTML Coding’ makes just as much sense as me telling you HTML Coding when read in sequence. The trick with using quotations and hyphens is actually knowing at what point in your text you can ‘get away’ with removing them and, this is only something you will know yourself after proofing your completed page.

Hyperlinks.

If you are only going to provide links from one page of your site to another then, why use absolute paths? http://www.domain.com/linking.html is the same as /linking.html when you use it in a link from one page on your site to another and, well, in all honesty you have increased the load time of your page by only linking to the relative url instead of the absolute and that’s what we are trying to do here right? Make our pages load faster.

White Space.

White space on a web page can be a good marketing tool however, white space in your HTML code is a bad thing, placing spaces between certain parts of your HTML code can quickly bog down your load times instead, try to use the tab key to separate certain parts of code likewise, keep the use of &nbsp to a minimum, this can quickly become the most relevant term on your page if used in excess.

One other benefit of making your pages as small as possible is that a webmaster wanting to steal your HTML code is going to have a harder time finding the exact piece of coding if the HTML is all on a single line than they would if the code was laid out nicely however, this in itself is only a deterrent and it wont stop those webmasters determined to steal your HTML code.

Page Load Time Overview.

Hopefully this brief article has given you some idea of ways in which you can practically reduce the load time of your pages without affecting the overall look and feel of your site and, who knows, if your page loads quicker, then you have a better chance of your surfer getting to your sponsor quicker.

Article written by Lee

Marketing Sites With Slogans

Date: 2011.02.22 | Category: Promotion | Response: 0

With the constant changes happening in the adult industry webmaster need to look towards alternative ways of marketing not only their own sites but the sites of their sponsors. This is where something that we have all seen daily can come in handy, what is this marketing tool? Simple, Slogans.

Slogans – What Are They?

A slogan is a short, memorable advertising phrase for example, ‘Just Do it’ – Nike. By utilizing a slogan on your site you are not only giving your surfers something other by which they can remember your site by but, you are actively building up your brand which, in turn, can mean more repeat traffic and ultimately, more sales.

How To Make A Slogan.

So now you know what a slogan is how do you go about creating one? Simple, you should think of something short, usually three to four word slogans work the best again, as with the Nike example above ‘Just Do it’ its short, sweet and memorable, try to make your own slogan fit within this guideline and you are half way done. Another thing that you may like to consider is making your slogan practical or humorous, something witty can often stay in a persons mind a lot longer than something serious, play on peoples memory and ensure they remember your brand.

Where To Use Your Slogan.

Now that you have thought up a slogan which you feel will work on your traffic and sites you need to consider the places where you can use it for maximum impact, the most obvious place to use your slogan is on your site design, either at the top or the bottom of your pages, make it clear and more importantly, make it stand out. In addition, if you have any banners or buttons created, ensure you utilize the slogan on those creatives, the goal is to have your slogan seen by as many people, as quickly as possible.

Article written by Lee

Viral Marketing – Catching The Marketing Bug

Date: 2011.02.21 | Category: Viral Marketing | Response: 0

The term viral marketing is offensive. Call yourself a viral marketer and, people will often take two steps back. I know I would do. It is a sinister thing, the simple virus is fraught with doom, not quite dead yet not fully alive, it exists in that nether region somewhere between horror movies and disaster films.

That said however, you have to admire the skills of the viral marketer. They have a way of winning by sheer weight of numbers alone. They piggy back on everyone else and use their resources to grow their own. In the right circumstances the viral marketer can grow exponentially. A virus doesn’t have to mate, it just replicates itself again and, again and, again increasing its power, doubling its effect with each replication.

I
I I
I I I I
I I I I I I
I I I I I I I I

In a few short generations, a viral marketing population can boom as seen in the diagram above.

Viral marketing defined.

What does a virus have to do with viral marketing? Viral marketing describes any strategy that encourages individuals to pass on a marketing message to others, creating the potential for mass growth in the messages exposure and influence.

Like viruses, such strategies take advantage of rapid multiplication to explode the message to hundreds, even thousands in a relatively short period of time.

Before the advent of the internet viral marketing was often referred to as ‘word of mouth’. However, for better or for worse, the term viral marketing has infected.

One classic example of this marketing technique is Hotmail.com one of the first free web based email services. Their strategy was simple.

Give away free email addresses and services.
Attach a simple tag at the bottom of every free message sent out.
Watch people email their friends, colleagues and family.
Watch these same friends colleagues and family join up to their service.
See the message propelled to an ever increasing audience, all for free.

In closing viral marketing is like watching the tiny ripples of a single pebble dropped pond, one small splash can create ever increasing circles which in turn could create ever increasing revenues.

Article Written By Lee

European Surfers – Porn High On The List!

Date: 2011.02.22 | Category: General | Response: 0

Adult web sites were visited by 3.8 million home Internet users in the UK in June 2001, according to Internet monitoring company Net Value. This accounts for more than a quarter of the entire UK home Internet population.

UK visitors to adult websites spent more than 45 minutes on these sites each in June. Adult sites make up 41.2 per cent of all the sites visited in the UK with a significant audience. Students (23.2 per cent), manual workers (15 per cent), and professionals (12.8 per cent) are the largest groups of UK visitors to adult sites.

However Germany has the largest audience for online porn in Europe with more than 5.3 million Germans visiting an adult site in June. They also spent more time on these type of sites than any other nationality – each German visitor spent almost an hour on adult sites in June. Net Value data also showed that more than half (52.3 per cent) the websites visited in June by a significant number of German users were of an adult orientated nature.

Spain has the greatest proportion of visitors to pornographic sites – 40 per cent of Spanish home Internet users visiting a pornography site in June 2001.

“Pornography has become a lucrative online business, with many companies now recognizing it as a valuable additional revenue stream,” Net Value’s Alki Manias said. “And this would seem to be a stable business area – the popularity of online pornography continues unchecked.”

Adult sites are also popular amongst the earliest adopters of the Internet. People who first got online at home before 1997 account for 18.5 per cent of visitors to adult sites, though they only make up 14.1 per cent of the whole UK online population.

In the UK, Lastminute.com has just introduced an auction for adult toys and aids, whilst in Germany, Freenet.de and T-Online are also moving into the adult business.

The following charts detail various demographics relating to European surfers usage of adult sites:

Number of adult websites visited, June 2001

* Sites with a significant reach

UK visitors to adult websites by occupation, June 2001

As you can now see, we, as adult webmasters, have a considerable chunk of the online adult industry sitting in our laps and, we should concentrate on tapping into this market as more and more American companies are realizing the importance of these figures we will inevitably reach a stage where the European market will be passed across to our US counterparts.

Think Fresh – Work Smarter

Date: 2011.02.24 | Category: General | Response: 0

We have all experienced it at some point in our webmaster career, more often than not though, we hear about it all the time. What is it? Wanting to give in when we hit that proverbial brick wall.

Hopefully this article can offer you some help and advice when it comes to getting your sales back on track or, even getting them started at all.

Ask For Help.

The one thing that amazes me about this industry is that despite the fact we are all business competitors we are all (mostly) willing to help other webmasters out for little or nothing in return. if you hit that brick wall then imply ask for some help.

As webmasters we have a barrage of free tools readily available to us for asking the advice of others whether it is in email from your sponsors support reps, icq or even on the many industry related chat boards, by actually spending sometime to help yourself by asking others you can often see things from a new perspective and, get advice as to why thing that should be working are not.

Start Over.

So you have been doing this webmaster job for the last few months submitting to the TGP’s, building free and AVS sites but you still haven’t made a dime, something is wrong somewhere but how do you pinpoint the error? By far the easiest way to find out what is wrong is to start afresh. Head over to one of the webmaster resource sites and see what others are doing ask for advice and feedback on your sites and learn from the experiences they tell you about. Just because you might have heard the same information before doesn’t mean you shouldn’t ask about it, often one webmaster will be able to tell you an alternate way of doing something that another webmaster is. One of the best ways to get a grasp on this learning curve is to read articles and tutorials, there are thousands of them on the net from HTML to Programming and everything in-between emulate the information contained in these articles and adjust that same information to suit your needs.

Don’t Stagnate.

If you are not having success at the AVS side of the business try something else, you already have a good base for building free sites and even TGP’s just because you have never tried using these sources of traffic and income doesn’t mean you wont be any good at them.

If traffic is your problem as mentioned above, ask others where they get their traffic from and how they built it up, learn to start small and grow instead of running head first into millions of hits a month that are being wasted.

Research The Industry.

If you are thinking of quitting, before you do spend a day or two just doing a little background research in the industry, its no secret that webmasters who join the online industry today have to work two or three times harder than our peers who joined several years ago, this is and always has been true in any business. By researching the industry you should be able to find out how others that joined before you failed and, more importantly, WHY they failed, learn from those experiences.

Finally.

No matter how hard and meaningless you find the work stick at it, just because you are not making any sales it doesn’t mean you wont make any sales tomorrow or even next week / month / year. Keep turning those sites out and, soon enough, when you least expect it you’ll make a sale and, you know what… the euphoric feeling you will get will be more than enough to make you realize that you HAVE been doing something right all along.

Article written by Lee

Adult Industry Standards – What Are They Exactly?

Date: 2011.02.21 | Category: General | Response: 0

For some, the term ‘industry standards’ might seem like an oxymoron and, in such a wide spread global industry this might just be the case, the adult industry is not regulated in any way shape or form however, this term is thrown around with the best of them.

In this article we will take a quick look at some of the ‘standards’ which have been set and, for the most part, seem to be accepted across the online adult industry as a whole.

Industry Standards – The Basics.

‘Industry Standards’ are, in effect a set of guidelines or rules by which any person operating a business in a specific sector operate by. These may range fro charging a standard price for a product, operating in a certain way or something else. Most industries have their own set of specific ‘standards’ which are usually upheld regardless of whether they are actually written in law, as regulations, rules or, unwritten, unspoken standards.

Adult Industry Standards – The List.

This is a list of the 4 most common ‘Adult Industry Standards’ that webmasters would seem to operate their businesses towards, these are not ‘official’ industry standards more general operational guideline which are accepted as the ‘norm’ in our industry.

1) Adult Webmasters should use ‘legal’ content.
2) Adult Webmasters should abide by the rules of the sponsors they use.
3) Adult Webmasters should not promote ‘child pornography’ or imply the promotion of the same.
4) Adult Webmasters should operate their business within the scope of the law.

Taking the above four items into account, there of course, other standards by which webmasters already self-regulate to some extent for example, you shouldn’t steal other webmasters work, content, bandwidth (through hotlinking), etc. However, other than the four primary ‘unwritten rules’ above there doesn’t appear to be any special ‘code of practice’ to which webmasters should or even, can adhere to.

Taking the above information one step further, lets take a quick look at the adult industry sponsors, almost all of them have a different variation of their Terms and Conditions however, implied or otherwise, most of them tend to stick within the confines of the details already mentioned above. This in itself can lead webmasters into some troubles for example, promotion of sites, most sponsors have unwritten rules about what webmasters can and cant do to promote sites, no spamming paysites, no misleading links but, again, there are no ‘set’ rules that any two sponsors seem to say in the exact same manner.

Adult Industry Standards – Self Regulation.

We all know by now (at least those of us whom have been doing this for a few months) that the adult industry is pretty much self regulated and, whilst this is almost certainly a good thing it can also lead to complications. For example, ‘Webmaster A’ does something to promote a site that they got permission to do whilst, ‘Webmaster B’ does the same thing without having permission. in this instance, more often than not ‘Webmaster B’ will the one who gets their name blackened in the industry. it would also seem that, whilst those webmasters who have a long standing in the industry are capable of getting away with certain things, others, who perhaps have seen things done, when they try the same they get ridiculed.

Adult Industry Standards – Overview.

As ‘Adult Webmasters’ and, i would like to stress the ‘Adult’ part of that job title we have a lot of information thrown at us from the very first day of joining this industry, how we choose to use that information is up to us on an individual basis. That said, until the ‘standards’ are set on a level playing field i cant help wondering what effect, negative or positive our own style of self regulation is having on our associates and peers, does it help that we can go to message forums and call sponsors, hosts, other webmasters cheats? or, does this hinder our industry on a much wider scale?

One thing is for certain, if i were a journalist writing a report on the adult industry as a whole, i don’t even think i could write about the actual ‘business’ side of things after all, we all run our businesses as we see fit and, at the same time, read the rule book that would at least, for the time being, suit us as individual business owners.

Article written by Lee.