Robots.txt – Control The Robots That Crawl Your Sites

Date: 2011.02.24 | Category: Search Engine Optimization, WebDesign | Response: 0

By writing a structured text file you can indicate to robots that certain parts of your server are off-limits to some or all robots. It is best explained with an example:

# robots.txt file for general use on web servers.

User-agent: webcrawler
Disallow:

User-agent: googlebot
Disallow: /

User-agent: *
Disallow: /cgi-bin
Disallow: /logs
The first line, starting with ‘#’, specifies a comment.

The first paragraph specifies that the robot called ‘webcrawler’ has nothing disallowed: it may go anywhere.

The second paragraph indicates that the robot called ‘googlebot’ has all relative URLs starting with ‘/’ disallowed. Because all relative URL’s on a server start with ‘/’, this means the entire site is closed off.

The third paragraph indicates that all other robots should not visit URLs starting with /cgi-bin or /log. Note the ‘*’ is a special token, meaning “any other User-agent”; you cannot use wildcard patterns or regular expressions in either User-agent or Disallow lines.

Two common errors:

Wildcards are not supported: instead of ‘Disallow: /tmp/*’ just say ‘Disallow: /tmp’.
You shouldn’t put more than one path on a Disallow line (this may change in a future version of the spec)
Ultimately, without the use of robots.txt files on your servers/domains, you are risking a variety of potential problems including, unauthorized access to your cgi directory, unauthorized viewing of your site stats, possible spamming of the search engines by accidental crawling of doorway pages.

One distinct advantage however of having a robots.txt file on your server is that, quite simply, you will be able to tell when and where your site has been indexed or potentially indexed as, all robots will automatically call for the robots.txt file BEFORE any other page on your server so, as long as you keep an eye open for any calls of this file, you can see who is knocking at your site for indexing purposes.

Below is a robots.txt example that you can copy and paste into a text document to use on your own server:

<!–Start Copy Below This Line–>

User-agent: *
Disallow: /cgi-bin
Disallow: /logs

<!–End Copy Above This Line–>

The above will allow all spiders to crawl all of your site except the subdirectory’s ‘cgi-bin’ and ‘logs’ which, may be altered to suit any subdirectory’s you do not wish the spiders to crawl on your server.

Article written by Lee

Converting Chinese Adult Traffic – The Niche Paysites That Work

Date: 2011.02.21 | Category: Traffic | Response: 0

Golden Rules For Finding A New Domain Name

Date: 2011.02.22 | Category: Domain Names | Response: 0

We all know by now that domain names are being registered at an unbelievable rate and, whilst the vast majority of ‘decent’ domain names have already been registered there are still some god domains to be registered and, this article will give you some insight into how you can choose an effective domain for your business purposes – regardless of what they are.

Avoid Play On Words.

Whilst sitting at a bar you come up with an idea for a domain www.4play.com and, at the time this might seem like a great domain name to buy however, before you head to your favorite register and purchase the domain stop to think about the long term implications.

Let me explain this a little more using the example www.4play.com lets think about this, every time you mention the domain in a conversation people are more likely to head across to www.foreplay.com or www.fourplay.com first as a type-in. This is also true of the other abbreviation styles of ‘internet slang’ remember the days of the ‘dot com’ registrations, you know domains such as www.dotsex.com looking back now, these seem ridiculous to have been registered however, at the time they were popular but they died their death years ago.

Think Investment.

A good ‘commercial’ domain must be able to distinguish itself from the competition, there are several ways to achieve this for example:

Consider Your Target Audience.

Aim your domain at a specific, yet broad market audience. use tools to narrow down what your customers (surfers) are looking for, narrow this list down to a select few domains and then, narrow the list down some more.

Follow Trends Or… Create Them.

If you are serious about picking a good domain name or two then be prepared to invest the time required to get a good domain name. Research the latest trends on the internet, see what products or services are ‘hot’ and will be around long term and also see which domains are just a flash in the pan.

A good example of ‘long term’ domains would be www.europeanwebmasters.com which i registered several years ago when, in all honesty, the foreign markets were not even thought about however, you cant go to any forum nowadays without someone asking about the international marketplace.

Act On A Whim.

In complete contrast to my opening statement in this article, if you think you have a solid business idea, act on it, the chances are someone else will also think of the same idea as you and, if you don’t get the domain name first, they will.

Alternative Buying.

So you have decided that you do want to buy www.4play.com before you make your purchase have a look at what other variants of this domain are available, for example, you might like to check registrations of www.4-play.com, www.for-play.com, www.forplay.com, etc etc.

If you have a great business idea, make sure you have all of your bases covered, just because you are starting a new craze, that doesn’t mean the domains will be available for registration tomorrow or next week.

By purchasing all the variants of the high quality domain you have thought of you are, in effect, eliminating all of the competition you could face long term.

Don’t Cyber-Squat.

If you are a serious domain buyer, avoid tailgating on other peoples domain names unless of course, it has enormous potential for example, if someone has registered a generic domain such as www.123456.com but failed to register www.123-456.com why not register the available domain? You are not impeding on anyone’s property rights and, you might benefit from some mis-typed traffic at the same time. As with any type of mis-typed domain, before you register it, seek legal advice, a few dollars spent before registering the domain could save you thousands afterwards.

Fools Rush In.

Don’t automatically buy the first domain name you think of, think on it some more, sleep on it if you have to, ask your family and friends on their opinions. Although the really good domain names have virtually almost all gone, its better to carefully think out each and every domain name purchase you make and save yourself some money long term than to rush in and buy a domain that wont be any use and have to register a new domain to take the place of the first.

In addition to the above don’t sit on a really good domain name idea forever because, forever comes a lot sooner than you may think.

Hopefully this article has given you some useful information in respect of registering new domain names and you can put this information to good practice when buying domains. Article written by Lee

Building A Surfer Trap – Stage 2

Date: 2011.02.21 | Category: Traffic | Response: 0

In the last tutorial we hopefully got the foundations of our surfer trap laid and in this stage, we will start to put this thing together.

Ok the first step of stage two of building your surfer trap is to start linking each of the individual FPA’s to your Multi-Site FPA.

The easiest way that I have found to do this is to give each FPA its own sub directory on your server and have the html page named index for each of the single site FPA’s.

So for instance, if you have the site All Petite on your Multi-Site FPA you would link it to:

mydomain.com/all-petite/

Or whatever you called the sub directory for the All Petite single FPA.

Now, once you have linked these single FPA’s to your Multi-Site FPA we need to start ‘playing’ with them once again.

You should now have copy’s of your single site FPA’s and Multi-Site FPA on both your server and Hard Drive.

Take the copy’s you have on your hard drive and add a small NICHE pop up console to each of the single site FPA’s AND the Multi-Site FPA.

I would suggest making 6 NICHE consoles.

These consoles should be pure text and nothing else.

Each of the links on this small console should link to a different niche of your single site FPA’s I usually go with one link for each of the following niches…

Gay
Mature
Teen
Fetish
Hardcore
Asian

Plus, I usually add a link at the bottom of my console which goes to the POTD program.

Once you have these consoles built you should upload them to their OWN sub directory on your server, I would suggest calling this directory ‘consoles’ and calling each of the niche consoles the name of the NICHE they represent.

So, you should now have the following on your HD and on your server:

1 Multi-Site FPA
50 or so Single Site FPA’s (All Linked From The Multi-Site FPA)
6 Small Pop-Up Consoles (Popping Only One On The Multi-Site FPA and The Single Site FPA’s, each different niche Single Site FPA pops a different niche console however.)

You now have to check that your surfer trap is working so far.

Article written by Lee.

Getting Webmaster Traffic To Your Design Site

Date: 2011.02.22 | Category: General, Promotion | Response: 0

Just starting in the design biz? Well you’re going to need some traffic to your design work. You need to get your name out to as many people as humanly possible. If you don’t have the contacts, then you don’t have the work. Network, communicate, and setup your portfolio. These are the 3 most important steps when starting your design company, preceding these three steps are advertising and demonstrating.

When I first started designing, I had no clue what I was doing except for designing websites. I knew I needed clients, but had no idea where to start. I met up with a ouple of other webmasters one night. I told them I had just started and was looking for some work. They took me in and taught me the trade. They showed me a few tricks in how to design things much quicker, and also subconsciously taught me to make sure as many people as possible see my work, and that they know who its from.

I worked with my friends for a few months when things started to get slow, so I took it upon myself to start my own company. I still got outsourced work from them, but now was taking on my own clients, but I had forgotten one important step. Advertising, the biggest step to forget. So I started posting on message boards to get my name in the dirt. I received a few clients, but nothing large. Then one day out of the blue a man came to me and wanted 4 pay sites designed. Wow, a real client at last. He said he saw my posts on a resource forum and decided to use me for his work.

I worked for this client for about 2 months, and more and more people were coming to me. I had been doing something good, but work started to slow and finally I realized I had been working for the same few clients and had not been getting anyone else in the door. Maybe board posting wasn’t enough? Exactly, its not, I asked around to see what I could do I had gotten a few suggestions like banner trades, recip’s, work for advertising. So I did them all. And soon enough I had more clients than I could shake a stick at.

Network.

Talk to people, people that are in the biz. Webmasters and designers. Talk to anyone you possibly can that could further spread your name of even bring work to you. If you do not network, then don’t plan on anything coming your way.

Communicate.

Get on boards, ICQ, AIM, MSN, whatever. Just make sure that people see you and know you are there. Send them emails with different offers, not spam, but personal emails. Take it upon yourself to try and get your name into the field.

Portfolio.

If you do not have one of these, then you might as well try to sell a spider to an arachnophobe. Design some fakes sites if you don’t have anything to show. Do some banners, tours, anything that shows the potential of your work. Make sure you present it as efficiently as possible. People do not want to root around not knowing what they are looking at.

Advertise.

Make banners, buttons, links, ads, and anything that you can stick your name on. Get listed on any and all Webmaster resource sites, and design sites. This will help you establish a name base and let people know you are around.

Demonstrate.

Write articles for resource sites, create different tutorials also, this will let people know you know what your doing. The more people that like your ideas, the more they will like you. Therefore the more likely you will get work.

Follow these steps as I did and you will be on your way to having clients beating down your door. Also, make sure you really have something to offer before trying to sell your work. Be unique in what you design and how you present it. Clients love it when their sites are different from others, obviously.

Article written by John

International Billing Alternatives – Online Check Payments

Date: 2011.02.23 | Category: Billing Solutions | Response: 0

In my previous article i discussed the value involved with Premium Rate Phone billing as an option for your adult surfers and, staying on the topic of payment processing this article will take a closer look at the Online Check payment method or, ACH as it is commonly referred to.

ACH (Online Check Payments) – What Is It?

An online check payment is a method of allowing your customers to pay for their goods using their check’s online, in order for your customer to pay via a check they need to have available certain items these are, a current checking account, a valid routing number (found on the check) and, an account number. Funds paid via online checks are automatically debited from the customers bank account.

Online Check Billing – How It Works.

Online check payments are processed in real-time, surfers are automatically accepted and authenticated via their current billing address, social security or, driving license number, once they have been authenticated their payment details are then sent to the ACH (Automated Clearing House) system where this information is automatically accepted as long as the details provided are verified as correct.

Online Check Payments – What Are The Costs?

Utilizing the online check method of billing your customers is actually just as, if not more, cost effective as using online credit or debit cards, in effect, you are guaranteed the funds of the check once they clear as, in all reality, the surfer will not have such an easy time declaring the purchase as a ‘charge back’ because the information needed to pay via an online check is information that in reality, only they have access too.

So, as with our previous articles, lets say your paysite membership fee for one month is US$35, a surfer signs up to your site using an online check, you make, approximately, US$33 from this membership for each and every month the customer (or surfer) chooses to renew their membership.

The one main advantage with online checks however is that, surfers will often feel more ‘secure’ in using them to pay for 3 or 6 month memberships and, as long as their check clears your account, you are almost certainly guaranteed the funds.

Online Check Billing – The Main Benefits.

As mentioned above already, the primary benefit of the ACH payment method is that the customer will almost certainly have funds available in their online checking account to be able to meet the cost of the paysite membership, after all, they wouldn’t give out their banking details if they were not sure the payment would go through. In addition to this advantage there are also several other advantages to using Online Checks as a payment method for example:

Increased Sales.
Reduced Order + Billing Costs.
Faster Payment.
Reduced Credit Card Charge Backs.

ACH Check Payments – Overview.

Whilst ACH check payments are a good alternative for US surfers the one major drawback is that, in today’s global market place they are not a method of payment for international surfers unfortunately, at this time, there are no companies who can offer this service to my knowledge to the ever growing global population.

That said, there is a place in the industry for check processing for adult payments and, with Visa breathing down our collective necks more and more, now would be an ideal time to take an in-depth look at this processing method.

I hope this article has provided you with some useful information regarding the online check payment method.

Article written by Lee

Outsourcing – Becoming More Profitable Online

Date: 2011.02.24 | Category: Employment | Response: 0

As webmasters we already do a lot of outsourcing from hosting our sites to design and marketing to getting traffic which we send to our sponsors. However, many of us are missing out on opportunities to outsource even more of our work and, by missing these opportunities, we are losing money.

Outsourcing work can consist of anything from translations, design, scripting, marketing, seo, site submissions and pretty much anything and everything in between.

However, before we outsource some work to others there are several factors that need to be taken into consideration these are what will be addressed in this article.

Cost.

Ensuring we work ‘cost-effectively’ is one thing we all want to do, we need to make a profit whilst still being able to develop our business further. One good way to find out if the costs of outsourcing outweighs the cost of keeping the work in house to make a simple list of both the time and financial involvements both in and out of house. For example, in house you may have employees that need paying to do the work, you will almost certainly need to spend a lot of your own time on the project and, more likely than not you will need to research the work you want to undertake, all of this can become costly when looked at in detail a good reason to outsource your work to another company or individual.

Benefits.

How will outsourcing benefit you and your business? As with the cost example above make a list of things that will benefit you from the time saved on the project to the monetary benefits of outsourcing the work and the completion times often, by outsourcing your work you can have it done in much less time than if you handled it yourself ‘in-house’ so to speak.

Flexibility.

What are the indirect benefits of you outsourcing your work? Not necessarily the money saved but more along the lines of time management. if you give a designer a list of ideas and suggestions you WANT your work to have, chances are, they will get it right the first time whereas, if you amble along experimenting with what you actually create you may, in effect, take much longer to complete the task in hand. By saving yourself time what else can you get done, whether it is building more sites or marketing your existing sites further the indirect benefits all weigh up more often than not, these benefits will be favorable to outsourcing the work.

Risk.

This is probably THE most important thing to take into account when considering outsourcing your work, what happens if, you pay for the outsourcing and, overnight the company who is doing the work for you goes out of business? What happens if someone you have in your employ decides that they would rather be doing the work rather than you outsourcing it? Financially can you afford to outsource the work? All of these factors need to be considered before undertaking any form of outsourcing.

Basically, what I am trying to tell you is that, if you spend a few moments actually running the numbers as oppose to the ideas you have in respect of your workload you will see that outsourcing can be come a valuable asset to your business and, more importantly, your bottom line profits.

Article written by Lee

Building A Surfer Trap – Stage 7

Date: 2011.02.21 | Category: Traffic | Response: 0

Here we go with Stage 7 in this Surfer Trap tutorial.

We should by now have a rather complex looking surfer trap, pop up consoles and blur consoles on all of the pages within it, all of these same pages interlinking each other indefinitely.

So, we are starting to get some traffic to this beauty from our existing sites and the counters we implemented but, how can we get some more traffic for FREE?

What I suggest we do next to this little baby is to add a banner exchange code to EACH of the FPA’s we have and also, onto the larger table console we created.

You should sign up for one banner exchange code for this trap, you might like to search around for a banner exchange that lets you have a decent ratio of impressions.

Once you have signed up for your banner exchange code, you now need to copy this coding into the BOTTOM of all of your FPA HTML pages including the Multi-Site FPA.

Now you have the banner exchange code on your site you are earning credits. Your account may not be activated for a day or so but, what this means is you are earning credits the entire time you are showing banners on your Surfer Trap.

Now we have the banner exchange code on our sites we only have one further step to take in order for this project to be completed.

Making sure it works how it is supposed too along with fine tuning this little beast.

If you have any further questions or comments please post on the forums here and one of us will be able to help you.

Article written by Lee.

Cascading Style Sheet Basics

Date: 2011.02.21 | Category: WebDesign | Response: 0

CSS (Cascading Style Sheets) have been around for a while now, and act as a complement to plain old HTML files.

Style sheets allow a developer to separate HTML code from formatting rules and styles. It seems like many HTML beginners’ under-estimate the power and flexibility of the style sheet. In this article, I’m going to describe what cascading style sheets are, their benefits, and two ways to implement them.

Cascading What’s?

They’re what chalk is to cheese, what ice-cream is to Jell-O they complement HTML and allow us to define the style (look and feel) for our entire site in just one file!

They get their name from the fact that each different style declaration can be “cascaded” under the one above it, forming a parent-child relationship between the styles.

They were quickly standardized, and both Internet Explorer and Netscape built their latest browser releases to match the CSS standard (or, to match it as closely as they could).

So, you’re still wondering what a style sheet is? A style sheet is a free-flowing document that can either be referenced by, or included into a HTML document (Kind of like using SSI to call a file but not, if that makes sense). Style sheets use blocks of formatted code to define styles for existing HTML elements, or new styles, called ‘classes’.

Style sheets can be used to change the height of some text, to change the background color of a page, to set the default border color of a table the list goes on and on. Put simply though, style sheets are used to set the formatting, color scheme and style of an HTML page.

Style sheets should really be used instead of the standard , < b >, < i > and < u > tags because:

One style sheet can be referenced from many pages, meaning that each file is kept to a minimum size and only requires only extra line to load the external style sheet file

If you ever need to change any part of your sites look/feel, it can be done quickly and only needs to be done in one place: the style sheet and furthermore, it is done globally.

With cascading style sheets, there are many page attributes that simply cannot be set without them: individual tags can have different background colors, borders, indents, shadows, etc.

Style sheets can either be inline (included as part of a HTML document), or, referenced externally (Contained in a separate file and referenced from the HTML document). Inline style sheets are contained wholly within a HTML document and will only change the look and layout of that HTML file.

Open your favorite text editor and enter the following code. Save the file as styles.html and open it in your browser:

Cascading Style Sheet Example.

h1
{
color: #636594;
font-family: Verdana;
size: 18pt;
}

This is one big H1 tag!

When you fire up your browser, you should see the text “This is one big H1 tag!” in a large, blue Verdana font face.

Let’s step through the style code step by step. Firstly, we have a pretty standard HTML header. The page starts with the tag followed by the tag. Next, we use a standard tag to set the title of the page we are working with.

Notice, though, that before the tag is closed, we have our tag, its contents, and then the closing tag.

h1
{
color: #636594;
font-family: Verdana;
size: 18pt;
}

When you add the style sheet code inline (as part of the HTML document), it must be bound by and tags respectively. Our example is working with the tag. We are changing three attributes of the ’s style: the text color (color), the font that any tags on the page will be displayed in (font-family), and lastly, the size of the font (size).

The code between the { and } are known as the attributes. Our sample code has three. Try changing the hexadecimal value of the color attribute to #A00808 and then save and refresh the page. You should see the same text, just colored red instead of blue.

An Example Of An External Style Sheet.

External style sheets are similar to internal style sheets, however, they are stripped of the and tags, and need to be referenced from another HTML file to be used.

Create a new file called “whatever.css” and enter the following code into it:

h1
{
color: #a00808;
font-family: Verdana;
size: 18pt
}

Next, create a HTML file and name it test.html. Enter the following code into test.html:

External Style Sheet Reference Example.

This is one big H1 tag!

As mentioned above, you can see that the actual code in whatever.css is exactly the same as it was in the inline example. In our HTML file, we simply place a tag in the section of our page. The rel=”stylesheet” attribute tells the browser that the link to the external file is a style sheet. The type=”text/css” attribute tells the browser that whatever.css is a text file containing CSS (cascading style sheet) declarations. Lastly, the href=”whatever.css” attribute tells the browser that the actual file we want to load is whatever.css.

Conclusion.

Well, there you have it, a quick look at style sheets and how to implement both an inline and external version. Checkout the links below if you’ve never worked with cascading style sheets before. You will be surprised at some of the things you can do with them!

Article written by Lee.

TGP Posting – Automating Submissions Responsibly

Date: 2011.02.21 | Category: TGP | Response: 0

TGP Posting – Automating Submissions Responsibly.

Many an experienced webmaster has endured first hand the labor intensive process of manually building a submitting large quantities of image galleries to TGP’s in an effort to drive traffic, whether it be to their own site or a sponsors, in a bid to generate money. One quickly learns that creating a gallery template is the way to go, whereby one can more quickly and easily swap out the reciprocal links for the TGP’s, which means building customized galleries is more efficient, before going off to submit them to all the relevant TGP’s…

But this is only the beginning of the story. Manually visiting and posting to all of the TGP’s (there are literally thousands of them) takes a lot of time. Moreover, one must stop and read the rules for each TGP to ensure one is staying within the specified guidelines…

There is an easier way! Enter the Thumbnail Gallery Submission Wizard (TGSW). It takes much of the labor intensive work out of producing galleries for, and submitting them to, TGP’s. Available in both desktop (PC) and server (Perl based) versions, TGSW has gained rapid and widespread acceptance as the de-facto TGP gallery automation tool. Some of it’s features include:

Fully Customizable Gallery Templates.

You can create templates on a niche by niche basis, inserting appropriate sponsor codes and images. For the thumbnails and images they link to, you simply insert some intuitive ‘placeholder tags’, which are interpreted by TGSW at run-time and replaced with the appropriate images. You can be flexible as to how many thumbs/images you would like displayed per gallery to meet your own personal preferences.

Automated Reciprocal Link Insertion.

You can also insert placeholder tags for the automatic insertion of reciprocal links. At run-time, TGSW will insert a specified number of reciprocal links in the positions you have inserted those tags in your templates.

Customizable Filenames.

You can specify filename options so that when TGSW generates galleries, the filenames it uses are unique to your galleries.

FTP and ‘Free Host’ Support.

Do you host your galleries on a free host? Or simply on another of your servers? TGSW can be configured to FTP the completed galleries (along with images and thumbs if necessary) to a server of your choice. There is also a lot of support for ‘free hosts’ that don’t have FTP, but instead used a browser-based upload manager.

Automatic Gallery Submission.

TGSW will then automatically submit all of the galleries it generates to all of the appropriate TGP’s. It even sends an email to the TGP’s that require submissions via that method! TGSW can even be configured to place all of your submissions via a proxy server, so you can mask the IP address from where you submit.

Extensive Reporting.

There is an optional reporting feature that you can turn on or off. When turned on, TGSW logs all of the submission information at the point of submission, which you can review at your leisure at a later time.

Regular Updates.

TGP’s come and go, so TGSW offers an auto-update feature, whereby it will download the latest copy of the database from our site. We usually update at least once per week, sometimes more often, to keep your database current.

Of course, due to the personalized nature of your galleries, there will be some significant configuration work to do before one can hope to achieve any real results with TGSW. One of the key points is that we do not ship the product with any TGP’s enabled – this way, you are responsible for your own usage of TGSW, and are forced to at least visit the TGP’s in question – we do this in an attempt to remain responsible.

If you have neither the time nor the inclination to configure the TGSW TGP database yourself, then I highly recommend http://www.tgswupdates.com. They have spent extensive time configuring the current TGSW database for 55 niche categories, and offer fully-configured updates very soon after we release a new auto-update – not only will you be up-to-date, but you will also have all of the available TGP’s enabled, along with all of the reciprocal link images ready to start posting!

Article written by Robert Purdy.