• Mirroring Adult Sites – Stage Three

    Date: 2011.02.23 | Category: Promotion, Tutorials | Response: 0

    So we hit stage three of our tutorial in this stage we are going to make some pages for our top 5 AVS systems. However, as we did in the last tutorial with the new TGP galleries we created we are going to use the same content and same pages that we have already built. On with the tutorial…

    Anyone who build AVS sites will know that you need to have a standard site layout. This usually consists of an entry page (or a warning page), a navigational page (or in our case our menu.html page) and some gallery pages.

    So the first thing we need to do is open up the warning page. Once this page has been opened we now need to do some editing of the page, what I would suggest is moving the warning text to the lower half of the page and at the top making some ‘juicy’ sales text, depending on the niche you are targeting with this site you may also like to add a couple of the original thumbnail images at the VERY top of your page however, these should NOT be linked to the full size image.

    Once you have edited your page to a reasonable standard for the AVS you now need to save this page in the /FreeSite/AVS/ folder that you originally created on your HD. I would suggest saving the page as something like avs1.html or the name of the AVS you will be using this page for.

    Once you have done this you now need to duplicate this page but save it as a different name in again, in the /FreeSite/AVS/ folder so you will end up with avs1.html, avs2.html, etc.

    At the moment these AVS pages have no AVS script on them so, we need to visit the AVS system we are going to be using and fill out the details to have the AVS generate an AVS signup page script for us. Once we have the coding that the AVS provides we now have to place this on our avs1.html page. You should repeat this for each of the AVS’s you wish to use and save each instance of the generated AVS script to a separate AVS*.html page.

    be aware, that when you are putting your information into the AVS to generate the script, you should enter the ‘members area url’ as the page we created for our navigation so, the AVS script location will be /FreeSite/AVS/avs1.html and, the members area page will be, /FreeSite/Menu/menu.html.

    Once you have placed the script on our avs.html pages you should now have the following sites ready:

    1) 50 Pic Free Site With Pics On HTML Pages.
    2) 5 TGP Galleries With Pics On HTML Pages.
    3) 5 AVS Entry Pages.

    Now we are starting to see how using one set of content can amount to a mass of sites all of which can be sending traffic to our sponsors and, to our surfer trap.

    This is where stage three of our tutorial ends however, in our next tutorial we will continue to make some more sites and in an effort to get some traffic we start to play with the ones we have currently created.

    Article written by Lee

  • Displaying Special Characters On Your HTML Pag

    Date: 2011.02.22 | Category: WebDesign | Response: 0

    In order to display certain characters within your HTML pages, you must use a special code. The codes below display the HTML code and the character when displayed on your web page. To use any of the characters displayed within the chart, copy & paste the HTML code to the left of the character you would like to use.

    HTML Code Browser View HTML Code Browser View HTML Code Browser View HTML Code Browser View
    © © ! ! _ _  
    ® ® " ` ` ž ž
      # ` a a Ÿ Ÿ
    " $ $ b b  
    & & % % c c ¡ ¡
    &lt; < &#38; & &#100; d &#162; ¢
    &gt; > &#39; &#101; e &#163; £
    &Agrave; À &#40; ( &#102; f &#164; ¤
    &Aacute; Á &#41; ) &#103; g &#165; ¥
    &Acirc; Â &#42; * &#104; h &#166; ¦
    &Atilde; Ã &#43; + &#105; i &#167; §
    &Auml; Ä &#44; , &#106; j &#168; ¨
    &Aring; Å &#45; &#107; k &#169; ©
    &AElig; Æ &#46; . &#108; l &#170; ª
    &Ccedil; Ç &#47; / &#109; m &#171; «
    &Egrave; È &#48; 0 &#110; n &#172; ¬
    &Eacute; É &#49; 1 &#111; o &#173; ­
    &Ecirc; Ê &#50; 2 &#112; p &#174; ®
    &Euml; Ë &#51; 3 &#113; q &#175; ¯
    &Igrave; Ì &#52; 4 &#114; r &#176; °
    &Iacute; Í &#53; 5 &#115; s &#177; ±
    &Icirc; Î &#54; 6 &#116; t &#178; ²
    &Iuml; Ï &#55; 7 &#117; u &#179; ³
    &ETH; Ð &#56; 8 &#118; v &#180; ´
    &Ntilde; Ñ &#57; 9 &#119; w &#181; µ
    &Otilde; Õ &#58; : &#120; x &#182;
    &Ouml; Ö &#59; ; &#121; y &#183; ·
    &Oslash; Ø &#60; < &#122; z &#184; ¸
    &Ugrave; Ù &#61; = &#123; { &#185; ¹
    &Uacute; Ú &#62; > &#124; | &#186; º
    &Ucirc; Û &#63; ? &#125; } &#187; »
    &Uuml; Ü &#64; @ &#126; ~ &#188; ¼
    &Yacute; Ý &#65; A &#127; ? &#189; ½
    &THORN; Þ &#66; B &#128; &#190; ¾
    &szlig; ß &#67; C &#129;  &#191; ¿
    &agrave; à &#68; D &#130; &#192; À
    &aacute; á &#69; E &#131; ƒ &#193; Á
    &aring; å &#70; F &#132; &#194; Â
    &aelig; æ &#71; G &#133; &#195; Ã
    &ccedil; ç &#72; H &#134; &#196; Ä
    &egrave; è &#73; I &#135; &#197; Å
    &eacute; é &#74; J &#136; ˆ &#198; Æ
    &ecirc; ê &#75; K &#137; &#199; Ç
    &euml; ë &#76; L &#138; Š &#200; È
    &igrave; ì &#77; M &#139; &#201; É
    &iacute; í &#78; N &#140; Œ &#202; ?
    &icirc; î &#79; O &#141;  &#203; Ë
    &iuml; ï &#80; P &#142; Ž &#204; Ì
    &eth; ð &#81; Q &#143;  &#205; Í
    &ntilde; ñ &#82; R &#144;  &#206; Î
    &ograve; ò &#83; S &#145; &#207; Ï
    &oacute; ó &#84; T &#146; &#208; Ð
    &ocirc; ô &#85; U &#147; &#209; Ñ
    &otilde; õ &#86; V &#148; &#210; Ò
    &ouml; ö &#87; W &#149; &#211; Ó
    &oslash; ø &#88; X &#150; &#212; Ô
    &ugrave; ù &#89; Y &#151; &#213; Õ
    &uacute; ú &#90; Z &#152; ˜ &#214; Ö
    &ucirc; û &#91; [ &#153; &#215; ×
    &yacute; ý &#92; \ &#154; š &#216; Ø
    &thorn; þ &#93; ] &#155; &#217; Ù
    &yuml; ÿ &#94; ^ &#156; œ &#218; Ú

    Whilst the above list is by no means complete, it should contain the most useful characters and codes for you to build your sites using the special characters with ease.

    Article written by Lee

  • Domain Name Registration Services What To Look For

    Date: 2011.02.22 | Category: Domain Names | Response: 0

    Once upon a time, if you wanted to register a domain name, you could only do it by visiting Network Solutions at http://www.networksolutions.com/ and paying them whatever they asked for, about $35.00 per year.

    Then ICANN, http://www.icann.org/, The Internet Corporation for Assigned Names and Numbers (ICANN) that is the non-profit corporation that was formed to assume responsibility for the IP address space allocation, protocol parameter assignment, domain name system management, and root server system management functions previously performed under U.S. Government contract by IANA and other entities, decided to change the rules.

    The initial testing phase of the new competitive Shared Registry System for the .com, .net, and .org domains quietly began to take place in April of 1999.

    It started with five participants who were the first to implement the new system for competition in the market for .com, .net, and .org domain name registration services.

    Previously, registration services in the .com, .net, and .org domains were provided by Network Solutions, Inc. under an exclusive contract with the United States government.

    In the two years since this program began, things have really changed.

    Just this last week, ICANN reported that two of their registrars, Tucows and New York-based Register.com, had recorded more new registrations for Top Level Domains (dot-com, dot-net and dot-org) than VeriSign’s Network Solutions.

    This marks the first time ever that VeriSign’s Network Solutions was out-sold by any of the registrars and signals that their past dominance of domain name registration is certainly fading.

    Why?

    Because besides others being allowed to make domain name registrations, these new registrars are also cutting prices.

    The Rules have most certainly changed.

    The Shared Registration System (“SRS”), ICANN’s accredited registrars program, allows people to submit application to become a registrar along with a non-refundable $1000 filing fee.

    After someone is accepted into the program then they must pay a yearly fee of $5000 to maintain their status as an accredited registrar.

    This situation has created a very competitive environment which can only be beneficial to all of us as the price to register a domain name has fallen like a rock from a very tall building.

    However, if you plan to register a new domain name using a virtual unknown registrar, make certain they do indeed have the legal accreditation from ICANN by visiting the ICANN web site and viewing their posted list of ALL accredited vendors:
    http://www.icann.org/registrars/accredited-list.html

    It will only take you a few moments to make sure you are dealing with a reputable vendor of domain names. Those few moments will make the entire process legal and worry-free.

    Article written by Lee

  • Protecting The Kids – Europe’s Role

    Date: 2011.02.24 | Category: 2257 | Response: 0

    As adult webmasters we have certain obligations we must fulfill daily whether these be, legal or moral.

    One issue that is constantly cropping up in our industry is that of minors (Children) accessing adult websites and, more importantly, the ease of which they can do.

    Recent figures released by one of Europe’s top internet analysis companies show that children in Europe and, specifically within the United Kingdom are more likely to visit a website and that, ‘showing that around one in five Internet kids (290,000) check out the sex sites’.

    These figures are certainly alarming to say the least, bearing in mind they are specifically talking about the United Kingdom, that leaves a vast majority of Europe, as yet, un-analyzed.

    We should all adapt to new methods in order to protect minors from accessing our site whether that includes placing your sites behind AVS systems which, in my opinion is one of the best ways and, most profitable of protecting minors or, utilizing ‘web safe’ software packages that are available to block access to adult sites completely we all need to adopt these practices.

    The fact of the matter remains that, in this day and age, no matter what precautions we take in order to prevent access there will, undoubtedly, be a majority of children who can and will, get access to adult sites.

    Does that mean we should compromise on the quality of our sites? No
    Does that mean we need to think harder about how we develop our sites? Yes

    It takes very little effort to subscribe to the services to block access and, you can get a single line of code to place within your html from ICRA which will at least, deter underage surfers from accessing your sites.

    In addition to the above mentioned service, you can also place a link on your warning page/s to the following services for parents to block access from children to our sites, SAFESURF, CYBERPATROL, NETNANNY and, SURFWATCH amongst others. Its not just about utilizing software and ratings on our sites though, we can go much further than that and, for instance, using nothing but softcore content on our sites will protect to some extent the materials available to children but, in addition you will also notice your conversion ratios will go up! I have and, I’m sure you have, heard it time and time again.. Make them ‘Pay for pink’ and, by using softcore images on your sites that’s exactly what you are doing.

    I for one certainly hope that you take heed at this article, protecting our children is paramount if, we are to succeed in the business, it is getting harder and harder to control who accesses our site but, we can at least take a step in the right direction.

    Article written by Lee

  • Time Management – Organizing Your Content Purchases

    Date: 2011.02.24 | Category: Content | Response: 0

    From time to time it is inevitable that as adult webmasters there will be two things that will happen:

    1) You will buy some licensed content.

    2) You will use this content for a gallery.

    However, unless your content is organized you can end up spending to much time to make a 10 pic gallery page. This article is going to offer you some sound advice on how to organize your content from the second you take delivery of it which, will save you a lot of time long term.

    So we have taken delivery of our adult content either by download or, on cdrom what next, we could just file it away on cdrom but, by taking a little extra time to organize your content from the start you will end up not only building sites MUCH quicker but also saving time all round.

    Here are some helpful hints to get you on the way to content organization.

    1) Unzip all your content sets and, if applicable, separate them into model and niche sets.

    2) Create folders for each model and, each set of 10 images within the main model sets.

    3) Rename all your images in the 10 pic sets starting from pic1.jpg through to pic10.jpg.

    4) Crop, compress and thumbnail each image within each set of 10 that you have.

    5) create a html page that calls your thumbnails and main pics using relative urls i.e. /set1/gallery1/image1.jpg for the larger image and /set1/gallery1/thumb1.jpg for the thumbnail image.

    6) Inside each of your 10 pic/thumbnail folders place this HTML page you have just created.

    7) Burn each of the gallery folders to cdrom.

    Lets now look at what an hour spent has enabled us to do.

    Instant Galleries.

    Say we want to build a 10 pic gallery to add into a free site or an AVS site that we are building, we know we have all the galleries already made, its just a case of finding the correct gallery and uploading it to our server.

    Image Swapping.

    What happens if we need to swap an image from one of our pages to a more appropriate one for the niche we are marketing to, simple, you go to the image set you want, look for the image name and simply change the image without having to upload it as, you will now know the EXACT location on your server of the image you are changing to e.g., /set6/gallery8/image9.jpg would change to set24/gallery2/image2.jpg.

    There are of course other ways this can benefit you for example, you can plug in your galleries to any site you own if you have them all uploaded to a central content location domain.

    The benefits of organizing your content from the instant you take delivery are endless, the above is just a sample of how I have successfully saved time and effort by becoming more organized, the only limitations you have with your organizational skills are those that you impose on yourself.

    Article written by Lee

  • Thinking Of Starting An Adult Website In The UK?

    Date: 2011.02.24 | Category: General | Response: 0

    We all know that there are many foreign / international adult webmasters and there are some very well known ones based in England however, before you start building your online empire what are the legalities regarding the type of content you can and cant use on your adult pornographic sites?

    To be honest with you, there are no ‘defined’ laws in England (At the time of writing this article) regarding the use of online media to promote adult activities however, it is a commonly held belief that as long as you stay to the same standard as what most ‘top shelf magazines’ or ‘R18 Videos’ have in them you shouldn’t go far wrong.

    So what are these standards? That’s the information that I am about to give you.

    Content that IS NOT acceptable.

    1) Any material which is in breach of the criminal law.

    2) Material (including dialogue) likely to encourage an interest in abusive sexual activity (e.g., pedophilia, incest) which may include depictions involving adults role-playing as non-adults.

    3) The portrayal of any sexual activity, whether real or simulated, which involves lack of consent.

    4) The infliction of pain or physical harm, real or (in a sexual context) simulated. Some allowance may be made for mild consensual activity.

    5) Any sexual threats or humiliation which do not form part of a clearly consenting role-playing game.

    6) The use of any form of physical restraint which prevents participants from withdrawing consent, for example, ball gags.

    7) Penetration by any object likely to cause actual harm or associated with violence.

    8) Activity which is degrading or dehumanizing (examples include the portrayal of bestiality, necrophilia, defecation, urolagnia).

    As you can see from the above, there ARE very specific guidelines regarding water sports, animality and, some of the more ‘out there’ fetishes.

    Now you know what you cant use on your adult sites, lets take a look at the list of sexual activities that you can use. Its no surprise that the list of what you can use is considerably shorter.

    Content that MAY BE acceptable.

    1) Aroused genitalia.

    2) Masturbation.

    3) Oral-genital contact including kissing, licking and sucking.

    4) Penetration by finger, penis, tongue, vibrator or dildo.

    5) Non-harmful fetish material.

    6) Group sexual activity.

    7) Ejaculation and semen.

    It also worth noting that the above guidelines are not distinguished between heterosexual or homosexual activities.

    So, that’s the low down on what the current status of affairs are with regards to the use of adult content on websites in England and Wales. Actually, that’s not to bad just ensure that you stay within these guidelines and, more importantly, that you do consult a solicitor before commencing any form of adult business after all, that’s what they are there for, to give you SOUND legal advice instead of basic ‘guidelines’.

    Article written by Lee

  • Gay Adult Marketing 101

    Date: 2011.02.22 | Category: Promotion | Response: 0

    There is a myth out there that gay traffic is hard to convert because a gay surfer is reluctant to buy. This isn’t so. Conversions come down to two things:

    • The gay surfer is discriminating; a membership to a site that has exactly what we want
    • The gay surfer is loyal; I, believe, this comes from our experience as a community. When a Gay surfer decides to purchase a membership, it’s typically for a longer period of time.

    This is evident with the better Gay Pay Sites; conversions may be lower than a straight hardcore site however, membership tend to be longer than the industry average. The gay surfer is discriminating; we look for a long-term membership with a site that has we want whether it’s teens, bears, amateurs, etc.

    With that idea, I always advocate that age-old niche free site philosophy use a variety of sponsor programs on your sites. Typically, my free sites will have one main sponsor (I use Quality Males) then I’ll break my other banner slots down one Teen site, a Twink site and maybe a product like Viagra. But this will vary depending on the “flavor” or “personality” of your site – if you have a gay leather site, my main sponsor will be a Leather sponsor or product, with a variety of other sponsors (one mega site, a teen site, and maybe an adult toy store).

    One marketing option, I tend to see working well is the full-page ad vs. only banners. I, honestly, do not know whether it’s a quality issue, a larger ad or the surfer’s disgust with banner ads, but it works well in our market.

    One thing that experience has proven to me, it makes no difference whether you’re a webmaster to gay or straight traffic, you need to analyze your traffic. If you’re sending traffic out to sponsors and your not seeing the conversions, maybe you need to really look who your surfers are. If you’re lucky enough to know who your surfers are, then look for a specialty sponsor (whether partnership or click-thru program). It’s all a matter of finding the right sponsor programs and tweaking your site (and we all know how that can be). Don’t be afraid to experiment. It’s the long term that we need to be looking at. Remember that this isn’t “Who wants to be a Millionaire is 30 days or less”.

    Gay traffic isn’t difficult to manage as many people think. It’s a matter of patience and understanding your market. And the best way to understand that market, is to ask a successful webmaster in the gay adult market..

    Article written by Gary-Alan

  • What’s In A Niche?

    Date: 2011.02.24 | Category: General | Response: 0

    Many webmasters realize what the different ‘fetishes’ the surfers have are but, how many of us realize these are actually niches and, how many of realize that these niches can be broken down into smaller sub niches of the particular fetish the surfer is looking for?

    Lets take an example of say, the ‘lesbian’ niche.

    Of course we all know what the lesbian niche entails, two women getting naked with each other right? Wrong.

    There is much more to it than that, for example, obviously lesbian sites appeal to, well, they appeal to guys who want to fantasize about getting it on with two women but, what about the female surfers? Sure, some women probably join lesbian paysites too.

    That’s one ‘sub-niche’ of lesbian right there, this can be broken down even further though for examples, Ebony Lesbians, Teenage Lesbians, Mature Lesbians, the list goes on and on and on.

    So how do we choose a niche to market in adult?

    The first and foremost thing you should try when choosing ‘your’ niche is to try something that either excites you or, appeals to you in a non sexual manner, if you are into Lesbian Midgets getting it on, then start off with that for your niche.

    Likewise, if guys getting down and dirty is the thing that floats your boat, choose that as your niche, you should already know enough about the niche you choose primarily to be able to sell something to the surfer. If it excites you, it will more than likely excite a surfer and result in a sale.

    Of course, the above statement isn’t always true, I know plenty of straight webmasters who market the gay niche VERY successfully, they have found a method that works for them and developed their business from there it probably wasn’t easy at the start but, nothing easy will make you the ‘real’ money that there is in adult.

    You need to experiment, constantly adapt and change the way you do business, if you try something and it doesn’t work, ask yourself why, what could you have changed that might have made a difference and, instead of changing it on the first site you built, change it on your next one, that way, even though it may not work at this moment in time, you will no doubt find it will work at a later date just as you will find that something that works well for you now may not work at all later on in your business career.

    Once you have mastered a general niche you should then think about trying some of the sub niches that are available to you, there is more to teen than than just cute teenage girls lying naked on a bed and getting screwed rotten by some guy. just as you saw there was more to the lesbian niche above.

    Take your sponsors tour for ideas, often you will notice things that spark some though and, once you have that spark, you should ensure it develops into a flame.

    Even something as simple as a tattoo on a model or a piercing can be the tart of a whole new niche, look at the things that other webmasters may not be, just because there isn’t a proliferation of teenage pierced lesbian sites, doesn’t mean that someone doesn’t want to join one and, who knows, that weird sexual fetish you build a site for now may become popular in 6 months time.

    Basically, what I am trying to say is that as adult webmasters we need to investigate all aspects of the niche we want to or, currently do market, just because a surfer comes to the front page of a lesbian site, doesn’t mean that they wont also be interested in an ebony site, its all down to how we market our sponsors paysites as webmasters.

    Article written by Lee

  • Newsletter Know How – A Guide To Writing Newsletters

    Date: 2011.02.23 | Category: Promotion, Writing | Response: 0

    Email newsletters are a great way to make contact with existing clients and, prospective clients which makes them a great marketing tool. The biggest bonus however, over Email newsletters rather than print ones is that you have virtually no cost involved with writing and, ultimately, mailing them out.

    There is a wide variety of online newsletter on the internet. however, probably the simplest form for most webmasters is the email newsletter. Email provides you with a quick way to keep your name out there, build trust with you readers and, hopefully attract a few sales. If you archive your newsletter also this is a great way to get additional pages into the search engines and, as such, it then becomes a good traffic driver to your website regardless of the amount of subscribers you have. However one of the most important benefits of having an email newsletter sent on a regular basis is that it build brand recognition of your website or business.

    Your newsletter should provide information, not just of an advertising nature but that, should also be informative to your subscribers. In doing this you are offering information of value and, ultimately, ensuring that your subscribers remain. However, remember newsletters are for promoting your area of expertise not just a vehicle for revenue generation.

    One of the first things you should consider when deciding to do a newsletter is the amount of commitment you will have to put towards the project. Whether you start a monthly, weekly or, daily newsletter a great deal of commitment must be made to both the newsletter and, more importantly, your subscribers. For example, We generally spend a good 3 days researching the articles that have been submitted and trying to ensure that the details contained within them are relevant at the time of sending the email, this is not an easy task especially when the adult internet is constantly developing. If you don’t have the time to research and maintain consistency in your newsletter, then don’t even consider doing one, it isn’t for you at the present time.

    Now you have decided you can make the commitment required to run a successful email newsletter what do you do next? Collect email addresses. Probably one of the easiest ways to get email subscribers to join your list is to go through your current mail clients contact list and manually add those email addresses or, further still, you may even have an opt in collection program that you have been using for a while but have never really had the time to commit to writing a newsletter worthy of sending out. Remember though, an email list is only as good as the addresses contained within it. You want to run an OPT-IN email list, any other type of list will be considered Spam and, that will do you more damage than good. Of course, if you haven’t already got an email collection program you can find one online there are literally hundreds of them floating around that you can get for free from sites like http://www.hotscripts.com.

    So, you now have your emails, onto writing your newsletter. I think the greatest part of email is that it is somewhat less formal than writing for print copy. Email in fact tends to be very informal in comparison. The best way at approaching writing for an email newsletter is to write how you talk, it is more enjoyable for the reader and gives your newsletter a personality that no one else can emulate. Content wise, that depends on what you do, what would YOU like to see if you subscribed to an email list of the type you are going to be running and, more importantly, what would ensure you stay subscribed to the newsletter? Ask your friends, colleagues and, peers what they would like to see in an email newsletter, often they have been looking for information that is not readily available, this is an area where you then start to provide a service that no one else does.

    So you are at the point where you are starting to realize that running a newsletter is a lot of work correct? Well, it is. However, the effort, work and, time spent in putting your newsletter together will help you build a relationship with people whom, in all actuality, you may probably not ever meet in a face to face situation and, more importantly, it can become a great income generator over time.

    Article written by Lee

  • Robots.txt – Control The Robots That Crawl Your Sites

    Date: 2011.02.24 | Category: Search Engine Optimization, WebDesign | Response: 0

    By writing a structured text file you can indicate to robots that certain parts of your server are off-limits to some or all robots. It is best explained with an example:

    # robots.txt file for general use on web servers.

    User-agent: webcrawler
    Disallow:

    User-agent: googlebot
    Disallow: /

    User-agent: *
    Disallow: /cgi-bin
    Disallow: /logs
    The first line, starting with ‘#’, specifies a comment.

    The first paragraph specifies that the robot called ‘webcrawler’ has nothing disallowed: it may go anywhere.

    The second paragraph indicates that the robot called ‘googlebot’ has all relative URLs starting with ‘/’ disallowed. Because all relative URL’s on a server start with ‘/’, this means the entire site is closed off.

    The third paragraph indicates that all other robots should not visit URLs starting with /cgi-bin or /log. Note the ‘*’ is a special token, meaning “any other User-agent”; you cannot use wildcard patterns or regular expressions in either User-agent or Disallow lines.

    Two common errors:

    Wildcards are not supported: instead of ‘Disallow: /tmp/*’ just say ‘Disallow: /tmp’.
    You shouldn’t put more than one path on a Disallow line (this may change in a future version of the spec)
    Ultimately, without the use of robots.txt files on your servers/domains, you are risking a variety of potential problems including, unauthorized access to your cgi directory, unauthorized viewing of your site stats, possible spamming of the search engines by accidental crawling of doorway pages.

    One distinct advantage however of having a robots.txt file on your server is that, quite simply, you will be able to tell when and where your site has been indexed or potentially indexed as, all robots will automatically call for the robots.txt file BEFORE any other page on your server so, as long as you keep an eye open for any calls of this file, you can see who is knocking at your site for indexing purposes.

    Below is a robots.txt example that you can copy and paste into a text document to use on your own server:

    <!–Start Copy Below This Line–>

    User-agent: *
    Disallow: /cgi-bin
    Disallow: /logs

    <!–End Copy Above This Line–>

    The above will allow all spiders to crawl all of your site except the subdirectory’s ‘cgi-bin’ and ‘logs’ which, may be altered to suit any subdirectory’s you do not wish the spiders to crawl on your server.

    Article written by Lee

Premium Sponsors















Categories

Site Links