Using SSI For Auto Updates

Date: 2011.02.24 | Category: WebDesign | Response: 0

We all realize the benefits of being able to save time when building sites so, I got into thinking, how can I make my sites look as if they are continually updated without the need to go in and update them manually? Enter the world of SSI.

SSI is actually a nifty little tool, not only can you include files from a central location but, you can include them at specific times of the day, days of the week or even months of the year, very handy indeed if you are building any type of site that needs updating periodically.

Once the main burst of work has been completed you can pretty much use the same files over and over again to help you out.

So onto the auto updating SSI, the following SSI coding will enable you to update a page or pages based on which day of the month it is. It will check the day the page has been accessed and display the relevant information again, this is a handy thing to have should your sponsor be running a promotion over several days, all you need to do is update a selection of SSI files and all of your sites are updated instantly.

<!–#config timefmt=”%d”–>
<!–#include virtual=”/yourdirectory/$DATE_LOCAL.txt”–>

What you need to do is create 31 text files named 01.txt right the way through to 31.txt take the SSI call above and edit the location of the SSI files on your server, you may like to have a central folder named /SSI/ for this purpose so the location would be changed to /domain.com/SSI/$DATE_LOCAL.txt

I the 31 files you created you could have a table ad with eight of your sponsors links, an article in each one or even just a simple text link, anything that you may want to update can be included in these files.

As I mentioned above you can base the time, date and even month of rotation to whatever you like to alter how the files are rotated and ultimately viewed on the web you should change the %d in the timefmt field to one of the following:

%d : Day of the month requires 31 files named 01.txt to 31.txt
%w : Day of the week requires 7 files named 0.txt to 6.txt
%j : Day of the year requires 365 files named 001.txt to 365.txt
%u : The week of the year requires 52 files named 00.txt to 53.txt
%m : The month of the year requires 12 files named 01.txt to 12.txt
%H : Hour of the day requires 24 files named 00.txt to 23.txt
%M : Minute of the hour requires 60 files named 00.txt to 59.txt

As you can see from the above there really are no limitations to the uses of updating using SSI and, apart fro the relative ease of use and the time saved using them should one sponsor not be converting for you all you need to do to swap sponsors is alter your central set of SSI files and you have instantly changed sponsors over all of your sites.

Article written by Lee

Cleaning Up The Myths On Scrubbing

Date: 2011.02.21 | Category: Billing Solutions | Response: 0

Time and time again on message boards I see the same old topics regarding scrubbing usually preceded by some company being accused of scrubbing their webmasters surfers to much and the webmasters sales being lower because of the sponsor ‘scrubbing’ their surfers however, the reality of this is, it isn’t the sponsors who control how much or how little the surfers credit card transactions are ‘scrubbed’.

The E-Commerce Dilemma.

Irrespective of whether you are an online bookmaker, bakery or adult pay site owner the fact of the matter remains that only credit card fraud is on the increase and, in addition to the rise of online credit card fraud the methods in which the perpetrators of these crimes carry them out is also changing often combating the methods put in place by the online transaction processors to stop this happening luckily however, this is where ‘scrubbing’ comes into effect.

So What Is Scrubbing?

Scrubbing is a method used by the credit card processor that the companies who’s site you are sending a surfer to uses. Scrubbing is in effect, a method of calculating the probability that any single transaction (or group of transactions) could be fraudulent. That is to say, is being carried out by someone other than the true owner of the credit or debit card.

Scrubbing is probably the single most useful tool provided to our sponsors by the credit card processors to ensure that every transaction that gets sent to them is credible and, once the transaction is allowed (or not) a part of the information contained with the transaction is sent to a central database to help other clients of that processor guard against receiving unlawful transaction purchases.

How Does Scrubbing Affect Me?

As a webmaster, believe it or not, scrubbing is actually a good thing for you. You know that each transaction processed is first of all a legitimate one and, secondly, you know that the sponsor who you are using is not going to go bankrupt due to excessive illegal transaction. This means that the sponsor can improve the services they offer YOU as a webmaster to assist you in making more money.

In essence, the scrubbing of credit card transactions at a sponsors level increases the amount of money you make long term not only with that individual sponsor but, with every other sponsors who uses the same transaction processor.

Article written by Lee.

Why Go Adult?

Date: 2011.02.21 | Category: Hosting | Response: 0

When choosing a hosting company why choose an adult host over a mainstream one?

Simple, They provide above other things, a better quality of service, affordability and, most importantly, reliability.

Adult hosts face a variety of technical and support issues, this coupled with the points mentioned above makes them a far superior choice to standard mainstream hosting providers. This is one of the main factors why more and more mainstream internet based companies are now turning to the adult business forum to provide their hosting solutions.

Mainstream going adult? Yes that’s right, more and more mainstream companies are turning to our industries hosting providers for the fast speeds, security and, reliable infrastructures they can offer after all, adult sites are amongst the most prolific on the internet on average gaining more daily hits to their sites than mainstream websites so, they need to be cost efficient, not only to the hosting companies but, also to their clients, the webmaster.

Our industry strives on the use of heavy graphics, coupled with streaming media files to secure sales and longevity, this is why the adult hosting companies need to be able to provide not just a single, heavily laden server but tens of them, sometimes even hundreds all producing gigabytes of traffic on a daily basis.

Adult hosting companies are constantly upgrading their equipment in order to improve not just their servers, connectivity but also the smaller things that are often overlooked by webmasters, hubs, routers, switches and the likes along side the not so technical aspects of running a host, The staff.

Along with all of this technical equipment they also need to maintain a high level of technical knowledge, after all, not just anyone can install operating systems capable of running multi-million dollar industries. They need the knowledge to maintain, upgrade, repair and sell their services to the best of their capabilities.

What does this mean to you? Well, we all want to make money and, through the use of faster servers, e-commerce solutions and the technical support your hosting provider can give you, you will be fattening your wallet on a daily, weekly, monthly basis.

Adult hosting, quite simply, is the crème de la crème of the hosting world, they offer solid, solutions whether you are starting in the adult industry or, operate a mainstream e-commerce site.

So how do you choose a host that is right for you?

You need to ask some basic questions of the host and, do your homework. Not only should you find out what hosting solutions they can offer you but, you need to find out what their support service is like, how affordable they are in comparison to other companies who can offer similar or the same service. Whilst on the subject of hosting support, before you sign on the dotted line, give your host a call out of office hours, if they answer, then you can almost be certain they are a good hosting provider.

Of course, not all hosts will have 24 hour phone support, however, that said, some offer 24 hour icq support, email support and more.

Another sure fire way to find out if a hosting company is any good is to ask on the heavily traveled webmaster message boards, after all, you are not the only webmaster out there who will have tried this company, if they are no good, someone will know about it and point you in the direction of a reputable host like http://www.webair.com.

Hopefully, this article will have given you some insight into the world of adult hosting companies and, will assist you in making the right choice of host for your site, whatever type of website you might be hosting.

Article Written By Lee

Why Cant I Get Indexed By The Search Engines?

Date: 2011.02.24 | Category: Search Engine Optimization | Response: 0

Unfortunately, this is an all too common question. If it makes you feel any better, you’re not the only one frustrated about the length of time it takes to be indexed, or the many pitfalls involved. It often takes anywhere from two days to as much as six months to be listed on a search engine. For example, last month Excite finally updated its index for the first time since last August! Luckily, Excite is the most extreme case lately, but waiting several weeks to a month can also be extremely frustrating especially when your livelihood depends partly on these search engines.

The Web Position Submitter report will give you current time estimates for each engine so you’ll know what to expect. However, an engine at any time could choose to delay their indexing beyond the “norm” for maintenance or other reasons. On the flip side, you could get lucky and submit just a couple days before an engine does a complete refresh of their database. Therefore, submission times can never be an exact science since we’re all ultimately at the mercy of the engine.

If you’ve submitted your site and have waited the estimated time to be indexed and there’s still no listing, what do you do now?

Here are 16 tips that should help you solve this problem:

1. First, be sure you’re not already indexed but just don’t know it. Unfortunately, none of the major engines are kind enough to e-mail or notify you as to if and when you’ve been indexed.

The method to determine if a page or domain has been indexed varies from one engine to another, and in many cases, it’s difficult to tell for sure. Never assume that you’re not indexed just because you searched for a bunch of keywords and you never came up in the first few pages of results. You could be in there but buried near the bottom.

In addition, it’s not very practical to check the status of a number of pages on each major engine each week. Fortunately, Web Position has a URL verification feature in the Reporter that makes this process much easier. Each time you run a mission, it will report which URLs exist and do not exist in each engine. If you’re using Web Position and are not finding your URLs after submitting, be sure to see this page for common pitfalls to watch out for:

http://www.webposition.com/urlnotfoundhelp.htm

2. Make sure you have uploaded the pages to your site before submitting them. This one seems obvious, but submitting a page that does not exist or submitting with a subtle typo in the URL is a goof we might all make at one time or another. If you’re using Web Position’s Submitter, there’s a checkbox on tab 2 that forces Web Position to verify that all your URLs are valid before submitting them.

3. If you have information inside frames, that can cause problems with submissions. It’s best if you can create non-framed versions of your pages. You should then submit the non-frames versions of your pages which can of course point to your framed Web site. Alternatively, you can enter your relevant text within the NOFRAMES area of a framed page which most search engine spiders will read.

4. Search engine spiders cannot index sites that require any kind of registration or password. A spider cannot fill out a form of any kind. The same rule applies regarding indexing of content from a searchable database, because the spider cannot fill out a form to query that database. The solution is to create static pages that the engines will be able to find.

5. Dynamic pages often block spiders. In fact, any URL containing special symbols like a question mark (?) or an ampersand (&) will be ignored by many engines.

6. Most engines cannot index text that is embedded in graphics. Text that appears in multimedia files (audio and video) cannot be indexed by most engines. Information that is generated by Java applets or in XML coding cannot be indexed by most engines.

7. If your site has a slow connection or the pages are very complex and take a long time to load, it might time out before the spider can index all the text. For the benefit of your visitors and the search engines, limit your page size to less than 60K. In fact, most Webmasters recommend that your page size plus the size of all your graphics should not exceed 50K-70K. If it does, many people on dial up connections will leave before the page fully loads.

8. If you submit just your home page, don’t expect a search engine to travel more than one or two links away from the home page or the page that you submitted. Over time they may venture deeper into your site, but don’t count on it. You’ll often need to submit pages individually that appear further down into your site or have no link from the home page.

9. If your Web site fails to respond when the search engine spider pays a visit, you will not be indexed. Even worse, if you are indexed and they pay a visit when your site is down, you’ll often be removed from their database! Therefore, it pays to have a reliable hosting service that is up 99.5% of the time. However, at some point a spider is going to hit that other 0.5% and end up yanking your pages by mistake. Therefore, it pays to keep a close eye on your listings.

10. If you have ever used any questionable techniques that might be considered an overt attempt at spamming (i.e., excessive repetition of keywords, same color text as background, or other things that the Web Position Page Critic warns you about), an engine may ignore or reject your submissions. If you’re having trouble getting indexed in the expected amount of time, make sure your site is spam-free.

11. If your site contains redirects or meta refresh tags these things can sometimes cause the engines to have trouble indexing your site. Generally they will index the page that it is redirecting TO, but if it thinks you are trying to “trick” the engine by using “cloaking” or IP redirection technology, there’s a chance that it may not index the site at all.

12. If you’re submitting to a directory site like Yahoo, Open Directory, NBCI.com, LookSmart, or others, then a human being will review your site. They must decide the site is of sufficient “quality” before they will list it. I recommend you read the submission guide on the directory tab of the WebPosition Submitter. It contains tips to improve your chances of obtaining a good listing on these directories.

13. A number of engines no longer index pages residing on many common free web hosting services. The common complaint from the engines is that they get too many “junk” or low-quality submissions from free web site domains. Therefore, they often choose not to index anyone from those domains or they limit submissions from them. It’s always best to buy your own domain name (very important) and place it on a respected, paid hosting service to avoid being discriminated against.

14. Some engines have been known to drop pages that cannot be traveled to from the home page. HotBot has been rumored to do this. You may want to consider submitting your home page that links either directly or indirectly to your doorway pages.

15. Make sure you’re submitting within the recommended limits. Some engines do not like more than a certain number of submissions per day for the same domain. If you exceed the limit, you may find that all your submissions are ignored. Fortunately, WebPosition’s submitter will warn you regarding current limits and recommend you stay within them. Some submission consultants feel it is dangerous to submit more than ONE page a day to a engine for a given Web site. For those who wish to be ultra-conservative in their approach, the Web Position Submitter includes a checkbox to limit submissions to one URL per day per engine.

16. Last but not least, sometimes the engines just lose submissions at random through technical errors and bugs. Therefore, some people like to resubmit once or twice a month for good merit in case they do lose a submission. Certainly if you’ve followed all the “rules” and are still not listed, re-submit! Sometimes a little persistence is all that’s needed.

If any of the above scenarios apply to your submission, you should make the necessary adjustments and re-submit. If that still does not work, you should consider e-mailing or calling the search engine and asking them politely why you have not been indexed yet. Sometimes they will reply back with “Sorry, there was a problem with our system and I’ve now made sure you’ll be indexed within the next couple days.” Or, sometimes they’ll tell you why you were not indexed. In other cases, they will ignore your e-mail and you’ll have to keep e-mailing or calling them until they respond. Still, it’s definitely worth the effort to get your site listed with the major engines assuming you also take the time to optimize your pages so you’ll achieve top rankings.

Article written by Lee

Over The Rainbow

Date: 2011.02.24 | Category: General | Response: 0

So why is the gay community over the rainbow? As promised today I’ll finish up on the symbols that are prevalent in the gay community. Last week I mention the Pink Triangle and it’s political emergence. And technically, the rainbow flag has a similar political beginning.

I always love answering a question with another question (it is one of those annoying habits I have). So, when I am asked the “what does the rainbow flag stand for?” I look forward to the response when I ask, in turn, “what do YOU think it means?” Here are my top three favorite answers:

1 – “It’s colorful and gay people like colors.”

2 – “It’s a dance party thing”

3 – “Judy Garland sang Over the Rainbow you guys loved her a lot.” (This has to be my all time favorite.)

Well like any political symbol, it is a way to distinguish ourselves. But this time we look not to a place in history but we look at the world in general. No matter where you are, whether it is on 8^th street in NYC or Rue du Champe in Paris, there will be a gay person somewhere. Now, some may argue that not all cultures and societies will have homosexual present. And I say, “BULL”. They are just in the closet somewhere.

So in essence, gay men and women cross every racial and religious culture around the world. We come in all shapes, sizes and colors. So what better symbol to show that with than a rainbow, all colors coming together as one – as one community. No matter how culturally diverse our world is, the gay community is made up from a piece of each.

The rainbow flag and the uses of the rainbow, in the gay community, are diverse. If you see it flying outside on a restaurant wall, and it means it is a gay or gay friendly establishment. See a set of rainbow rings around a friend’s neck, it’s gay fashion accessories. And see a political march with rainbows on posters and flags, it’s a gay assembly.

Last week I insinuated that the pink triangle was not a symbol to over use in design. Well, in my opinion, the opposite is true with the rainbow and the rainbow flag. I am NOT saying run out and re do all your sites with rainbow backgrounds. No! But, I am saying that the nature of this political symbol is somewhat more flexible. We ourselves took the rainbow and made jewelry, publications, tee shirts and such. And just as the pink triangle, the rainbow will say that it’s ok to be here, you have friends inside or you have nothing to worry about here – be yourself, this place is for you.

So what have we learned? What some people think as silly symbols that gay people use, actually have an origin – and, a potent origin at that. I still ask, for your own good, that you use them wisely and not over do it. The more you throw symbols around willy-nilly, the more people will think you do not know what you are doing. And the more that the surfers thinks that, the less likely you are to make the sale and get your business to grow.

Article written by Gary-Alan

So That’s What It Means!

Date: 2011.02.24 | Category: General | Response: 0

Often you will hear other webmaster talking about things such as unique hits, banner exchanges and, AVS systems. The article below is a simplified glossary of those and many other terms that you will begin to hear day in and day out of your working life as an adult webmaster.

AVS (Adult Verification System)
The protection system that was designed to prevent minors from accessing adult sites. AVS services usually also have a large network of sites that adult surfers can access with one password. You can find a list of Age Verification Systems at Adult Sponsor Programs

AVS Site
A site that uses an AVS system.

Banner Exchange
A program that enables an exchange of traffic between a whole variety of adult sites. They provide you with some coding which you put in your HTML in order to get additional visitors to your adult site. You can visit: Porn Client for a highly respected Banner Exchange System.

Blind Links
When you place a misleading link on a site that will encourage the surfer to click on it. They will be sent to a new site that has nothing to do with what they expected to see. For example, if you had a text link saying ‘Free Porn’ and they get sent to a paysite when they click on the link.

Browser
A program that displays and navigates web pages you are using a browser now to view this page.

Chargeback
A chargeback is what happens when a surfer changes their mind or decides they don’t like the site or service they signed up for and tells their credit card company they will not pay the fee for your sponsor or paysite charges. Chargebacks are bad for everyone concerned because do you not only lose income for the sale, penalties are applied and sometimes they are applied to you.

Click-Thru Program
A sponsorship program that pays you an amount of money for each and every single visitor you send to their site. You can also find a list of per click sponsors at Adult Sponsor Programs.

Content Provider
A company that offer adults pictures, video clips for sale or lease. For a complete list of the best content providers head over to http://www.adult-content-providers.com.

Dead Or Broken Link
A link that is no longer valid or isn’t working. When you click on the link you get a page not found error.

E-Zine
An E-Zine is in simplified terms and online magazine.

FTP (File Transfer Protocol)
You need to upload (FTP) your web pages from your computer on to the web for everyone to see. One of the most well known FTP clients is Cute FTP.

Hits
Number of times your page was viewed over a specific period of time.

Hit Counter
Tool used to track the number of surfers that click onto your adult site. A good hit counter can be found at: http://www.sextracker.com

Hot-Linking
When someone links to an image on your server to display it on their site instead of linking to the image on their own server. You can prevent Hot-Linking by having a .htaccess file on your server.

HTML (HyperText Markup Language)
This is the language used to write web pages. This page is written in HTML.

ISP
Your internet service provider. AOL is a well known ISP.

Java
A programming language used by programmers to build and create programs. Not to be confused with JavaScript (see below).

JavaScript
A scripting language you can directly insert into HTML documents. They only work with surfers that have Java enabled on their browser.

Legal Content
Adult content for which you have rights to display on your site.

Model Release
Document that a model signs at the time the photographs of them are taken.

Message Board
A message board is a place where you can ask and offer advice about the industry or just generally chat with other adult webmasters for example the message board at: http://www.europeanwebmasters.com.

Newbie
A new adult webmaster.

Partnership, Sponsor or, Affiliate Program
A revenue program that pays you a percentage or fixed price for every member you send to your sponsor’s site.

Pay Site
An adult website where surfers have to pay a fee for access.

Pic Post
A site where you can submit a picture and your ad on a daily basis.

Plug In
A plug in is a ready-made type of web “CONTENT”. Many plug in providers will even host the content on their servers and allow you to change colors, Fonts and, add a logo graphic, so the plug in matches your site. Plug In content is generally more expensive than image content.

Ratio
A ratio like this refers to click throughs and actual sales made from them. When a webmaster says they got a 1:250 ratio, they mean that out of 250 people who clicked on his sponsor banner, one of the surfers paid for memberships.

Signup Ratio
The amount of surfers that paid to view your adult site (See the example above headed RATIO).

Spamming
Promoting a site or service to newsgroups or e-mail addresses that have not given you permission to do so. Spamming can also mean posting your referral codes on message boards constantly inn order to get other webmasters to sign up beneath you.

TGP (Thumbnail Gallery Post)
A site where you can submit your gallery pages. They in return put up your gallery and send you additional traffic.

Thumbnail
A smaller version of an image used to link to a larger version of the same image.

Turnkey Site
An adult site that is already designed and finished with logos, content, billing solutions and, hosting. All you have to do is maintain the site. Newbies often make the mistake of buying a turnkey site before they properly know how to market them.

Traffic
The term used to refer to the amount of visitors to your adult website over a specific period of time.

Uniques
Number of visitors to your site. If 10 surfers visit your site on any given day and 2 of them click onto your site 3 times the same day, it will be referred to as 8 unique visitors for that day.

URL
A web address. Actual address to a page would be a URL. For example: http://www.adultwebmasternewsletter.com is the URL to our Adult Webmaster Newsletter Site.

Warning or Entry Page
The page before a surfer sees the main content of your site.

Web Host
A company that will provide you with a hosting account so that you may upload your website on their server so that surfers may see your site. For a reputable host you might like to try http://www.webair.com.

Article written by Lee

Blogging For Traffic – An Alternate View

Date: 2011.02.21 | Category: Blogging | Response: 0

Just recently the adult industry seems to have gone ‘blog’ crazy in fact, it is almost a daily occurrence that webmasters mention a blog of some description on several message forums however, when it comes down to it, does blogging really matter at all? This is what we will take a look at in this article.

What Is A Weblog Or Blog?

A Weblog, or ‘Blog’ for short, is a kind of website or a part of a website. It is usually, but not always, run by a single person and they publish bits of writing on the Weblog. These bits of writing, called ‘entries’ or ‘posts,’ generally appear on the front page of the weblog in reverse chronological order, that is, with the newest entry at the top of the page, with older entries progressively further down.

So How Can Blogging Help Me?

Quite honestly, I don’t think it can. Think about it for a moment, you spend an hour or so a day writing a page in your online journal only for it to be erased or archived at a later date, doesn’t that seem strange to you? Instead of blogging why don’t you actually do something constructive such as making a .html page out of the text you were going to use for your blog, keyword it up and upload that directly onto your server? After all this in itself will benefit you in the long term much more than a quick page that will eventually disappear from existence. Of course there will always be those people who do successfully use blogs as a part of their marketing strategy and, kudos to them however, looking at the bigger picture, it makes much more sense to have a fresh HTML page which will remain indefinitely on your site that you can keyword and SEO for the search engines rather than something that is going to become relatively short lived.

Blogging – Overview.

To be perfectly honest with you, all of this talk of creating a blog to get additional traffic is, in itself just ‘hype’ unless you have a source of blog owners to link back to your blog or, an hour or so to kill each day wasting your time writing your blog your time really would be much better served coding HTML pages. After all, HTML pages have worked for the last 30 years, why all of a sudden have webmasters stopped using them?

Article written by Lee.

Time Management – Organizing Your Content Purchases

Date: 2011.02.24 | Category: Content | Response: 0

From time to time it is inevitable that as adult webmasters there will be two things that will happen:

1) You will buy some licensed content.

2) You will use this content for a gallery.

However, unless your content is organized you can end up spending to much time to make a 10 pic gallery page. This article is going to offer you some sound advice on how to organize your content from the second you take delivery of it which, will save you a lot of time long term.

So we have taken delivery of our adult content either by download or, on cdrom what next, we could just file it away on cdrom but, by taking a little extra time to organize your content from the start you will end up not only building sites MUCH quicker but also saving time all round.

Here are some helpful hints to get you on the way to content organization.

1) Unzip all your content sets and, if applicable, separate them into model and niche sets.

2) Create folders for each model and, each set of 10 images within the main model sets.

3) Rename all your images in the 10 pic sets starting from pic1.jpg through to pic10.jpg.

4) Crop, compress and thumbnail each image within each set of 10 that you have.

5) create a html page that calls your thumbnails and main pics using relative urls i.e. /set1/gallery1/image1.jpg for the larger image and /set1/gallery1/thumb1.jpg for the thumbnail image.

6) Inside each of your 10 pic/thumbnail folders place this HTML page you have just created.

7) Burn each of the gallery folders to cdrom.

Lets now look at what an hour spent has enabled us to do.

Instant Galleries.

Say we want to build a 10 pic gallery to add into a free site or an AVS site that we are building, we know we have all the galleries already made, its just a case of finding the correct gallery and uploading it to our server.

Image Swapping.

What happens if we need to swap an image from one of our pages to a more appropriate one for the niche we are marketing to, simple, you go to the image set you want, look for the image name and simply change the image without having to upload it as, you will now know the EXACT location on your server of the image you are changing to e.g., /set6/gallery8/image9.jpg would change to set24/gallery2/image2.jpg.

There are of course other ways this can benefit you for example, you can plug in your galleries to any site you own if you have them all uploaded to a central content location domain.

The benefits of organizing your content from the instant you take delivery are endless, the above is just a sample of how I have successfully saved time and effort by becoming more organized, the only limitations you have with your organizational skills are those that you impose on yourself.

Article written by Lee

Straight From The Horses Mouth – Get Googlized

Date: 2011.02.24 | Category: Search Engine Optimization | Response: 0

Many webmasters wonder how to ensure their sites will be included in Google’s index of web sites. Although Google crawls more than a billion pages, it’s inevitable some sites will be missed. When Google does miss a site, it’s frequently for one of these reasons:

* The site is not well connected through multiple links to others on the web.
* The site launched after Google’s last crawl was completed.
* The design of the site makes it difficult for Google to effectively crawl its content (excessive frames, tables, etc).

Google’s intent is to represent the content of the Internet fairly and accurately. To help make that goal a reality, we offer this guide to building a “crawler-friendly” site. There are no guarantees a site will be found by our crawler, but following these guidelines should increase the probability that your site will show up in Google search results.

Do…
Provide high-quality content on your page – especially your home page.
If you follow only one tip from this page, this should be it. Our crawler indexes web pages by analyzing the content of the pages themselves. Google will index your site better if your pages contain useful information. Plus, your site has a better chance of becoming a favorite among web surfers and being linked to by others if the information it contains is relevant and useful.

Submit your site to the appropriate category in a web directory.
Listing your site in the Open Directory Project http://www.dmoz.org/ or Yahoo! http://www.yahoo.com/ increases the likelihood it will be seen by robot crawlers and web surfers.

Pay attention to HTML conventions.

Make sure that your <TITLE> and <ALT> tags are accurate and descriptive. Also, check your <A HREF> tags for errors since broken or improperly formatted links can prevent Google from indexing your page.

Make use of the robots.txt file on your web server.
This file tells crawlers which directories can or cannot be crawled. Make sure it’s current for your site so that you don’t accidentally block our crawler. Visit: http://www.robotstxt.org/wc/faq.html for a FAQ answering questions regarding robots and how to control them once they visit your site.

Ensure that your site is accessible through HTML hyperlinks.
Generally, your site is crawlable if the pages are connected to each other with ordinary HTML links. If certain areas are not linked, you may be excluding older browsers, differently-abled users, and Google. Google can crawl content from a database or other dynamically generated content as long as it can be found by following links. If you have many unlinked pages, you may want to create a jump page from which the crawler can find all of your pages.

Build your site with a logical link structure.
A hierarchical link structure is not only beneficial to you, but also to Google. More of your site can be crawled if it is laid out in with a clear architecture.

Don’t…
Fill your page with lists of keywords, attempt to “cloak” pages, or put up “crawler only” pages.
If your site contains pages, links or text that you do not intend visitors to see, Google considers them deceptive and may ignore your site.

Feel obligated to purchase a search optimization service.
Some companies “guarantee” your site a place near the top of a results page. While legitimate consulting firms can improve your site’s flow and content, others employ deceptive tactics to try and fool search engines. Be careful – if your domain is affiliated with one of these services, it could be permanently banned from our index, we have found search engine optimization software like Web Position Gold works best but, again use it in moderation.

Use images to display important names, content or links.
Our crawler does not recognize text contained in graphics.
Use ALT tags if the main content and key words on your page cannot be formatted in regular HTML.

Provide multiple copies of a page under different URLs
Many sites offer text-only or printer-friendly versions of pages that contain the same content as the graphic-enriched version of the page. While Google crawls these pages, duplicates are removed from our index. In order to ensure that we have the desired version of your page, place the other versions in separate directories and use the robots.txt file to block our crawler.

Article written by a Google employee

Why Have More Than One Index Page?

Date: 2011.02.21 | Category: Search Engine Optimization | Response: 0

The first thing you should do when you start designing a web site is to create an index page. You would think that this is a basic knowledge in web design, but I still encounter web sites that are lacking in this.

If there’s no index page, and if the web host server has not set a directory access limitation, any visitor will see a directory listing of all the images, html pages, CGI-scripts, and other files in the directory. Everything will then be accessible for reading and downloading, and the CGI-scripts will also be executable!

So, for a basic security it is most important to have an index page in all your directories, whether they contain only pictures or garbage. In the directories that are private or containing things other then HTML pages, the index pages need only to print out a text like “access forbidden” or something in that spirit. In the directories containing one or more HTML pages, one of the pages must be named “index.html,” whether it is a page with real content or for security reason.

If you have a directory specifically for CGI-scripts, it will run a higher security risk, because most of the times these directories are called CGI-bin, or a variant of that, and anyone who is after your scripts is undoubtedly familiar with this and can access the directory by typing the directory name in the targeted site’s URL, if it’s not properly protected by an index page. Imagine the horror when someone uses your mailing list program to Spam all your subscribers or decides to sell your email list. It’s quite a big business in selling email lists. A large email list is worth thousands of US dollars nowadays.

I could have done all these things if I had any bad intentions when I accidentally bumped into an unprotected site. Actually, I bumped into two unprotected, huge subscribers lists in the last two months, which prompted me to write this article. But of course, I did the proper thing and emailed the web sites’ webmasters about their oversight. You would think that these professional looking and operating web sites with email lists of respectively 8,000 and 15,000 subscribers would know better.

Even if your site is made by a web design company, make sure all your directories are protected. In fact, one of the two unfortunate web sites I uncovered is a web design company. So, check out your site for this unnecessary security gap, right now.

Article written by Lee