Wednesday, January 16, 2008

Get in Google and Yahoo in Just 48 Hours with QuickList from Wpromote

This is a SiteProNews/ExactSeek Webmaster Exclusive Mailing!
To drop your subscription, use the link at the bottom of this message.



You are currently signed up to spn-aesop as: grobocop@gmail.com
To not receive further mailings, send a blank email to leave-spn-aesop-1453969Y@nwdmail.com

Jayde Online, Inc.
Suite 238, 23-845 Dakota Street
Winnipeg, MB R2M 5M3

Tuesday, January 15, 2008

Search Engines, Spiders and Meta Commands

This is your SiteProNews/ExactSeek Webmaster Newsletter!
To drop your subscription use the link at the bottom of this message.

   Join the Social Content Revolution!

  Webmaster Software     Webmaster Resources     Link to SPN     Top SEO Tools     Blog Search     Website Templates 

  Advertise Archives Contact Us Privacy Statement SPN Blog Home SEO News Forums
 
    QUICK LINKS
 

JAN. 16,  ISSUE #1041

Web Search


Blog Search
   Add a Blog
   
Search 16,600+ Blogs
   
Grab a Blog RSS Feed
   
Blog Express for RSS Feeds
 
SiteProNews Blog
Read daily blog posts in the SiteProNews Blog by two of the Web's top writers, Jim Hedger and Jerry Bader.

Tools & Services

Webmaster Tools
   Web Page Analyzer
   Meta Tag Generator
   Keyword Popularity Tool
   Link Popularity Checker
   Search Engine Submitter
   Internet Tools Directory
   Site Resource Directory
 

SEO-News Forums
Join the SEO-News Forums to post comments, articles and tips or learn from SEO experts.
Forum Posts
Yahoo 247
Google 2047
SE Tips 286
Link Exchanges 370
General Discussion 228
Join the SEO-News Forums
ExactSeek Toolbar
Get the toolbar with spyware scanning, webpage keyword analysis, web search on multiple meta engines, popup-blocking, Alexa site ranking, word highlighting, auto-upgrade and erase browser cookies.
 
Traffic Exchanges
Get Free Visitors to Your Site with these Outstanding Services:

TrafficZap Visitor Exchange
TrafficZap

TrafficSwarm Visitor Exchange
TrafficSwarm


Site of the Day
coRank.com is a site where you can create or visit pages, add whatever things you find interesting on the web, and do all sorts of things once they're added.

Does your web site qualify as a SPN Site of the Day? Webmaster resource sites can apply via email: sotd@sitepronews.com
 

App of the Day
dirhtml 4.81 (404 KB) is a simple utility that builds customizable index html files from a folder branch using the gui or command line. Handy for accessing files and folders from a web browser. Freeware for Windows NT/ 2000/ XP/ Vista.

If you have a Webmaster App that you would like listed on the SPN site, send us an email with details to: wapps@sitepronews.com
 

Must Read Ebooks
SPN offers one of the best eBook libraries on the Web. Our current selection includes Commercial and over 183 Freeware eBooks.

Authors can submit eBooks to SiteProNews via email: ebooks@sitepronews.com
 

Link to SPN
Link your site to SiteProNews, the newsletter and resource site for Webmasters.

Or, Add SPN to your site with just 2 lines of code. Top content for your site without any of the work.

Visit our SPN Partners page. Some great sites have opted to support the SiteProNews newsletter.

SPN Partners
UmbrellaNews - The Web's most comprehensive news site. Stories updated every 7 to 10 minutes.

SubmitPlus - Post your site to 110 search engines... Gratis.

Template Monster - The Web's number one website templates are available for immediate download.

Online Site Builder - Providing high end web design, site management & digital media tools

Web-Source - Your Guide to Professional Web Site Design & Development.

TheCgiSite.com - A directory of programming resources.

TechNewsletters.com - A directory of IT newsletters with ratings & descriptions.

Alexa Toolbar - An indispensable tool for web professionals, providing Visitor Data, Site Stats, and Contact details for all the sites you visit!.

NewWebDirectory - A new internet web directory of professionally reviewed web sites providing both freebie and paid site submission.

FreeWebMonitoring - Monitor your web site's availability 24 hours a day, 7 days a week with email alerts and weekly web site statistics.

DropJack.com - A new social content website similar to Digg. Submit original content or articles and news items that you believe are newsworthy.

SmartWebGadgets.com - Useful gadgets and widgets for your blog or website. Enhance any web page with just 2 lines of code.

Top 10 Exposure - Forget PPC. Get Google-Type ads for $3 - $4 per month and top 10 exposure across 225+ search engines & web directories.

ExcellentGuide.com - Provides a directory of trusted, reliable and credible websites based on a unique credibility scoring system

 

Submit Plus
Blog Search
AddMe.com
DropJack.com
DesignerWiz
Web Position
Alexa Toolbar
UmbrellaNews
SubmitExpress
Top SEO Tools
Website Builder
Top 10 Exposure
$100 Bonus Traffic
SiteProNews Blog
WebMaster Radio
NewWebDirectory
Website Templates
FreeWebMonitoring
Search Engine Tool
FreeWebSubmission
SmartWebGadgets.com


Top Webmaster Headlines

Breaking Blog News




All Search Engines Love Spiders: How
Meta Commands Can Help You Love Them Too

By Scott Buresh (c) 2008

Nearly all search engines utilize spiders (which are also known by their original name, robots) to go out and scour the web looking for web pages. These search engine spiders then bring the data back to be indexed by the engine.

Since roughly 1996, individual meta commands have existed that can be used on individual web pages to modify how these search engine spiders behave. The most useful of these commands are fairly universal and respected by almost all search engines. What follows is a list of some of the more popular spider commands and instances in which you might want to use them.

<meta name="robots" content="index">

Intelligent Email Solutions for Online Businesses!

This meta command is one of the most common ones used – and it is also the least necessary. It tells search engine spiders to come on in and put the page in their index. However, all search engines do this by default anyway. Basically, if you want to put it in there for fun, be my guest, but this command is not giving you any special treatment. All search engines are going to index your page, unless you specifically tell them otherwise.

<meta name="robots" content="follow">

The follow command is different from the index command. It basically requests that the search engine spiders follow the links that are on a particular page. Again, however, this piece of code is completely unnecessary because all search engines are going to follow the links on a page, unless otherwise directed.

<meta name="robots" content="noindex">

The noindex command, the opposite of the index command, tells search engine spiders not to index the content of a page. It's important to note however that search engine spiders will still follow the links on a page that uses only this command.

When not used for legitimate purposes, this tag can be dangerous because it can put you at risk for penalization by most, if not all search engines. This is because you can use a noindex tag to hide pages with multiple links that you don't want visitors to see but that you do want all search engines to index.

There are however some legitimate uses for the noindex command. For example, if you have a dynamic site and you've created static pages to replace some of your dynamic pages, which can make them easier for search engine spiders to access, you could put a noindex tag on the dynamic version.

Start Earning Revenue with a NeverblueAds Account!

As Google mentions in its Webmaster Help Center:

"Consider creating static copies of dynamic pages. Although the Google index includes dynamic pages, they comprise a small portion of our index. If you suspect that your dynamically generated pages (such as URLs containing question marks) are causing problems for our crawler, you might create static copies of these pages."

In cases like these, it is acceptable to use the "no index" command on the dynamic version of the page, so that your content will not be treated as duplicate. You are not tricking all search engines, you're just redirecting them.

<meta name="robots" content="nofollow">

This tag tells search engine spiders that it's OK to go ahead and index a page and list it but that they shouldn't follow any of the links that are on the page. This can be useful if, for example, you had some partners that requested a link on your site that you felt obligated to give, but you wanted to hold onto as much Page Rank as possible. Now this is of course between you and your personal god, but you would be able to in effect have a partners page, add the nofollow attribute to the meta tags, and basically not pass on any of your Page Rank to any of the sites to which you are linking. The nofollow command in effect tells all search engines that this is the end of the line.

<meta name="robots" content="noindex,nofollow">

Obviously, noindex and nofollow are powerful tags – and in combination, they can make a page and the subsequent pages to which it links invisible to nearly all search engines. This combination command tells search engine spiders, "Do not read this page; do not follow any of the links on this page; do not include this page in your index."

Forget Expensive PPC Advertising - There is an Alternative!

This command has its beneficial uses. For example, it can be placed on pages on a site that have duplicate content for legitimate reasons. A website might have both a page for the United States and a page for England that cover the same product with exactly the same content. However, nearly all search engines would see this as duplicate content and could devalue both pages. So placing this command on one of them means that search engine spiders will walk on by and you won't be penalized.

<meta name="robots" content="noarchive">

Finally, almost all search engines today, including Google and Yahoo, provide a cached version of a site alongside its listing that provides a snapshot of what the page used to look like. The noarchive tag, therefore, is available to be used in circumstances where there is content on your website that is of a timely nature and therefore that you might not necessarily want search engine spiders to cache for people to have access to moving forward.

For example, a business might run a one-time special that has a ridiculously low price to drum up some business while things are slow. The business will want to be able to shut that sale down as soon as sales are back up to a solid level. However, it is conceivable that someone could click on the cached version of the business's site, see the old deal that was out there, and insist on getting it for themselves. By using the noarchive tag, you are telling search engine spiders, in effect, "This page is subject to frequent changes, and I don't want my visitors to have access to some of this content at a later time."

Conclusion

The commands discussed above are just a few of the ones in existence, and new ones are being added frequently. While nearly all search engines support these commands, there are still some that don't. The ones in this article, however, are fairly universally understood by search engine spiders, no matter from where they originate. As more universal commands are introduced, I will write about them in future articles.


About The Author
Scott Buresh is the CEO of Medium Blue, which was recently named the number one search engine optimization company in the world by PromotionWorld. Scott has contributed content to many publications including Building Your Business with Google For Dummies (Wiley, 2004), MarketingProfs, ZDNet, WebProNews, DarwinMag, SiteProNews, ISEDB.com, and Search Engine Guide. Medium Blue serves local and national clients, including Boston Scientific, DS Waters, and Wake Forest University Baptist Medical Center. Visit MediumBlue.com to request a custom SEO guarantee based on your goals and your data.



Printer Friendly Version of this Article


Recommended Webmaster Articles

How to Build Links and Optimize your Website for Multiple Keywords
In case you were wondering how to systematically achieve saturation for multiple keywords for your website in search engines (instead of just a few), then this is a must read post.

8 Tips to Drive Video Viral Marketing
The idea of companies using video for Web marketing is still new. Some companies are certainly experimenting, often by embedding video, typically hosted at YouTube into their existing blogs. The fact is, some of the best online video comes from unlikely sources.

Link Building Strategy To Get Top Search Engine Rankings
Google and almost any other search engine like Yahoo, or MSN determine ranking by the amount of backlinks given website has. But that doesn't mean any backlinks either.

SelfPromotion Writing Tips for Companies
One of the best ways for companies to "get their name out there" is through selfpromotion. This is a little different than straight up advertising and usually more effective.

Need Content for Your Website - GoArticles.com has 660,800+ Articles
Add a GoArticles RSS feed or Javascrïpt feed in seconds.

GoArticles has introduced an
Article Rating, Voting & Sp@m Reporting System - Read, Rate, Vote!


Webmaster Resource Sites & Services

Top SEO Tools - A suite of the best online submission, reporting and SEO Tools available. Sign up for a frëe tríal.


Add Me! - a pioneer in search engine submission, and the most popular. They provide frëe submission and paid submission.

Google Ranking Secrets Revealed! Boost Your Google Ranking, Get More Orders, And Make More Monëy!


Build Your Traffíc with ABCSearch
Get $100 of FR-E-E qualified Visitors. Sign-up today and we'll match any initial deposit up to $100. Geo-targeting, full reporting and one clíck results!


Recommended Webmaster Tools & Services

Net Research Server (NRS) - a complete search engine solution for sites wanting to host entire web search, industry specific search, site search, or directory search. NRS also enables users to submit listings, create alerts, and organize bookmarks.

Select from 1000's of Quality Templates
Need a new site look? Select from thousands of professional designs for a fraction of web design costs. Get a multi-page website up in just a few hours.

Build a Business Website in Under 5 Minutes.
Over 172,000 people just like you have used Exact Websites to build professional websites, complete with web pages, photo albums, email, links and 27 other features without ever having built a website before.

WebPosition
WebPosition helps you maximize your site's search engine visibility by providing a complete SEO solution including rank reporting, keyword research, page optimization and submission. Download a frëe demo today!

Have an Opinion on Today's Article?
Post Your Comments in the SEO-News Forums
Sign Up for FR-E-E and Participate

 

 

SiteProNews - The Net's most widely read Webmaster newsletter



You are currently signed up to spn-aesop as: grobocop@gmail.com
To not receive further mailings, send a blank email to leave-spn-aesop-1453969Y@nwdmail.com


Jayde Online, Inc.
Suite 238, 23-845 Dakota Street
Winnipeg, MB R2M 5M3
(c) Copyright 2008 All rights reserved