Spiders and Blogging
I would like to take a moment to explain how the internet works, or more specifically how search engines work and how you can make them work for you in two parts.
While I did not author either article I took the liberty of placing the links on the bottom of the page for each article so you could read them more in depth.
What I want you to take away from this page is how well search spiders index websites and Blogs and how a well written Blog will help your web site gain organic website traffic when used together.
The goal with combining these two tools is to create a bigger spiderweb for the spiders so feel free to create or add to the Blog at the AMG Blog http://ashlandmarketinggroup.ning.com/ be sure when you are putting together the post you create both a back and forward link to your page by putting a link to your web site in the post. This will benefit all who do this.
The more links to and from all the blogs and websites the better.
Part One Spiders and web searching.
Before a search engine can tell you where a file or document is, it must be found. To find information on the hundreds of millions of Web pages that exist, a search engine employs special software robots, called spiders, to build lists of the words found on Web sites. When a spider is building its lists, the process is called Web crawling. (There are some disadvantages to calling part of the Internet the World Wide Web -- a large set of arachnid-centric names for tools is one of them.) In order to build and maintain a useful list of words, a search engine's spiders have to look at a lot of pages.
How does any spider start its travels over the Web? The usual starting points are lists of heavily used servers and very popular pages. The spider will begin with a popular site, indexing the words on its pages and following every link found within the site. In this way, the spidering system quickly begins to travel, spreading out across the most widely used portions of the Web.
"Spiders" take a Web page's content and create key search words that enable online users to find pages they're looking for. |
Keeping everything running quickly meant building a system to feed necessary information to the spiders. The early Google system had a server dedicated to providing URLs to the spiders. Rather than depending on an Internet service provider for the domain name server (DNS) that translates a server's name into an address, Google had its own DNS, in order to keep delays to a minimum.
When the Google spider looked at an HTML page, it took note of two things:
- The words within the page
- Where the words were found
Words occurring in the title, subtitles, meta tags and other positions of relative importance were noted for special consideration during a subsequent user search. The Google spider was built to index every significant word on a page, leaving out the articles "a," "an" and "the." Other spiders take different approaches.
Part Two
SEO Benefits of Blogging: More Search Traffic
It’s sometimes hard to imagine or even quantify the specific SEO benefits of a business blog, but credit the gang at HubSpot for doing a good job of it. If you missed their blog post from a few weeks ago, I think these stats are worth sharing here:
A study of 2,168 HubSpot customers shows that businesses that published at least 5 blog articles in the last 7 days draw 6.9 times more organic search traffic and 1.12 times more referral traffic than those who don’t blog at all.
Here’s all that in a more visual piece of evidence:
You should click through to read the HubSpot post because they have additional stats showing how site traffic goes up the more blog posts you publish.
All of this is a nice complement to HubSpot’s earlier stats, which showed how companies that blog get more traffic, more inbound links, and have more pages indexed in search engines.
A good company blog is an exceptionally powerful SEO weapon
Part One http://www.howstuffworks.com/search-engine1.htm
Part Two
By Matt McGee on Mar 1, 2010 in Blogging SEO Benefits of Blogging: More Search Traffic
Google began as an academic search engine. In the paper that describes how the system was built, Sergey Brin and Lawrence Page give an example of how quickly their spiders can work. They built their initial system to use multiple spiders, usually three at one time. Each spider could keep about 300 connections to Web pages open at a time. At its peak performance, using four spiders, their system could crawl over 100 pages per second, generating around 600 kilobytes of data each second.