Google crawling
how do web pages get into Google, and who/what determines the order in which the various web pages appear when a user does a search on Google?
Periodically, Google crawls all the web sites that are listed in www.dmoz.org, and any web sites that are linked to those web sites. For example, if www.MyTerrificwebsite.com is listed in www.dmoz.org, Google will crawl that web site. If www.MyTerrificWebsite.com has a link to www.MyEvenBetterWebsite.com on it, Google will crawl www.MyEvenBetterWebsite.com also. Once Google crawls each web site, it caches the web site.
As Google crawls each web site, it scans the HTML code on each web page. Google then takes all this information, and runs it through the algorithm used to determine Page Rank, and placement within the search engine results. Google and other search engines each have an algorithm they use to determine which pages should rank high, and which shouldn't within the search results. This algorithm is a logical decision tree which looks for certain key factors to determine search engine ranking.
What is this algorithm? None of the search engines reveal this information because people would write web pages only to rank well in the search engine rankings, instead of creating web pages with good content. Ultimately, the search engines want the most relevant search result to appear when users search on various topics.
Google constantly fine tunes its algorithm (modifying it such that it can determine how to place the most relevant search results at the top of its search engine results). Periodically, Google runs this algorithm on all the web pages it has cached. This is what some SEO (Search Engine Optimization) folks call the "Google Dance". In the past, Google used to update its index on a somewhat monthly basis, and the 'Google Dance' was a noticeable flux in the Google database. Recently, Google switched to more of a constant update process. This means the index is updated in smaller increments, versus all at once, and there's no obvious Google Dance. While the excitement of the Google Dance is gone (No, I don't have a life), I've noticed additions or changes to web sites are getting indexed quicker than in the past.
Periodically, Google crawls all the web sites that are listed in www.dmoz.org, and any web sites that are linked to those web sites. For example, if www.MyTerrificwebsite.com is listed in www.dmoz.org, Google will crawl that web site. If www.MyTerrificWebsite.com has a link to www.MyEvenBetterWebsite.com on it, Google will crawl www.MyEvenBetterWebsite.com also. Once Google crawls each web site, it caches the web site.
As Google crawls each web site, it scans the HTML code on each web page. Google then takes all this information, and runs it through the algorithm used to determine Page Rank, and placement within the search engine results. Google and other search engines each have an algorithm they use to determine which pages should rank high, and which shouldn't within the search results. This algorithm is a logical decision tree which looks for certain key factors to determine search engine ranking.
What is this algorithm? None of the search engines reveal this information because people would write web pages only to rank well in the search engine rankings, instead of creating web pages with good content. Ultimately, the search engines want the most relevant search result to appear when users search on various topics.
Google constantly fine tunes its algorithm (modifying it such that it can determine how to place the most relevant search results at the top of its search engine results). Periodically, Google runs this algorithm on all the web pages it has cached. This is what some SEO (Search Engine Optimization) folks call the "Google Dance". In the past, Google used to update its index on a somewhat monthly basis, and the 'Google Dance' was a noticeable flux in the Google database. Recently, Google switched to more of a constant update process. This means the index is updated in smaller increments, versus all at once, and there's no obvious Google Dance. While the excitement of the Google Dance is gone (No, I don't have a life), I've noticed additions or changes to web sites are getting indexed quicker than in the past.
posted by sandeep dixit at 11:00 PM
12 Comments:
Howdy! This post couldn't be written any better! Reading this post reminds me of my old room mate! He always kept chatting about this. I will forward this page to him. Pretty sure he will have a good read. Many thanks for sharing!
Here is my page ... mws
My site: zfk
Hey there! I could have sworn I've been to this site before but after browsing through some of the post I realized it's new to me.
Anyhow, I'm definitely happy I found it and I'll be book-marking and checking back often!
my website: weight loss
I absolutely love your blog and find many of your post's to be just what I'm looking for.
can you offer guest writers to write content for yourself?
I wouldn't mind composing a post or elaborating on a number of the subjects you write about here. Again, awesome site!
Visit my blog post :: twitter promotion
Аwesome! Its in fаct геmaгkable articlе, I have gοt much cleaг idea on the topiс оf from this pοst.
Feel free tο νisit my web blog :
: boom Truck
First of all I want to ѕаy awesome blog!
I had a quick quеstion that Ӏ'd like to ask if you don't minԁ.
I was іnterested to know how you сenter yоurѕelf anԁ
cleаr уour mind befοre writing. I have had
a harԁ time cleаring my thoughts in getting
my thoughts оut. I ԁο еnjoy ωriting but іt just seems like the first 10 to 15 minuteѕ tend to be lost just trying to figure out hoω to begin.
Αny suggestiοns or hints? Kudos!
Also visit my weblog :: tens machines
Hmm it appears like your website ate my first comment (it was extremely long) so I guess I'll just sum it up what I wrote and say, I'm thoroughly enjoying your blog.
I as well am an aspiring blog blogger but I'm still new to the whole thing. Do you have any recommendations for beginner blog writers? I'd definitely
appreciate it.
My site: aaa fx
Also see my webpage - http://www.arcadetrainer.com/index.php?params=profile/view/306145
It's going to be end of mine day, but before ending I am reading this enormous post to increase my knowledge.
Also visit my weblog ... how to build followers on twitter
Hello just wаnteԁ to give you а quick headѕ up.
The text in your article seеm to be running off the screen іn Intеrnet exρlorer.
Ι'm not sure if this is a format issue or something to do with browser compatibility but I thought I'd post to let you know.
The stуle and design look great though! Hope you get the problem reѕolved soon.
Мany thanks
Look at mу blog post :: tens pain relief
Woω, amаzing weblog format! Hοw lengthy
haѵe you been running а blog fоr?
you mаde running a blоg glancе eаsy.
The totаl lοok of yοuг sіte is great, let аlоne the сontent mаterial!
Reѵіеw my web blog - www.lgtensunits.com
Τhanks fοr another gгeat article.
Where elѕe may just anyone get that kіnd of info in such a
peгfеct method of wrіting?
I have a prеsentation subѕequent ωeеk, and I'm on the look for such info.
Also visit my homepage; dfw seo
Τhis design iѕ wiсkеd! You cеrtainlу know how to keep a гeаder еntertained.
Between your wit and your videos, I was almοst moved
to ѕtart my own blog (well, almost...HaHa!) Great јob.
I really loveԁ what you hаd to say, and more than that,
hοw уou pгesented it. Too cool!
Fеel frеe to ѕuгf to my web-site;
altec bucket truck
My developer is trying to convince me to move to .
net from PHP. I have always disliked the idea because of the expenses.
But he's tryiong none the less. I've been using Movable-type on several websites for about
a year and am anxious about switching to another platform.
I have heard good things about blogengine.net. Is there a way I can transfer all my wordpress
posts into it? Any help would be really appreciated!
my web page; best teeth
Post a Comment
<< Home