You are currently viewing A seminar entitled Basic crawler algorithm

A seminar entitled Basic crawler algorithm


The College of Computer Science and Information Technology held a seminar entitled (The Basic Crawler Algorithm). The lecture was delivered by Asst. Instructor Maha Sabri of the Computer Science Department. It addressed the importance of Crawler algorithms as they are used in the field of web pages and global search engines such as Google and Yahoo. This algorithm downloads web pages automatically, because the information on the web is scattered among billions of pages that are served by millions of servers around the world. This is in addition to its importance in collecting various information from social network sites. The mechanism of this type of algorithm is that Crawler starts from a set of raw pages (URLs) and then uses the links within them to fetch other pages. There are many applications of Crawler programs in search engines, business intelligence and malicious applications.