Skip to main content

What is Spidering ?

Image result for What is Spidering ?
Spiders are programs (or automated scripts) that 'crawl' through the Web looking for data.
Spiders travel through website URLs and can pull data from web pages like email addresses.
Spiders also are used to feed information found on websites to search engines.
Spiders, which are also referred to as 'web crawlers' search the Web and not all are friendly in their intent.
Spiders and other automated tools are used by spammers to find email addresses (on the internet this practice is often referred to as 'harvesting') on websites and then use them to create spam lists.
Spiders are also a tool used by search engines to find out more information about your website, but left unchecked, a website without instructions (or, 'permissions') on how to crawl your site can present major information security risks. Spiders travel by following links and they are very adept at finding links to databases, program files, and other information that you may not want them to have access to.
_________________________
Labels:

Comments

Post a Comment

Popular posts from this blog

What is SQL ?

SQL (Structured Query Language) is a standardized programming language used for managing relational databases and performing various operations on the data in them. Initially created in the 1970s, SQL is regularly used by database administrators, as well as by developers writing data integration scripts and data analysts looking to set up and run analytical queries. The uses of SQL include modifying database table and index structures; adding, updating and deleting rows of data; and retrieving subsets of information from within a database for transaction processing and analytics applications.  Queries and other SQL operations take the form of commands written as statements -- commonly used SQL statements include select, add, insert, update, delete, create, alter and truncate. _________________________
Post a Comment
Read more