A: A website crawler is a software program designed to follow hyperlinks throughout a Web site, retrieving and indexing pages to document the site for searching purposes.
A: A website crawler is a software program designed to follow hyperlinks throughout a Web site, retrieving and indexing pages to document the site for searching purposes.
一个网站爬虫是设计在整个一个网络站点跟随超连接的一个软件程序，检索并且索引页记录为寻找目的地点。