Methods and apparatus for performing intelligent crawling are provided. Particularly, the intelligent crawling techniques of the invention provide a crawler mechanism which is capable of learning as it crawls in order to focus the search for documents on the information network being explored, e.g.,...http://www.google.de/patents/US8060816?utm_source=gb-gplus-sharePatent US8060816 - Methods and apparatus for intelligent crawling on the world wide web
