Focused document gathering on the Web for domain-specific information retrieval
type: Dataset
description: Vertical search engines, which focus on a specific segment of the Web, become more and more present in the Internet landscape. Topical search engines, notably, can obtain a significant performance boost by limiting their index on a specific topic. By doing so, language ambiguities are reduced, and both the algorithms and the user interface can take advantage of domain knowledge, such as domain objects or characteristics, to satisfy user information needs.In this thesis, we tackle the first inevitable step of a all topical search engine : focused document gathering from the Web. A thorough study of the state of art leads us to consider two strategies to gather topical documents from the Web: either relying on an existing search engine index (focused search) or directly crawling the Web (focused crawling).The first part of our research has been dedicated to focused search. In this context, a standard approach consists in combining domain-specific terms into queries, submitting those queries to a search engine and down- loading top ranked documents. After empirically evaluating this approach over 340 topics, we propose to enhance it in two different ways: Upstream of the search engine, we aim at formulating more relevant queries in or- der to increase the precision of the top retrieved documents. To do so, we define a metric based on a co-occurrence graph and a random walk algorithm, which aims at predicting the topical relevance of a query. Downstream of the search engine, we filter the retrieved documents in order to improve the document collection quality. We do so by modeling our gathering process as a tripartite graph and applying a random walk with restart algorithm so as to simultaneously order by relevance the documents and terms appearing in our corpus.In the second part of this thesis, we turn to focused crawling. We describe our focused crawler implementation that was designed to scale horizontally. Then, we consider the problem of crawl frontier ordering, w…
identifier: NNT: 2013PA112073
issued: 2026-05-10T01:16:09.615481
language: fr
modified: 2026-05-10T01:16:09.615486
contact point: Organization
  fn: CCSD
keyword: apprentissage-automatique
keyword: apprentissage-de-fonctions-dordonnancement
keyword: collecte-orientee
keyword: crawling-orientee
keyword: domain-specific-information-retrieval
keyword: focused-crawling
keyword: focused-search
keyword: infoeu-reposemanticsdoctoralthesis
keyword: infoinfo-ohcomputer-science-csother-csoh
keyword: information-retrieval
keyword: learning-to-rank
keyword: machine-learning
keyword: recherche-de-linformation
keyword: recherche-dinformation
keyword: recherche-orientee
keyword: theses
keyword: web
keyword: web-information-retrieval
landing page: https://theses.hal.science/tel-00853250

Focused document gathering on the Web for domain-specific information retrieval
type: Distribution
format: HTML
issued: 2026-05-10T01:16:09.620348
modified: 2026-05-10T01:16:09.593710
access URL: https://theses.hal.science/tel-00853250

test_moissonnage_selune
type: Agent