A Parser for News Downloads

Mike Scott

Resumo


This paper presents the Download Parser, a tool for handling text downloads from large online databases. Many universities have access to full-text databases which allow the user to search their holdings and then view and ideally download the full text of relevant articles, but there are important problems in practice in managing such downloads, because of factors such as duplication, unevenness of formatting standards, lack of documentation. The tool under discussion was devised to parse downloads, clean them up and standardise them, identify headlines and insert suitably marked-up headers for corpus analysis.


Palavras-chave


News corpus; Corpus clean-up; Duplicate texts; Building sub-corpora

Texto completo:

PDF

Métricas do artigo

Carregando Métricas ...

Metrics powered by PLOS ALM


Revista Delta-Documentação e Estudos em Linguística Teórica e Aplicada ISSN 1678-460X