Parsing with subdomain instance weighting from raw corpora
| Authors |
|
|---|---|
| Publication date | 2008 |
| Journal | Interspeech |
| Event | 9th Annual Conference of the International Speech Communication Association (Interspeech 2008), Brisbane, Australia |
| Volume | Issue number | 9 |
| Pages (from-to) | 2540 |
| Organisations |
|
| Abstract |
The treebanks that are used for training statistical parsers consist of hand-parsed sentences from a single source/domain like newspaper text. However, newspaper text concerns different subdomains of language use (e.g. finance, sports, politics, music), which implies that the statistics gathered by generative statistical parsers are averages over subdomain statistics. In this paper we explore a method, subdomain instance-weighting, that exploits raw subdomain corpora for introducing subdomain statistics into a state-of-the-art generative parser. We employ instance-weighting for creating an ensemble of subdomain specific versions of the parser, and explore methods for amalgamating their predictions. Our experiments show that subdomain statistics extracted from raw corpora can even improve the quality of the n-best lists of a formidable, state-of-the-art parser.
|
| Document type | Article |
| Note | Proceedings title: Proceedings of the 9th Annual Conference of the International Speech Communication Association (Interspeech 2008): incorporating the 12th Australian International Conference on Speech Science and Technology (SST 2008): 22-26 September 2008, Brisbane, Australia Publisher: International Speech Communication Association |
| Language | English |
| Published at | https://www.isca-speech.org/archive/interspeech_2008/i08_2540.html http://www.let.rug.nl/~bplank/papers/interspeech2008.pdf |
| Permalink to this page | |