Obligation And Prohibition Extraction Using Hierarchical Rnns | Awesome LLM Papers

Obligation And Prohibition Extraction Using Hierarchical Rnns

Ilias Chalkidis, Ion Androutsopoulos, Achilleas Michos Β· Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) Β· 2018

We consider the task of detecting contractual obligations and prohibitions. We show that a self-attention mechanism improves the performance of a BILSTM classifier, the previous state of the art for this task, by allowing it to focus on indicative tokens. We also introduce a hierarchical BILSTM, which converts each sentence to an embedding, and processes the sentence embeddings to classify each sentence. Apart from being faster to train, the hierarchical BILSTM outperforms the flat one, even when the latter considers surrounding sentences, because the hierarchical model has a broader discourse view.

Similar Work
Loading…