Article
Version 1
This version is not peer-reviewed
Document-Level Event Extraction with Definition-Driven ICL
Version 1
: Received: 10 August 2024 / Approved: 13 August 2024 / Online: 13 August 2024 (09:33:56 CEST)
How to cite: Liu, Z.; Luo, Y. Document-Level Event Extraction with Definition-Driven ICL. Preprints 2024, 2024080899. https://doi.org/10.20944/preprints202408.0899.v1 Liu, Z.; Luo, Y. Document-Level Event Extraction with Definition-Driven ICL. Preprints 2024, 2024080899. https://doi.org/10.20944/preprints202408.0899.v1
Abstract
In the field of Natural Language Processing (NLP), Large Language Models (LLMs) have shown great potential in document-level event extraction tasks, but existing methods face challenges in the design of prompts. To address this issue, we propose an optimization strategy called "Definition-driven Document-level Event Extraction (DDEE)." By adjusting the length of the prompt and enhancing the clarity of heuristics, we have significantly improved the event extraction performance of LLMs. We used data balancing techniques to solve the long-tail effect problem, enhancing the model's generalization ability for event types. At the same time, we refined the prompt to ensure it is both concise and comprehensive, adapting to the sensitivity of LLMs to the style of prompts. In addition, the introduction of structured heuristic methods and strict limiting conditions has improved the precision of event and argument role extraction. These strategies not only solve the prompt engineering problems of LLMs in document-level event extraction but also promote the development of event extraction technology, providing new research perspectives for other tasks in the NLP field.
Keywords
Event Extraction; aLarge Language Models; Prompt Engineering; Heuristic Clarity; Data Balancing; Document-level
Subject
Social Sciences, Language and Linguistics
Copyright: This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Comments (0)
We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.
Leave a public commentSend a private comment to the author(s)
* All users must log in before leaving a comment