6533b856fe1ef96bd12b2670

RESEARCH PRODUCT

Impact of textual data augmentation on linguistic pattern extraction to improve the idiomaticity of extractive summaries

Laurent GautierChristophe CruzAbdelghani Laifa

subject

VocabularyProcess (engineering)Computer sciencemedia_common.quotation_subjectLinguistic PatternsDeep learning02 engineering and technologyLexiconTerminology[SHS.LANGUE] Humanities and Social Sciences/LinguisticsLinguisticsField (computer science)Focus (linguistics)TerminologyText summarisationCorpus linguistics0202 electrical engineering electronic engineering information engineeringCorpus Linguistics020201 artificial intelligence & image processingRelevance (information retrieval)[SHS.LANGUE]Humanities and Social Sciences/Linguisticsmedia_commonNatural Language Processing

description

International audience; The present work aims to develop a text summarisation system for financial texts with a focus on the fluidity of the target language. Linguistic analysis shows that the process of writing summaries should take into account not only terminological and collocational extraction, but also a range of linguistic material referred to here as the "support lexicon", that plays an important role in the cognitive organisation of the field. On this basis, this paper highlights the relevance of pre-training the CamemBERT model on a French financial dataset to extend its domainspecific vocabulary and fine-tuning it on extractive summarisation. We then evaluate the impact of textual data augmentation, improving the performance of our extractive text summarisation model by up to 6%-11%.

https://hal.archives-ouvertes.fr/hal-03271380