6533b7d9fe1ef96bd126cd4f
RESEARCH PRODUCT
Using Tsetlin Machine to discover interpretable rules in natural language processing applications
Rupsa SahaMorten GoodwinOle-christoffer Granmosubject
Artificial intelligenceComputer sciencebusiness.industryNatural language processingRule miningcomputer.software_genreInterpretable AITheoretical Computer ScienceSemantic analysesComputational Theory and MathematicsMulti-turn dialogue analysesArtificial IntelligenceControl and Systems EngineeringArtificial intelligencebusinesscomputerVDP::Teknologi: 500::Informasjons- og kommunikasjonsteknologi: 550Natural language processingdescription
Tsetlin Machines (TM) use finite state machines for learning and propositional logic to represent patterns. The resulting pattern recognition approach captures information in the form of conjunctive clauses, thus facilitating human interpretation. In this work, we propose a TM-based approach to three common natural language processing (NLP) tasks, namely, sentiment analysis, semantic relation categorization and identifying entities in multi-turn dialogues. By performing frequent itemset mining on the TM-produced patterns, we show that we can obtain a global and a local interpretation of the learning, one that mimics existing rule-sets or lexicons. Further, we also establish that our TM based approach does not compromise on accuracy in the quest for interpretability, via comparison with some widely used machine learning techniques. Finally, we introduce the idea of a relational TM, which uses a logic-based framework to further extend the interpretability.
year | journal | country | edition | language |
---|---|---|---|---|
2021-11-12 |