-
Can formal argumentative reasoning enhance LLMs performances?
Authors:
Federico Castagna,
Isabel Sassoon,
Simon Parsons
Abstract:
Recent years witnessed significant performance advancements in deep-learning-driven natural language models, with a strong focus on the development and release of Large Language Models (LLMs). These improvements resulted in better quality AI-generated output but rely on resource-expensive training and upgrading of models. Although different studies have proposed a range of techniques to enhance LL…
▽ More
Recent years witnessed significant performance advancements in deep-learning-driven natural language models, with a strong focus on the development and release of Large Language Models (LLMs). These improvements resulted in better quality AI-generated output but rely on resource-expensive training and upgrading of models. Although different studies have proposed a range of techniques to enhance LLMs without retraining, none have considered computational argumentation as an option. This is a missed opportunity since computational argumentation is an intuitive mechanism that formally captures agents' interactions and the information conflict that may arise during such interplays, and so it seems well-suited for boosting the reasoning and conversational abilities of LLMs in a seamless manner. In this paper, we present a pipeline (MQArgEng) and preliminary study to evaluate the effect of introducing computational argumentation semantics on the performance of LLMs. Our experiment's goal was to provide a proof-of-concept and a feasibility analysis in order to foster (or deter) future research towards a fully-fledged argumentation engine plugin for LLMs. Exploratory results using the MT-Bench indicate that MQArgEng provides a moderate performance gain in most of the examined topical categories and, as such, show promise and warrant further research.
△ Less
Submitted 16 May, 2024;
originally announced May 2024.
-
Online Handbook of Argumentation for AI: Volume 4
Authors:
Lars Bengel,
Lydia Blümel,
Elfia Bezou-Vrakatseli,
Federico Castagna,
Giulia D'Agostino,
Isabelle Kuhlmann,
Jack Mumford,
Daphne Odekerken,
Fabrizio Russo,
Stefan Sarkadi,
Madeleine Waller,
Andreas Xydis
Abstract:
This volume contains revised versions of the papers selected for the fourth volume of the Online Handbook of Argumentation for AI (OHAAI). Previously, formal theories of argument and argument interaction have been proposed and studied, and this has led to the more recent study of computational models of argument. Argumentation, as a field within artificial intelligence (AI), is highly relevant for…
▽ More
This volume contains revised versions of the papers selected for the fourth volume of the Online Handbook of Argumentation for AI (OHAAI). Previously, formal theories of argument and argument interaction have been proposed and studied, and this has led to the more recent study of computational models of argument. Argumentation, as a field within artificial intelligence (AI), is highly relevant for researchers interested in symbolic representations of knowledge and defeasible reasoning. The purpose of this handbook is to provide an open access and curated anthology for the argumentation research community. OHAAI is designed to serve as a research hub to keep track of the latest and upcoming PhD-driven research on the theory and application of argumentation in all areas related to AI.
△ Less
Submitted 20 December, 2023;
originally announced January 2024.
-
Computational Argumentation-based Chatbots: a Survey
Authors:
Federico Castagna,
Nadin Kokciyan,
Isabel Sassoon,
Simon Parsons,
Elizabeth Sklar
Abstract:
Chatbots are conversational software applications designed to interact dialectically with users for a plethora of different purposes. Surprisingly, these colloquial agents have only recently been coupled with computational models of arguments (i.e. computational argumentation), whose aim is to formalise, in a machine-readable format, the ordinary exchange of information that characterises human co…
▽ More
Chatbots are conversational software applications designed to interact dialectically with users for a plethora of different purposes. Surprisingly, these colloquial agents have only recently been coupled with computational models of arguments (i.e. computational argumentation), whose aim is to formalise, in a machine-readable format, the ordinary exchange of information that characterises human communications. Chatbots may employ argumentation with different degrees and in a variety of manners. The present survey sifts through the literature to review papers concerning this kind of argumentation-based bot, drawing conclusions about the benefits and drawbacks that this approach entails in comparison with standard chatbots, while also envisaging possible future development and integration with the Transformer-based architecture and state-of-the-art Large Language models.
△ Less
Submitted 7 January, 2024;
originally announced January 2024.
-
A Serverless Architecture for Efficient and Scalable Monte Carlo Markov Chain Computation
Authors:
Fabio Castagna,
Alberto Trombetta,
Marco Landoni,
Stefano Andreon
Abstract:
Computer power is a constantly increasing demand in scientific data analyses, in particular when Markov Chain Monte Carlo (MCMC) methods are involved, for example for estimating integral functions or Bayesian posterior probabilities. In this paper, we describe the benefits of a parallel computation of MCMC using a cloud-based, serverless architecture: first, the computation time can be spread over…
▽ More
Computer power is a constantly increasing demand in scientific data analyses, in particular when Markov Chain Monte Carlo (MCMC) methods are involved, for example for estimating integral functions or Bayesian posterior probabilities. In this paper, we describe the benefits of a parallel computation of MCMC using a cloud-based, serverless architecture: first, the computation time can be spread over thousands of processes, hence greatly reducing the time the user should wait to have its computation completed. Second, the overhead time required for running in parallel several processes is minor and grows logarithmically with respect to the number of processes. Third, the serverless approach does not require time-consuming efforts for maintaining and updating the computing infrastructure when/if the number of walkers increases or for adapting the code to optimally use the infrastructure. The benefits are illustrated with the computation of the posterior probability distribution of a real astronomical analysis.
△ Less
Submitted 6 October, 2023;
originally announced October 2023.
-
Online Handbook of Argumentation for AI: Volume 3
Authors:
Lars Bengel,
Elfia Bezou-Vrakatseli,
Lydia Blümel,
Federico Castagna,
Giulia D'Agostino,
Daphne Odekerken,
Minal Suresh Patil,
Jordan Robinson,
Hao Wu,
Andreas Xydis
Abstract:
This volume contains revised versions of the papers selected for the third volume of the Online Handbook of Argumentation for AI (OHAAI). Previously, formal theories of argument and argument interaction have been proposed and studied, and this has led to the more recent study of computational models of argument. Argumentation, as a field within artificial intelligence (AI), is highly relevant for…
▽ More
This volume contains revised versions of the papers selected for the third volume of the Online Handbook of Argumentation for AI (OHAAI). Previously, formal theories of argument and argument interaction have been proposed and studied, and this has led to the more recent study of computational models of argument. Argumentation, as a field within artificial intelligence (AI), is highly relevant for researchers interested in symbolic representations of knowledge and defeasible reasoning. The purpose of this handbook is to provide an open access and curated anthology for the argumentation research community. OHAAI is designed to serve as a research hub to keep track of the latest and upcoming PhD-driven research on the theory and application of argumentation in all areas related to AI.
△ Less
Submitted 15 December, 2022;
originally announced December 2022.
-
Online Handbook of Argumentation for AI: Volume 2
Authors:
OHAAI Collaboration,
Andreas Brannstrom,
Federico Castagna,
Theo Duchatelle,
Matt Foulis,
Timotheus Kampik,
Isabelle Kuhlmann,
Lars Malmqvist,
Mariela Morveli-Espinoza,
Jack Mumford,
Stipe Pandzic,
Robin Schaefer,
Luke Thorburn,
Andreas Xydis,
Antonio Yuste-Ginel,
Heng Zheng
Abstract:
This volume contains revised versions of the papers selected for the second volume of the Online Handbook of Argumentation for AI (OHAAI). Previously, formal theories of argument and argument interaction have been proposed and studied, and this has led to the more recent study of computational models of argument. Argumentation, as a field within artificial intelligence (AI), is highly relevant for…
▽ More
This volume contains revised versions of the papers selected for the second volume of the Online Handbook of Argumentation for AI (OHAAI). Previously, formal theories of argument and argument interaction have been proposed and studied, and this has led to the more recent study of computational models of argument. Argumentation, as a field within artificial intelligence (AI), is highly relevant for researchers interested in symbolic representations of knowledge and defeasible reasoning. The purpose of this handbook is to provide an open access and curated anthology for the argumentation research community. OHAAI is designed to serve as a research hub to keep track of the latest and upcoming PhD-driven research on the theory and application of argumentation in all areas related to AI.
△ Less
Submitted 23 June, 2021; v1 submitted 16 June, 2021;
originally announced June 2021.
-
Online Handbook of Argumentation for AI: Volume 1
Authors:
OHAAI Collaboration,
Federico Castagna,
Timotheus Kampik,
Atefeh Keshavarzi Zafarghandi,
Mickaël Lafages,
Jack Mumford,
Christos T. Rodosthenous,
Samy Sá,
Stefan Sarkadi,
Joseph Singleton,
Kenneth Skiba,
Andreas Xydis
Abstract:
This volume contains revised versions of the papers selected for the first volume of the Online Handbook of Argumentation for AI (OHAAI). Previously, formal theories of argument and argument interaction have been proposed and studied, and this has led to the more recent study of computational models of argument. Argumentation, as a field within artificial intelligence (AI), is highly relevant for…
▽ More
This volume contains revised versions of the papers selected for the first volume of the Online Handbook of Argumentation for AI (OHAAI). Previously, formal theories of argument and argument interaction have been proposed and studied, and this has led to the more recent study of computational models of argument. Argumentation, as a field within artificial intelligence (AI), is highly relevant for researchers interested in symbolic representations of knowledge and defeasible reasoning. The purpose of this handbook is to provide an open access and curated anthology for the argumentation research community. OHAAI is designed to serve as a research hub to keep track of the latest and upcoming PhD-driven research on the theory and application of argumentation in all areas related to AI.
△ Less
Submitted 22 June, 2020;
originally announced June 2020.
