Search results for "Correctness"
showing 10 items of 69 documents
A comprehensive study of automatic program repair on the QuixBugs benchmark
2021
Abstract Automatic program repair papers tend to repeatedly use the same benchmarks. This poses a threat to the external validity of the findings of the program repair research community. In this paper, we perform an empirical study of automatic repair on a benchmark of bugs called QuixBugs, which has been little studied. In this paper, (1) We report on the characteristics of QuixBugs; (2) We study the effectiveness of 10 program repair tools on it; (3) We apply three patch correctness assessment techniques to comprehensively study the presence of overfitting patches in QuixBugs. Our key results are: (1) 16/40 buggy programs in QuixBugs can be repaired with at least a test suite adequate pa…
Automated Patch Assessment for Program Repair at Scale
2021
AbstractIn this paper, we do automatic correctness assessment for patches generated by program repair systems. We consider the human-written patch as ground truth oracle and randomly generate tests based on it, a technique proposed by Shamshiri et al., called Random testing with Ground Truth (RGT) in this paper. We build a curated dataset of 638 patches for Defects4J generated by 14 state-of-the-art repair systems, we evaluate automated patch assessment on this dataset. The results of this study are novel and significant: First, we improve the state of the art performance of automatic patch assessment with RGT by 190% by improving the oracle; Second, we show that RGT is reliable enough to h…
A framework for evaluating student interaction with automatically assessed exercises
2016
Automatic assessment has become a widely used technique in programming courses. Even though modern techniques can practically ensure functional correctness of student solutions, it is less clear how to promote quality interaction between students and the automatic assessment systems. In this article we propose a simple analytical framework for studying student interaction with the automatic assessment systems and use it to study our functional programming course.
Towards CNC Programming Using Haskell
2004
Recent advances in Computerized Numeric Control (CNC) have allowed the manufacturing of products with high quality standards. Since CNC programs consist of a series of assembler-like instructions, several high-level languages (e.g., AutoLISP, APL, OMAC) have been proposed to raise the programming abstraction level. Unfortunately, the lack of a clean semantics prevents the development of formal tools for the analysis and manipulation of programs. In this work, we propose the use of Haskell for CNC programming. The declarative nature of Haskell provides an excellent basis to develop program analysis and manipulation tools and, most importantly, to formally prove their correctness.
Adaptive Contention Resolution for VoIP Services in the IEEE 802.16 Networks
2007
In the IEEE 802.16 networks, a subscriber station can use the contention slots to send bandwidth requests to the base station. The contention resolution mechanism is controlled by the backoff start/end values and a number of the request transmission opportunities. These parameters are set by the base station and are announced to subscriber stations in the management messages. In the case of the VoIP services, it is critical that the contention resolution occurs within the specified time interval to meet the VoIP QoS requirements. Thus, it is the responsibility of the base station to set correct contention resolution parameters to ensure the QoS requirements. This paper presents analytical c…
Heuristic Method to Improve Systematic Collection of Terminology
2016
In this paper, we propose an experimental tool for analysis and graphical representation of glossaries. The original heuristic algorithms and analysis methods incorporated into the tool appeared to be useful to improve the quality of the glossaries. The tool was used for analysis of ISTQB Standard Glossary of Terms Used in Software Testing. There are instances of problems found in ISTQB glossary related to its consistency, completeness, and correctness described in the paper.
Input-output feedback linearizing control of linear induction motor taking into consideration the end-effects. Part I: Theoretical analysis
2015
Abstract This first part of a paper, divided into two parts, deals with the theoretical formulation of the input–output feedback linearization (FL) control technique as to be applied to linear induction motors (LIMs). Linear induction motors, differently from rotating induction motors (RIMs), present other strong non-linearities caused by the so-called dynamic end effects, leading to a space-vector model with time-varying inductance and resistance terms and an additional braking force term. This paper, starting from a dynamic model of the LIM taking into consideration its dynamic end effects, previously developed by the same authors, defines a feedback linearization (FL) technique suited fo…
A KST-BASED SYSTEM FOR STUDENT TUTORING
2008
Abstract: A novel assessment procedure based on knowledge space theory (KST) is presented along with a complete implementation of an intelligent tutoring system. (ITS) that has been used to test our theoretical findings. The key idea is that correct assessment of the student knowledge is strictly related to the structure of the domain ontology. Suitable relationships between the concepts must be present to allow the creation of a reverse path from the "knowledge state" representing the student goal to the one that contains her actual knowledge about this topic. Knowledge space theory is a very good framework to guide the process of building the ontology used, by the artificial tutor The sys…
PGAC: A Parallel Genetic Algorithm for Data Clustering
2005
Cluster analysis is a valuable tool for exploratory pattern analysis, especially when very little a priori knowledge about the data is available. Distributed systems, based on high speed intranet connections, provide new tools in order to design new and faster clustering algorithms. Here, a parallel genetic algorithm for clustering called PGAC is described. The used strategy of parallelization is the island model paradigm where different populations of chromosomes (called demes) evolve locally to each processor and from time to time some individuals are moved from one deme to another. Experiments have been performed for testing the benefits of the parallelisation paradigm in terms of comput…
Adaptation of elaborated feedback in e-learning
2008
Design of feedback is a critical issue of online assessment development within Web-based Learning Systems (WBLSs). In our work we demonstrate the possibilities of tailoring the feedback to the students’ learning style (LS), certitude in response and its correctness. We observe in the experimental studies that these factors have a significant influence on the feedback preferences of students and the effectiveness of elaborated feedback (EF), i.e. students’ performance improvement during the test. These observations helped us to develop a simple EF recommendation approach. Our experimental study shows that (1) many students are eager to follow the recommendations on necessity to read certain …