Search results for "Machine learning"
showing 10 items of 1464 documents
Classical Training Methods
2006
This chapter reviews classical training methods for multilayer neural networks. These methods are widely used for classification and function modelling tasks. Nevertheless, they show a number of flaws or drawbacks that should be addressed in the development of such systems. They work by searching the minimum of an error function which defines the optimal behaviour of the neural network. Different standard problems are used to show the capabilities of these models; in particular, we have benchmarked the algorithms in a nonlinear classification problem and in three function modelling problems.
Neural Networks with Multidimensional Cross-Entropy Loss Functions
2019
Deep neural networks have emerged as an effective machine learning tool successfully applied for many tasks, such as misinformation detection, natural language processing, image recognition, machine translation, etc. Neural networks are often applied to binary or multi-class classification problems. In these settings, cross-entropy is used as a loss function for neural network training. In this short note, we propose an extension of the concept of cross-entropy, referred to as multidimensional cross-entropy, and its application as a loss function for classification using neural networks. The presented computational experiments on a benchmark dataset suggest that the proposed approaches may …
Unbiased sensitivity analysis and pruning techniques in neural networks for surface ozone modelling
2005
Abstract This paper presents the use of artificial neural networks (ANNs) for surface ozone modelling. Due to the usual non-linear nature of problems in ecology, the use of ANNs has proven to be a common practice in this field. Nevertheless, few efforts have been made to acquire knowledge about the problems by analysing the useful, but often complex, input–output mapping performed by these models. In fact, researchers are not only interested in accurate methods but also in understandable models. In the present paper, we propose a methodology to extract the governing rules of trained ANN which, in turn, yields simplified models by using unbiased sensitivity and pruning techniques. Our propos…
An Adaptive Global-Local Memetic Algorithm to Discover Resources in P2P Networks
2007
This paper proposes a neural network based approach for solving the resource discovery problem in Peer to Peer (P2P) networks and an Adaptive Global Local Memetic Algorithm (AGLMA) for performing the training of the neural network. This training is very challenging due to the large number of weights and noise caused by the dynamic neural network testing. The AGLMA is a memetic algorithm consisting of an evolutionary framework which adaptively employs two local searchers having different exploration logic and pivot rules. Furthermore, the AGLMA makes an adaptive noise compensation by means of explicit averaging on the fitness values and a dynamic population sizing which aims to follow the ne…
A new method for optimal synthesis of wavelet-based neural networks suitable for identification purposes
1999
Abstract This paper deals with a new method for optimal synthesis of Wavelet-Based Neural Networks (WBNN) suitable for identification purposes. The method uses a genetic algorithm (GA) combined with a steepest descent technique and least square techniques for both optimal selection of the structure of the WBNN and its training. The method is applied for designing a predictor for a chaotic temporal series
Detecting rottenness caused by Penicillium genus fungi in citrus fruits using machine learning techniques
2012
Penicillium fungi are among the main defects that may affect the commercialization of citrus fruits. Economic losses in fruit production may become enormous if an early detection of that kind of fungi is not carried out. That early detection is usually based either on UltraViolet light carried out manually. This work presents a new approach based on hyperspectral imagery for defect segmentation. Both the physical device and the data processing (geometric corrections and band selection) are presented. Achieved results using classifiers based on Artificial Neural Networks and Decision Trees show an accuracy around 98%; it shows up the suitability of the proposed approach.
A Multi-layer Feed Forward Neural Network Approach for Diagnosing Diabetes
2018
Diabetes is one of the worlds major health problems according to the World Health Organization. Recent surveys indicate that there is an increase in the number of diabetic patients resulting in an increase in serious complications such as heart attacks and deaths. Early diagnosis of diabetes, particularly of type 2 diabetes, is critical since it is vital for patients to get insulin treatments. However, diagnoses could be difficult especially in areas with few medical doctors. It is, therefore, a need for practical methods for the public for early detection and prevention with minimal intervention from medical professionals. A promising method for automated diagnosis is the use of artificial…
Intrusion Detection with Interpretable Rules Generated Using the Tsetlin Machine
2020
The rapid deployment in information and communication technologies and internet-based services have made anomaly based network intrusion detection ever so important for safeguarding systems from novel attack vectors. To this date, various machine learning mechanisms have been considered to build intrusion detection systems. However, achieving an acceptable level of classification accuracy while preserving the interpretability of the classification has always been a challenge. In this paper, we propose an efficient anomaly based intrusion detection mechanism based on the Tsetlin Machine (TM). We have evaluated the proposed mechanism over the Knowledge Discovery and Data Mining 1999 (KDD’99) …
Artificial Neural Networks in Sports: New Concepts and Approaches
2001
Artificial neural networks are tools, which - similar to natural neural networks - can learn to recognize and classify patterns, and so can help to optimise context depending acting. These abilitie...
Efficient MLP Digital Implementation on FPGA
2005
The efficiency and the accuracy of a digital feed-forward neural networks must be optimized to obtain both high classification rate and minimum area on chip. In this paper an efficient MLP digital implementation. The key features of the hardware implementation are the virtual neuron based architecture and the use of the sinusoidal activation function for the hidden layer. The effectiveness of the proposed solutions has been evaluated developing different FPGA based neural prototypes for the High Energy Physics domain and the automatic Road Sign Recognition domain. The use of the sinusoidal activation function decreases hardware resource employment of about 32% when compared with the standar…