Search results for "Linear"

showing 10 items of 7165 documents

Kernel methods and their derivatives: Concept and perspectives for the earth system sciences.

2020

Kernel methods are powerful machine learning techniques which implement generic non-linear functions to solve complex tasks in a simple way. They Have a solid mathematical background and exhibit excellent performance in practice. However, kernel machines are still considered black-box models as the feature mapping is not directly accessible and difficult to interpret.The aim of this work is to show that it is indeed possible to interpret the functions learned by various kernel methods is intuitive despite their complexity. Specifically, we show that derivatives of these functions have a simple mathematical formulation, are easy to compute, and can be applied to many different problems. We n…

FOS: Computer and information sciencesComputer Science - Machine LearningSupport Vector MachineTheoretical computer scienceComputer scienceEntropyKernel FunctionsNormal Distribution0211 other engineering and technologies02 engineering and technologyMachine Learning (cs.LG)Machine LearningStatistics - Machine LearningSimple (abstract algebra)0202 electrical engineering electronic engineering information engineeringOperator TheoryData ManagementMultidisciplinaryGeographyApplied MathematicsSimulation and ModelingQRDensity estimationKernel methodKernel (statistics)Physical SciencessymbolsMedicine020201 artificial intelligence & image processingAlgorithmsResearch ArticleComputer and Information SciencesScienceMachine Learning (stat.ML)Research and Analysis MethodsKernel MethodsKernel (linear algebra)symbols.namesakeArtificial IntelligenceSupport Vector MachinesHumansEntropy (information theory)Computer SimulationGaussian process021101 geological & geomatics engineeringData VisualizationCorrectionRandom VariablesFunction (mathematics)Probability TheorySupport vector machineAlgebraPhysical GeographyLinear AlgebraEarth SciencesEigenvectorsRandom variableMathematicsEarth SystemsPLoS ONE
researchProduct

Deep Non-Line-of-Sight Reconstruction

2020

The recent years have seen a surge of interest in methods for imaging beyond the direct line of sight. The most prominent techniques rely on time-resolved optical impulse responses, obtained by illuminating a diffuse wall with an ultrashort light pulse and observing multi-bounce indirect reflections with an ultrafast time-resolved imager. Reconstruction of geometry from such data, however, is a complex non-linear inverse problem that comes with substantial computational demands. In this paper, we employ convolutional feed-forward networks for solving the reconstruction problem efficiently while maintaining good reconstruction quality. Specifically, we devise a tailored autoencoder architect…

FOS: Computer and information sciencesComputer Science - Machine Learningbusiness.industryComputer scienceComputer Vision and Pattern Recognition (cs.CV)Image and Video Processing (eess.IV)Computer Science - Computer Vision and Pattern RecognitionNonlinear optics020207 software engineering02 engineering and technologyIterative reconstructionInverse problemElectrical Engineering and Systems Science - Image and Video ProcessingAutoencoderRendering (computer graphics)Machine Learning (cs.LG)Non-line-of-sight propagation0202 electrical engineering electronic engineering information engineeringFOS: Electrical engineering electronic engineering information engineering020201 artificial intelligence & image processingComputer visionArtificial intelligencebusiness
researchProduct

Dual Extrapolation for Sparse Generalized Linear Models

2020

International audience; Generalized Linear Models (GLM) form a wide class of regression and classification models, where prediction is a function of a linear combination of the input variables. For statistical inference in high dimension, sparsity inducing regularizations have proven to be useful while offering statistical guarantees. However, solving the resulting optimization problems can be challenging: even for popular iterative algorithms such as coordinate descent, one needs to loop over a large number of variables. To mitigate this, techniques known as screening rules and working sets diminish the size of the optimization problem at hand, either by progressively removing variables, o…

FOS: Computer and information sciencesComputer Science - Machine Learningextrapolation[MATH.MATH-OC] Mathematics [math]/Optimization and Control [math.OC]Machine Learning (stat.ML)working setsgeneralized linear models[STAT.ML] Statistics [stat]/Machine Learning [stat.ML]Convex optimizationscreening rulesMachine Learning (cs.LG)[STAT.ML]Statistics [stat]/Machine Learning [stat.ML]Statistics - Machine Learning[MATH.MATH-OC]Mathematics [math]/Optimization and Control [math.OC]Lassosparse logistic regression
researchProduct

Kernel Anomalous Change Detection for Remote Sensing Imagery

2020

Anomalous change detection (ACD) is an important problem in remote sensing image processing. Detecting not only pervasive but also anomalous or extreme changes has many applications for which methodologies are available. This paper introduces a nonlinear extension of a full family of anomalous change detectors. In particular, we focus on algorithms that utilize Gaussian and elliptically contoured (EC) distribution and extend them to their nonlinear counterparts based on the theory of reproducing kernels' Hilbert space. We illustrate the performance of the kernel methods introduced in both pervasive and ACD problems with real and simulated changes in multispectral and hyperspectral imagery w…

FOS: Computer and information sciencesComputer scienceGaussianComputer Vision and Pattern Recognition (cs.CV)Multispectral imageComputer Science - Computer Vision and Pattern Recognition0211 other engineering and technologiesMachine Learning (stat.ML)02 engineering and technologysymbols.namesakeStatistics - Machine LearningElectrical and Electronic Engineering021101 geological & geomatics engineeringbusiness.industryHilbert spaceHyperspectral imagingPattern recognitionNonlinear systemKernel methodKernel (image processing)13. Climate actionsymbolsGeneral Earth and Planetary SciencesArtificial intelligencebusinessChange detection
researchProduct

Upperbounds on the probability of finding marked connected components using quantum walks

2019

Quantum walk search may exhibit phenomena beyond the intuition from a conventional random walk theory. One of such examples is exceptional configuration phenomenon -- it appears that it may be much harder to find any of two or more marked vertices, that if only one of them is marked. In this paper, we analyze the probability of finding any of marked vertices in such scenarios and prove upper bounds for various sets of marked vertices. We apply the upper bounds to large collection of graphs and show that the quantum search may be slow even when taking real-world networks.

FOS: Computer and information sciencesDiscrete Mathematics (cs.DM)FOS: Physical sciences01 natural sciencesUpper and lower bounds010305 fluids & plasmasTheoretical Computer Science0103 physical sciencesFOS: MathematicsMathematics - CombinatoricsQuantum walkElectrical and Electronic Engineering010306 general physicsQuantum computerMathematicsDiscrete mathematicsConnected componentQuantum PhysicsStatistical and Nonlinear PhysicsRandom walkQuantum searchElectronic Optical and Magnetic MaterialsModeling and SimulationSignal ProcessingCombinatorics (math.CO)Quantum Physics (quant-ph)Stationary stateComputer Science - Discrete Mathematics
researchProduct

Computational Limitations of Affine Automata

2019

We present two new results on the computational limitations of affine automata. First, we show that the computation of bounded-error rational-values affine automata is simulated in logarithmic space. Second, we give an impossibility result for algebraic-valued affine automata. As a result, we identify some unary languages (in logarithmic space) that are not recognized by algebraic-valued affine automata with cutpoints.

FOS: Computer and information sciencesDiscrete mathematics050101 languages & linguisticsTheoryofComputation_COMPUTATIONBYABSTRACTDEVICESUnary operationFormal Languages and Automata Theory (cs.FL)Computer scienceComputation05 social sciencesComputer Science - Formal Languages and Automata Theory02 engineering and technology[INFO.INFO-DM]Computer Science [cs]/Discrete Mathematics [cs.DM]Nonlinear Sciences::Cellular Automata and Lattice GasesLogarithmic spaceAutomatonTheoryofComputation_MATHEMATICALLOGICANDFORMALLANGUAGES0202 electrical engineering electronic engineering information engineering020201 artificial intelligence & image processing0501 psychology and cognitive sciencesAffine transformationImpossibilityComputer Science::Formal Languages and Automata TheoryComputingMilieux_MISCELLANEOUS
researchProduct

The quantum query complexity of certification

2009

We study the quantum query complexity of finding a certificate for a d-regular, k-level balanced NAND formula. Up to logarithmic factors, we show that the query complexity is Theta(d^{(k+1)/2}) for 0-certificates, and Theta(d^{k/2}) for 1-certificates. In particular, this shows that the zero-error quantum query complexity of evaluating such formulas is O(d^{(k+1)/2}) (again neglecting a logarithmic factor). Our lower bound relies on the fact that the quantum adversary method obeys a direct sum theorem.

FOS: Computer and information sciencesDiscrete mathematicsQuantum Physics0209 industrial biotechnologyNuclear and High Energy PhysicsQuantum queryComputer scienceDirect sumFOS: Physical sciencesGeneral Physics and AstronomyStatistical and Nonlinear Physics0102 computer and information sciences02 engineering and technologyCertificationComputational Complexity (cs.CC)Certificate01 natural sciencesTheoretical Computer ScienceComputer Science - Computational Complexity020901 industrial engineering & automationComputational Theory and Mathematics010201 computation theory & mathematicsQuantum Physics (quant-ph)QuantumMathematical PhysicsQuantum Information and Computation
researchProduct

Futures pricing in electricity markets based on stable CARMA spot models

2012

We present a new model for the electricity spot price dynamics, which is able to capture seasonality, low-frequency dynamics and the extreme spikes in the market. Instead of the usual purely deterministic trend we introduce a non-stationary independent increments process for the low-frequency dynamics, and model the large uctuations by a non-Gaussian stable CARMA process. The model allows for analytic futures prices, and we apply these to model and estimate the whole market consistently. Besides standard parameter estimation, an estimation procedure is suggested, where we t the non-stationary trend using futures data with long time until delivery, and a robust L 1 -lter to nd the states of …

FOS: Computer and information sciencesEconomics and EconometricsElectricity spot pricebusiness.industryEstimation theoryRisk premium60G52 62M10 91B84 (Primary) 60G10 60G51 91B70 (Secondary)Lévy processStatistics - ApplicationsCARMA model electricity spot prices electricity forward prices continuous time linear model Lévy process stable CARMA process risk premium robust filterddc:MicroeconomicsFOS: Economics and businessGeneral EnergyBase load power plantPeak loadEconometricsEconomicsApplications (stat.AP)ElectricityPricing of Securities (q-fin.PR)businessFutures contractQuantitative Finance - Pricing of Securities
researchProduct

Parity Oblivious d-Level Random Access Codes and Class of Noncontextuality Inequalities

2016

One of the fundamental results in quantum foundations is the Kochen-Specker no-go theorem. For the quantum theory, the no-go theorem excludes the possibility of a class of hidden variable models where value attribution is context independent. Recently, the notion of contextuality has been generalized for different operational procedures and it has been shown that preparation contextuality of mixed quantum states can be a useful resource in an information-processing task called parity-oblivious multiplexing. Here, we introduce a new class of information processing tasks, namely d-level parity oblivious random access codes and obtain bounds on the success probabilities of performing such task…

FOS: Computer and information sciencesExistential quantificationComputer Science - Information TheoryFOS: Physical sciences01 natural sciences010305 fluids & plasmasTheoretical Computer ScienceQuantum state0103 physical sciencesElectrical and Electronic Engineering010306 general physicsQuantumMathematicsQuantum computerDiscrete mathematicsQuantum PhysicsInformation Theory (cs.IT)Statistical and Nonlinear PhysicsParity (physics)Electronic Optical and Magnetic MaterialsKochen–Specker theoremModeling and SimulationSignal ProcessingOnticQuantum Physics (quant-ph)Random access
researchProduct

New Results on Vector and Homing Vector Automata

2019

We present several new results and connections between various extensions of finite automata through the study of vector automata and homing vector automata. We show that homing vector automata outperform extended finite automata when both are defined over $ 2 \times 2 $ integer matrices. We study the string separation problem for vector automata and demonstrate that generalized finite automata with rational entries can separate any pair of strings using only two states. Investigating stateless homing vector automata, we prove that a language is recognized by stateless blind deterministic real-time version of finite automata with multiplication iff it is commutative and its Parikh image is …

FOS: Computer and information sciencesFinite-state machineTheoretical computer scienceTheoryofComputation_COMPUTATIONBYABSTRACTDEVICESFormal Languages and Automata Theory (cs.FL)Computer science010102 general mathematicsComputer Science - Formal Languages and Automata Theory0102 computer and information sciencesNonlinear Sciences::Cellular Automata and Lattice Gases01 natural sciencesAutomatonTheoryofComputation_MATHEMATICALLOGICANDFORMALLANGUAGES010201 computation theory & mathematicsComputer Science (miscellaneous)0101 mathematicsComputer Science::Formal Languages and Automata TheoryHoming (hematopoietic)
researchProduct