Search results for "Linear"
showing 10 items of 7165 documents
Implicit differentiation for fast hyperparameter selection in non-smooth convex learning
2022
International audience; Finding the optimal hyperparameters of a model can be cast as a bilevel optimization problem, typically solved using zero-order techniques. In this work we study first-order methods when the inner optimization problem is convex but non-smooth. We show that the forward-mode differentiation of proximal gradient descent and proximal coordinate descent yield sequences of Jacobians converging toward the exact Jacobian. Using implicit differentiation, we show it is possible to leverage the non-smoothness of the inner problem to speed up the computation. Finally, we provide a bound on the error made on the hypergradient when the inner optimization problem is solved approxim…
Dimensionality Reduction via Regression in Hyperspectral Imagery
2015
This paper introduces a new unsupervised method for dimensionality reduction via regression (DRR). The algorithm belongs to the family of invertible transforms that generalize Principal Component Analysis (PCA) by using curvilinear instead of linear features. DRR identifies the nonlinear features through multivariate regression to ensure the reduction in redundancy between he PCA coefficients, the reduction of the variance of the scores, and the reduction in the reconstruction error. More importantly, unlike other nonlinear dimensionality reduction methods, the invertibility, volume-preservation, and straightforward out-of-sample extension, makes DRR interpretable and easy to apply. The pro…
A Unified SVM Framework for Signal Estimation
2013
This paper presents a unified framework to tackle estimation problems in Digital Signal Processing (DSP) using Support Vector Machines (SVMs). The use of SVMs in estimation problems has been traditionally limited to its mere use as a black-box model. Noting such limitations in the literature, we take advantage of several properties of Mercer's kernels and functional analysis to develop a family of SVM methods for estimation in DSP. Three types of signal model equations are analyzed. First, when a specific time-signal structure is assumed to model the underlying system that generated the data, the linear signal model (so called Primal Signal Model formulation) is first stated and analyzed. T…
The Max-Product Algorithm Viewed as Linear Data-Fusion: A Distributed Detection Scenario
2019
In this paper, we disclose the statistical behavior of the max-product algorithm configured to solve a maximum a posteriori (MAP) estimation problem in a network of distributed agents. Specifically, we first build a distributed hypothesis test conducted by a max-product iteration over a binary-valued pairwise Markov random field and show that the decision variables obtained are linear combinations of the local log-likelihood ratios observed in the network. Then, we use these linear combinations to formulate the system performance in terms of the false-alarm and detection probabilities. Our findings indicate that, in the hypothesis test concerned, the optimal performance of the max-product a…
Fast Estimation of Diffusion Tensors under Rician noise by the EM algorithm
2016
Diffusion tensor imaging (DTI) is widely used to characterize, in vivo, the white matter of the central nerve system (CNS). This biological tissue contains much anatomic, structural and orientational information of fibers in human brain. Spectral data from the displacement distribution of water molecules located in the brain tissue are collected by a magnetic resonance scanner and acquired in the Fourier domain. After the Fourier inversion, the noise distribution is Gaussian in both real and imaginary parts and, as a consequence, the recorded magnitude data are corrupted by Rician noise. Statistical estimation of diffusion leads a non-linear regression problem. In this paper, we present a f…
Bifurcation analysis of a TaO memristor model
2019
This paper presents a study of bifurcation in the time-averaged dynamics of TaO memristors driven by narrow pulses of alternating polarities. The analysis, based on a physics-inspired model, focuses on the stable fixed points and on how these are affected by the pulse parameters. Our main finding is the identification of a driving regime when two stable fixed points exist simultaneously. To the best of our knowledge, such bistability is identified in a single memristor for the first time. This result can be readily tested experimentally, and is expected to be useful in future memristor circuit designs.
The infinite dihedral group
2022
We describe the infinite dihedral group as automaton group. We collect basic results and give full proofs in details for all statements.
Quantifying non-periodicity of non-stationary time series through wavelets
2019
In this paper, we introduce a new wavelet tool for studying the degree of non-periodicity of time series that is based on some recently defined tools, such as the \textit{windowed scalogram} and the \textit{scale index}. It is especially appropriate for non-stationary time series whose characteristics change over time and so, it can be applied to a wide variety of disciplines. In addition, we revise the concept of the scale index and pose a theoretical problem: it is known that if the scale index of a function is not zero then it is non-periodic, but if the scale index of a function is zero, then it is not proved that it has to be periodic. This problem is solved for the particular case of …
Laplacian versus Adjacency Matrix in Quantum Walk Search
2015
A quantum particle evolving by Schr\"odinger's equation contains, from the kinetic energy of the particle, a term in its Hamiltonian proportional to Laplace's operator. In discrete space, this is replaced by the discrete or graph Laplacian, which gives rise to a continuous-time quantum walk. Besides this natural definition, some quantum walk algorithms instead use the adjacency matrix to effect the walk. While this is equivalent to the Laplacian for regular graphs, it is different for non-regular graphs, and is thus an inequivalent quantum walk. We algorithmically explore this distinction by analyzing search on the complete bipartite graph with multiple marked vertices, using both the Lapla…
Nonlinear quantum Langevin equations for bosonic modes in solid-state systems
2017
Based on the experimental evidence that impurities contribute to the dissipation properties of solid-state open quantum systems, we provide here a description in terms of nonlinear quantum Langevin equations of the role played by two-level systems in the dynamics of a bosonic degree of freedom. Our starting point is represented by the description of the system/environment coupling in terms of coupling to two separate reservoirs, modelling the interaction with external bosonic modes and two level systems, respectively. Furthermore, we show how this model represents a specific example of a class of open quantum systems that can be described by nonlinear quantum Langevin equations. Our analysi…