Search results for " Regression"
showing 10 items of 1835 documents
Multiple smoothing parameters selection in additive regression quantiles
2021
We propose an iterative algorithm to select the smoothing parameters in additive quantile regression, wherein the functional forms of the covariate effects are unspecified and expressed via B-spline bases with difference penalties on the spline coefficients. The proposed algorithm relies on viewing the penalized coefficients as random effects from the symmetric Laplace distribution, and it turns out to be very efficient and particularly attractive with multiple smooth terms. Through simulations we compare our proposal with some alternative approaches, including the traditional ones based on minimization of the Schwarz Information Criterion. A real-data analysis is presented to illustrate t…
Social capital and economic growth in Europe: nonlinear trends and heterogeneous regional effects
2016
After two decades of academic debate on the social capital-growth nexus, discussion still remains open. Most of the literature so far, however, has followed the one-size-its-all approach, neglecting that the great disparities across geographical units might have implications in this relationship. This article analyzes the role of two social capital indicators on the growth of 237 European regions in the period 1995–2007 by implementing a set of both parametric and non- parametric regressions. Whereas the former impose a linear functional form for the parameters, the latter relax this assumption providing a flexible frame in which the functional form is given by the data. The technique also …
Recursive estimation of the conditional geometric median in Hilbert spaces
2012
International audience; A recursive estimator of the conditional geometric median in Hilbert spaces is studied. It is based on a stochastic gradient algorithm whose aim is to minimize a weighted L1 criterion and is consequently well adapted for robust online estimation. The weights are controlled by a kernel function and an associated bandwidth. Almost sure convergence and L2 rates of convergence are proved under general conditions on the conditional distribution as well as the sequence of descent steps of the algorithm and the sequence of bandwidths. Asymptotic normality is also proved for the averaged version of the algorithm with an optimal rate of convergence. A simulation study confirm…
Quantile regression via iterative least squares computations
2012
We present an estimating framework for quantile regression where the usual L 1-norm objective function is replaced by its smooth parametric approximation. An exact path-following algorithm is derived, leading to the well-known ‘basic’ solutions interpolating exactly a number of observations equal to the number of parameters being estimated. We discuss briefly possible practical implications of the proposed approach, such as early stopping for large data sets, confidence intervals, and additional topics for future research.
Minimax estimation with additional linear restrictions - a simulation study
1988
Let the parameter vector of the ordinary regression model be constrained by linear equations and in addition known to lie in a given ellipsoid. Provided the weight matrix A of the risk function has rank one, a restricted minimax estimator exists which combines both types of prior information. For general n.n.d. A two estimators as alternatives to the unfeasible exact minimax estimator are developed by minimizing an upper and a lower bound of the maximal risk instead. The simulation study compares the proposed estimators with competing least-squares estimators where remaining unknown parameters are replaced by suitable estimates.
Segmented mixed models with random changepoints: a maximum likelihood approach with application to treatment for depression study
2014
We present a simple and effective iterative procedure to estimate segmented mixed models in a likelihood based framework. Random effects and covariates are allowed for each model parameter, including the changepoint. The method is practical and avoids the computational burdens related to estimation of nonlinear mixed effects models. A conventional linear mixed model with proper covariates that account for the changepoints is the key to our estimating algorithm. We illustrate the method via simulations and using data from a randomized clinical trial focused on change in depressive symptoms over time which characteristically show two separate phases of change.
Comparison between splines and fractional polynomials for multivariable model building with continuous covariates: a simulation study with continuous…
2012
In observational studies, many continuous or categorical covariates may be related to an outcome. Various spline-based procedures or the multivariable fractional polynomial (MFP) procedure can be used to identify important variables and functional forms for continuous covariates. This is the main aim of an explanatory model, as opposed to a model only for prediction. The type of analysis often guides the complexity of the final model. Spline-based procedures and MFP have tuning parameters for choosing the required complexity. To compare model selection approaches, we perform a simulation study in the linear regression context based on a data structure intended to reflect realistic biomedica…
Some extensions of multivariate sliced inverse regression
2007
Multivariate sliced inverse regression (SIR) is a method for achieving dimension reduction in regression problems when the outcome variable y and the regressor x are both assumed to be multidimensional. In this paper, we extend the existing approaches, based on the usual SIR I which only uses the inverse regression curve, to methods using properties of the inverse conditional variance. Contrary to the existing ones, these new methods are not blind for symmetric dependencies and rely on the SIR II or SIRα. We also propose their corresponding pooled slicing versions. We illustrate the usefulness of these approaches on simulation studies.
Asymptotics for pooled marginal slicing estimator based on SIRα approach
2005
Pooled marginal slicing (PMS) is a semiparametric method, based on sliced inverse regression (SIR) approach, for achieving dimension reduction in regression problems when the outcome variable y and the regressor x are both assumed to be multidimensional. In this paper, we consider the SIR"@a version (combining the SIR-I and SIR-II approaches) of the PMS estimator and we establish the asymptotic distribution of the estimated matrix of interest. Then the asymptotic normality of the eigenprojector on the estimated effective dimension reduction (e.d.r.) space is derived as well as the asymptotic distributions of each estimated e.d.r. direction and its corresponding eigenvalue.
Regression models for multivariate ordered responses via the Plackett distribution
2008
AbstractWe investigate the properties of a class of discrete multivariate distributions whose univariate marginals have ordered categories, all the bivariate marginals, like in the Plackett distribution, have log-odds ratios which do not depend on cut points and all higher-order interactions are constrained to 0. We show that this class of distributions may be interpreted as a discretized version of a multivariate continuous distribution having univariate logistic marginals. Convenient features of this class relative to the class of ordered probit models (the discretized version of the multivariate normal) are highlighted. Relevant properties of this distribution like quadratic log-linear e…