Search results for "Linear regression"

showing 10 items of 375 documents

Simulation in the Simple Linear Regression Model

2002

Summary This article presents an activity which simulates the linear regression model in order to verify the probabilistic behaviour of the resulting least-squares statistics in practice.

Statistics and ProbabilityPolynomial regressionGeneral linear modelProper linear modelMultivariate adaptive regression splinesComputer scienceStatisticsLinear modelApplied mathematicsPrincipal component regressionLog-linear modelSimple linear regressionEducationTeaching Statistics
researchProduct

Linear and ellipsoidal restrictions in linear regression

1991

The problem of combining linear and ellipsoidal restrictions in linear regression is investigated. Necessary and sufficient conditions for compactness of the restriction set are proved assuring the existence of a minimax estimator. When the restriction set is not compact a minimax estimator may still exist for special loss functions arid regression designs

Statistics and ProbabilityPolynomial regressionStatistics::TheoryMathematical optimizationProper linear modelLinear predictor functionBayesian multivariate linear regressionLinear regressionLinear modelPrincipal component regressionStatistics Probability and UncertaintySimple linear regressionMathematicsStatistics
researchProduct

Varying-coefficient functional linear regression models

2008

This article considers a generalization of the functional linear regression in which an additional real variable influences smoothly the functional coefficient. We thus define a varying-coefficient regression model for functional data. We propose two estimators based, respectively, on conditional functional principal regression and on local penalized regression splines and prove their pointwise consistency. We check, with the prediction one day ahead of ozone concentration in the city of Toulouse, the ability of such nonlinear functional approaches to produce competitive estimations.

Statistics and ProbabilityPolynomial regressionStatistics::TheoryProper linear modelMultivariate adaptive regression splines010504 meteorology & atmospheric sciencesLocal regression01 natural sciences62G05 (62G20 62M20)Statistics::ComputationNonparametric regressionStatistics::Machine Learning010104 statistics & probabilityLinear regressionStatisticsStatistics::Methodology0101 mathematicsSegmented regressionRegression diagnosticComputingMilieux_MISCELLANEOUS0105 earth and related environmental sciencesMathematics
researchProduct

Estimating regression models with unknown break-points.

2003

This paper deals with fitting piecewise terms in regression models where one or more break-points are true parameters of the model. For estimation, a simple linearization technique is called for, taking advantage of the linear formulation of the problem. As a result, the method is suitable for any regression model with linear predictor and so current software can be used; threshold modelling as function of explanatory variables is also allowed. Differences between the other procedures available are shown and relative merits discussed. Simulations and two examples are presented to illustrate the method.

Statistics and ProbabilityProper linear modelMultivariate adaptive regression splinesModels StatisticalEpidemiologyLinear modelDustMarginal modelSurvival AnalysisLinear predictor functionStatisticsLinear regressionChronic DiseaseApplied mathematicsHeart TransplantationHumansRegression AnalysisSegmented regressionBronchitisRegression diagnosticMathematicsStatistics in medicine
researchProduct

Testing with a nuisance parameter present only under the alternative: a score-based approach with application to segmented modelling

2016

ABSTRACTWe introduce a score-type statistic to test for a non-zero regression coefficient when the relevant term involves a nuisance parameter present only under the alternative. Despite the non-regularity and complexity of the problem and unlike the previous approaches, the proposed test statistic does not require the nuisance to be estimated. It is simple to implement by relying on the conventional distributions, such as Normal or t, and it justified in the setting of probabilistic coherence. We focus on testing for the existence of a breakpoint in segmented regression, and illustrate the methodology with an analysis on data of DNA copy number aberrations and gene expression profiles from…

Statistics and ProbabilityScore testscore testNuisance variablepiecewise linearthreshold valuecomputer.software_genre01 natural sciencesnon-standard inference010104 statistics & probability03 medical and health sciences0302 clinical medicineStatisticsLinear regressionTest statisticNuisance parameter0101 mathematicsSegmented regressionStatisticMathematicsApplied MathematicsProbabilistic logicBreakpoint detectionModeling and SimulationData miningStatistics Probability and UncertaintySettore SECS-S/01 - Statisticacomputer030217 neurology & neurosurgeryJournal of Statistical Computation and Simulation
researchProduct

The Induced Smoothed lasso: A practical framework for hypothesis testing in high dimensional regression.

2020

This paper focuses on hypothesis testing in lasso regression, when one is interested in judging statistical significance for the regression coefficients in the regression equation involving a lot of covariates. To get reliable p-values, we propose a new lasso-type estimator relying on the idea of induced smoothing which allows to obtain appropriate covariance matrix and Wald statistic relatively easily. Some simulation experiments reveal that our approach exhibits good performance when contrasted with the recent inferential tools in the lasso framework. Two real data analyses are presented to illustrate the proposed framework in practice.

Statistics and ProbabilityStatistics::TheoryInduced smoothingEpidemiologyComputer scienceFeature selectionWald test01 natural sciencesasthma researchStatistics::Machine Learning010104 statistics & probability03 medical and health sciencesHealth Information ManagementLasso (statistics)Linear regressionsparse modelsStatistics::MethodologyComputer Simulation0101 mathematicssandwich formula030304 developmental biologyStatistical hypothesis testing0303 health sciencesCovariance matrixlung functionRegression analysisStatistics::Computationsparse modelResearch DesignAlgorithmSmoothingvariable selectionStatistical methods in medical research
researchProduct

Reference Posterior Distributions for Bayesian Inference

1979

Statistics and Probabilitybusiness.industry010102 general mathematicsBayes factorPattern recognitionBayesian inference01 natural sciencesBayesian statistics010104 statistics & probabilityFrequentist inferenceFiducial inferenceStatistical inferenceBayesian experimental designArtificial intelligence0101 mathematicsBayesian linear regressionbusinessMathematicsJournal of the Royal Statistical Society: Series B (Methodological)
researchProduct

Electricity consumption prediction with functional linear regression using spline estimators

2010

A functional linear regression model linking observations of a functional response variable with measurements of an explanatory functional variable is considered. This model serves to analyse a real data set describing electricity consumption in Sardinia. The interest lies in predicting either oncoming weekends’ or oncoming weekdays’ consumption, provided actual weekdays’ consumption is known. A B-spline estimator of the functional parameter is used. Selected computational issues are addressed as well.

Statistics and Probabilitybusiness.industryB-splineEstimatorelectricity consumption in SardiniaSpline (mathematics)functional linear regressionfunctional responseB-splineARH(1)StatisticsEconometricspenalized least squareElectricityStatistics Probability and UncertaintybusinessFunctional linear regressionMathematicsJournal of Applied Statistics
researchProduct

Contributed discussion on article by Pratola

2016

The author should be commended for his outstanding contribution to the literature on Bayesian regression tree models. The author introduces three innovative sampling approaches which allow for efficient traversal of the model space. In this response, we add a fourth alternative.

Statistics and Probabilitymodel selectionMarkov Chain Monte Carlo (MCMC)Bayesian regression treeComputer scienceBig dataBayesian regression tree (BRT) modelsComputingMilieux_LEGALASPECTSOFCOMPUTINGbirth–death processMachine learningcomputer.software_genreSequential Monte Carlo methods01 natural sciencespopulation Markov chain Monte Carlo010104 statistics & probabilitysymbols.namesakebig data0502 economics and businessBayesian Regression Trees (BART)0101 mathematics050205 econometrics Bayesian treed regressionMultiple Try Metropolis algorithmsINFERÊNCIA ESTATÍSTICAbusiness.industryApplied MathematicsModel selection05 social sciencesRejection samplingData scienceVariable-order Bayesian networkTree (data structure)Tree traversalMarkov chain Monte Carlocontinuous time Markov processsymbolsArtificial intelligencebusinessBayesian linear regressioncommunication-freecomputerGibbs samplingBayesian Analysis
researchProduct

A multi-scale approach for testing and detecting peaks in time series

2020

An approach is presented that combines a statistical test for peak detection with the estimation of peak positions in time series. Motivated by empirical observations in neuronal recordings, we aim at investigating peaks of different heights and widths. We use a moving window approach to compare the differences of estimated slope coefficients of local regression models. We combine multiple windows and use the global maximum of all different processes as a test statistic. After rejection, a multiple filter algorithm combines peak positions estimated from multiple windows. Analysing neuronal activity recorded in anaesthetized mice, the procedure could identify significant differences between …

Statistics and Probabilitypeak detection ; multi-scale ; linear regression ; neuronal ensembles ; Brain statesSeries (mathematics)Scale (ratio)business.industry05 social sciencesPattern recognition01 natural sciencesPeak detection010104 statistics & probabilityBrain state0502 economics and businessLinear regressionArtificial intelligence0101 mathematicsStatistics Probability and Uncertaintybusiness050205 econometrics Statistical hypothesis testingMathematics
researchProduct