An Algorithm for Least-Squares Estimation of Nonlinear Parameters
Get full access to this article
View all available purchase options and get full access to this article.
References
1.
G. W. Booth, G. E. P. Box, M. E. Muller, T. I. Peterson, Forecasting by Generalized Regression Methods, Nonlinear Estimation (Princeton—IBM), Mimeo. (IBM Share Program No. 687 WL NL1), International Business Machines Corp., 1959
2.
G. E. P. Box, G. A. Coutie, Application of digital computers in the exploration of functional relationships, Proc. Inst. Elec. Engrs. B, 103 (1957), 100–107
3.
Haskell B. Curry, The method of steepest descent for non-linear minimization problems, Quart. Appl. Math., 2 (1944), 258–261
4.
H. O. Hartley, The modified Gauss-Newton method for the fitting of non-linear regression functions by least squares, Technometrics, 3 (1961), 269–280
5.
D. W. Marquardt, Chem. Eng. Progr., 55 (1959), 65–70
6.
D. W. Marquardt, R. G. Bennett, E. J. Burrell, Jour. Molec. Spectroscopy, 7 (1961), 269–279
7.
D. D. Morrison, Methods for nonlinear least squares problems and convergence proofs, Tracking Programs and Orbit Determination, Proc. Jet Propulsion Laboratory Seminar, 1960, 1–9
8.
Kenneth Levenberg, A method for the solution of certain non-linear problems in least squares, Quart. Appl. Math., 2 (1944), 164–168
Information & Authors
Information
Published In
Copyright
Copyright © 1963 Society for Industrial and Applied Mathematics.
History
Submitted: 13 June 1962
Published online: 13 July 2006
Authors
Metrics & Citations
Metrics
Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited By
- DAMO: A Deep Solver for Arbitrary Marker Configuration in Optical Motion CaptureACM Transactions on Graphics, Vol. 44, No. 1 | 1 October 2024
- A machine learning paradigm for necessary observations to reduce uncertainties in aerosol climate forcingNature Communications, Vol. 15, No. 1 | 27 September 2024
- Wavelet-based arcing signal source localization algorithm using a compact multi-square microstrip antennaScientific Reports, Vol. 14, No. 1 | 1 October 2024
- Prediction of rod-like particle mixing in rotary drums by three machine learning methods based on DEM simulation dataPowder Technology, Vol. 448 | 1 Dec 2024
- Parameter estimation-based discrimination method for osteoporosis stage with ultrasound bone densitometerScientific Reports, Vol. 14, No. 1 | 3 October 2024
- Machine learning models for vapor-liquid equilibrium of binary mixtures: State of the art and future opportunitiesChemical Engineering Research and Design, Vol. 211 | 1 Nov 2024
- Layer‐specific BOLD effects in gradient and spin‐echo acquisitions in somatosensory cortexMagnetic Resonance in Medicine, Vol. 43 | 7 October 2024
- Optimal experiment design for inverse problems via selective normalization and zero-shift timesJournal of Inverse and Ill-posed Problems | 5 October 2024
- Green Synthesis Study: Adsorption of Congo Red Dye with Selenium Nanoparticles Obtained from Prunus Armeniaca L. Leaf WasteChemistrySelect, Vol. 9, No. 37 | 1 October 2024
- Viscoelasticity estimation of sports prosthesis by energy-minimizing inverse kinematics and its validation by forward dynamicsAdvanced Robotics, Vol. 5 | 4 October 2024
- Aerodynamic Characterization of a Hypersonic Projectile Using Acceleration-Based Measurements and Numerical MethodsJournal of Spacecraft and Rockets | 1 October 2024
- Generic and Specific Models for Volume Estimation in Forest and Savanna Phytophysiognomies in Brazilian CerradoPlants, Vol. 13, No. 19 | 3 October 2024
- Physico-thermal and geochemical behavior and alteration of the Au indicator gangue hydrothermal quartz at the Kubi Gold Ore DepositsJournal of African Earth Sciences, Vol. 90 | 1 Oct 2024
- Excess Thermodynamic Properties and FTIR Studies of Binary Mixtures of Toluene with 2-Propanol or 2-Methyl-1-PropanolMolecules, Vol. 29, No. 19 | 4 October 2024
- Ferroelectric hydrogels from amino acids and oleic acidiScience, Vol. 27, No. 9 | 1 Sep 2024
- Resolution of multiple semi-infinite delaminations using lock-in infrared thermographyNDT & E International, Vol. 146 | 1 Sep 2024
- Oxidative conversion of methane: maximizing the carbon yield in natural gas valorization via the C123 processChemical Engineering and Processing - Process Intensification, Vol. 203 | 1 Sep 2024
- A Levenberg–Marquardt Method for Nonsmooth Regularized Least SquaresSIAM Journal on Scientific Computing, Vol. 46, No. 4 | 12 August 2024
- Distinct neurodevelopmental and epileptic phenotypes associated with gain- and loss-of-function GABRB2 variantseBioMedicine, Vol. 106 | 1 Aug 2024
- Estimating the soil water retention curve by the HYPROP-WP4C system, HYPROP-based PCNN-PTF and inverse modeling using HYDRUS-1DJournal of Hydrology, Vol. 639 | 1 Aug 2024
- Higher-order Newton methods with polynomial work per iterationAdvances in Mathematics, Vol. 452 | 1 Aug 2024
- Series Oscillatory Circuit with Eddy LossesRussian Electrical Engineering, Vol. 95, No. 7 | 6 October 2024
- Advancing electrochemical impedance analysis through innovations in the distribution of relaxation times methodJoule, Vol. 8, No. 7 | 1 Jul 2024
- Identifying the real fracture hidden in rock microcrack zone by acoustic emission energyInternational Journal of Mining Science and Technology, Vol. 34, No. 6 | 1 Jun 2024
- Super-Universal Regularized Newton MethodSIAM Journal on Optimization, Vol. 34, No. 1 | 3 January 2024
- Regularized Newton Method with Global \({\boldsymbol{\mathcal{O}(1/{k}^2)}}\) ConvergenceSIAM Journal on Optimization, Vol. 33, No. 3 | 14 July 2023
- Inverse Problems for Subdiffusion from Observation at an Unknown Terminal TimeSIAM Journal on Applied Mathematics, Vol. 83, No. 4 | 17 July 2023
- An Optimized Dynamic Mode Decomposition Model Robust to Multiplicative NoiseSIAM Journal on Applied Dynamical Systems, Vol. 22, No. 1 | 16 February 2023
- Shadowing-Based Data Assimilation Method for Partially Observed ModelsSIAM Journal on Applied Dynamical Systems, Vol. 21, No. 2 | 11 April 2022
- Localized Sensitivity Analysis at High-Curvature Boundary Points of Reconstructing Inclusions in Transmission ProblemsSIAM Journal on Mathematical Analysis, Vol. 54, No. 2 | 9 March 2022
- A Stochastic Levenberg--Marquardt Method Using Random Models with Complexity ResultsSIAM/ASA Journal on Uncertainty Quantification, Vol. 10, No. 1 | 29 March 2022
- Derivative-Free Bayesian Inversion Using Multiscale DynamicsSIAM Journal on Applied Dynamical Systems, Vol. 21, No. 1 | 24 January 2022
- Chapter Four: Roots of nonlinear equationsFundamentals of Numerical Computation: Julia Edition | 29 May 2024
- Back MatterFundamentals of Numerical Computation: Julia Edition | 6 July 2023
- A multi-state Markov model using notification data to estimate HIV incidence, number of undiagnosed individuals living with HIV, and delay between infection and diagnosis: Illustration in France, 2008–2018Statistical Methods in Medical Research, Vol. 30, No. 11 | 4 October 2021
- Optimization of the antioxidant capacity of mangosteen peels ( Garcinia mangostana L.) extracts: Management of the drying extraction processesFood Science and Technology International, Vol. 27, No. 5 | 4 October 2020
- Adaptive data-driven modular control approach to computer aided process planning for manufacturing spiral bevel and hypoid gearsProceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture, Vol. 235, No. 3 | 20 September 2020
- Extended validation of a ground-based three-axis spacecraft simulator modelProceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, Vol. 235, No. 2 | 13 July 2020
- Fully integrated multi-scale modelling of damage and time-dependency in thermoplastic-based woven compositesInternational Journal of Damage Mechanics, Vol. 30, No. 2 | 23 September 2020
- Convergence of Newton-MR under Inexact Hessian InformationSIAM Journal on Optimization, Vol. 31, No. 1 | 7 January 2021
- A Nonmonotone Matrix-Free Algorithm for Nonlinear Equality-Constrained Least-Squares ProblemsSIAM Journal on Scientific Computing, Vol. 43, No. 5 | 13 September 2021
- Direct inverse control for active vibration suppression using artificial neural networksJournal of Vibration and Control, Vol. 27, No. 1-2 | 6 May 2020
- A recurrent neural network–based model for predicting bending behavior of ionic polymer–metal composite actuatorsJournal of Intelligent Material Systems and Structures, Vol. 31, No. 17 | 21 July 2020
- A curvilinear bivariate random changepoint model to assess temporal order of markersStatistical Methods in Medical Research, Vol. 29, No. 9 | 23 January 2020
- An improved magnetometer calibration and compensation method based on Levenberg–Marquardt algorithm for multi-rotor unmanned aerial vehicleMeasurement and Control, Vol. 53, No. 3-4 | 6 January 2020
- Intelligent nonlinear model predictive control of gas pipeline networksTransactions of the Institute of Measurement and Control, Vol. 41, No. 16 | 7 August 2019
- Online fatigue crack prognosis using nonlinear ultrasonic modulationStructural Health Monitoring, Vol. 18, No. 5-6 | 13 February 2019
- Inelastic Displacement Spectra and Its Utilization of DDB Design for Seismic Isolated Bridges Subjected to Near-Fault Pulse-Like Ground MotionsEarthquake Spectra, Vol. 35, No. 3 | 1 August 2019
- Pyrolysis modeling, sensitivity analysis, and optimization techniques for combustible materials: A reviewJournal of Fire Sciences, Vol. 37, No. 4-6 | 2 September 2019
- Mass properties identification and automatic mass balancing system for satellite attitude dynamics simulatorProceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, Vol. 233, No. 3 | 17 December 2017
- On the Quadratic Convergence of the Cubic Regularization Method under a Local Error Bound ConditionSIAM Journal on Optimization, Vol. 29, No. 1 | 28 March 2019
- Random Sampling from Joint Probability Distributions Defined in a Bayesian FrameworkSIAM Journal on Scientific Computing, Vol. 41, No. 1 | 15 January 2019
- The Conjugate Residual Method in Linesearch and Trust-Region MethodsSIAM Journal on Optimization, Vol. 29, No. 3 | 25 July 2019
- Optimal parameter estimation in semi-empirical tire modelsProceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, Vol. 233, No. 1 | 19 June 2018
- Adaptive tracking control based on neural approximation for the yaw motion of a small-scale unmanned helicopterInternational Journal of Advanced Robotic Systems, Vol. 16, No. 1 | 19 February 2019
- Soft Computing Tools to Predict Progression of Percent Embedment of Aggregates in Chip SealsTransportation Research Record: Journal of the Transportation Research Board, Vol. 2672, No. 12 | 14 May 2018
- Intensification of the convective drying process of Salvia officinalis : Modeling and optimizationFood Science and Technology International, Vol. 24, No. 5 | 1 March 2018
- Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and OptimizationSIAM Review, Vol. 60, No. 3 | 8 August 2018
- Iterative Importance Sampling Algorithms for Parameter EstimationSIAM Journal on Scientific Computing, Vol. 40, No. 2 | 1 March 2018
- A Duality-Based Optimization Approach for Model Adaptivity in Heterogeneous Multiscale ProblemsMultiscale Modeling & Simulation, Vol. 16, No. 1 | 1 March 2018
- Newton Correction Methods for Computing Real Eigenpairs of Symmetric TensorsSIAM Journal on Matrix Analysis and Applications, Vol. 39, No. 3 | 3 July 2018
- Variable Projection Methods for an Optimized Dynamic Mode DecompositionSIAM Journal on Applied Dynamical Systems, Vol. 17, No. 1 | 1 February 2018
- Semi-isotropic design of a Stewart platform through constrained optimizationProceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science, Vol. 231, No. 10 | 16 December 2015
- Mechanical properties of Precontraint 1202 S2 based on uniaxial tensile and creep testsJournal of Reinforced Plastics and Composites, Vol. 36, No. 4 | 13 December 2016
- Comparison of luminous intensity distributionsLighting Research & Technology, Vol. 49, No. 1 | 3 August 2016
- An ODE-Based Method for Computing the Distance of Coprime Polynomials to Common DivisibilitySIAM Journal on Numerical Analysis, Vol. 55, No. 3 | 22 June 2017
- The Use of Quadratic Regularization with a Cubic Descent Condition for Unconstrained OptimizationSIAM Journal on Optimization, Vol. 27, No. 2 | 6 June 2017
- A Comparative Performance of Least-Square Method and Very Fast Simulated Annealing Global Optimization Method for Interpretation of Self-Potential Anomaly over 2-D Inclined Sheet Type StructureJournal of the Geological Society of India, Vol. 88, No. 4 | 1 October 2016
- Levenberg--Marquardt Methods Based on Probabilistic Gradient Models and Inexact Subproblem Solution, with Application to Data AssimilationSIAM/ASA Journal on Uncertainty Quantification, Vol. 4, No. 1 | 16 August 2016
- Synchronization of Independently Moving Cameras via Motion RecoverySIAM Journal on Imaging Sciences, Vol. 9, No. 3 | 7 July 2016
- Structural Health Monitoring of a 54-Story Steel-Frame Building Using a Wave Method and Earthquake RecordsEarthquake Spectra, Vol. 31, No. 1 | 1 February 2015
- An Efficient Gauss--Newton Algorithm for Symmetric Low-Rank Product Matrix ApproximationsSIAM Journal on Optimization, Vol. 25, No. 3 | 6 August 2015
- GUI Based Inversion Code for Automatic Quantification of Strike Limited Listric Fault Sources and Regional Gravity Background from Observed Bouguer Gravity AnomaliesJournal of the Geological Society of India, Vol. 83, No. 6 | 1 June 2014
- Factorization Approach to Structured Low-Rank Approximation with ApplicationsSIAM Journal on Matrix Analysis and Applications, Vol. 35, No. 3 | 11 September 2014
- An Algebraic Solution for the Candecomp/PARAFAC Decomposition with Circulant FactorsSIAM Journal on Matrix Analysis and Applications, Vol. 35, No. 4 | 11 December 2014
- Hybrid Prediction Approach Based on Weekly Similarities of Traffic Flow for Different Temporal ScalesTransportation Research Record: Journal of the Transportation Research Board, Vol. 2443, No. 1 | 1 January 2014
- Kinematic model calibration of a 7-DOF capstan-driven haptic device for pose and force control accuracy improvementProceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science, Vol. 227, No. 6 | 13 September 2012
- Intrusion and Upliftment of Mahakoshal Rocks Between Vindhyan and Gondwana in Narmada Son Lineament, Central IndiaJournal of the Geological Society of India, Vol. 81, No. 4 | 1 April 2013
- Structured Low-Rank Approximation with Missing DataSIAM Journal on Matrix Analysis and Applications, Vol. 34, No. 2 | 27 June 2013
- Volumetric analysis of syringomyelia following hindbrain decompression for Chiari malformation Type I: syringomyelia resolution follows exponential kineticsNeurosurgical Focus, Vol. 31, No. 3 | 1 Sep 2011
- Typological Seismic Risk Maps for ItalyEarthquake Spectra, Vol. 27, No. 3 | 1 August 2011
- Identification of optimized constitutive model parameters at a high strain rate using electromagnetic ring expansion test resultsProceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science, Vol. 225, No. 4 | 1 April 2011
- Rank-Deficient Nonlinear Least Squares Problems and Subset SelectionSIAM Journal on Numerical Analysis, Vol. 49, No. 3 | 23 June 2011
- Computing Points that Satisfy Second Order Necessary Optimality Conditions for Unconstrained MinimizationSIAM Journal on Optimization, Vol. 20, No. 4 | 19 February 2010
- On the Convergence of Recursive Trust-Region Methods for Multiscale Nonlinear Optimization and Applications to Nonlinear MechanicsSIAM Journal on Numerical Analysis, Vol. 47, No. 4 | 4 September 2009
- Inverse Analysis of Plate Load Tests to Assess Subgrade Resilient ModulusTransportation Research Record: Journal of the Transportation Research Board, Vol. 2101, No. 1 | 1 January 2009
- Random Utility Location, Production, and Exchange Choice; Additive Logit Model; and Spatial Choice MicrosimulationsTransportation Research Record: Journal of the Transportation Research Board, Vol. 2003, No. 1 | 1 January 2007
- Response models based on bagging neural networksJournal of Interactive Marketing, Vol. 19, No. 1 | 1 February 2005
- Relative Periodic Solutions of the Complex Ginzburg--Landau EquationSIAM Journal on Applied Dynamical Systems, Vol. 4, No. 4 | 7 August 2006
- Linear versus Nonlinear Dimensionality Reduction of High-Dimensional Dynamical SystemsSIAM Journal on Scientific Computing, Vol. 25, No. 6 | 25 July 2006
- Analyzing the Dynamics of Cellular Flames Using Karhunen--Loève Decomposition and Autoassociative Neural NetworksSIAM Journal on Scientific Computing, Vol. 24, No. 5 | 25 July 2006
- An Elementary Model for Control of a Semiconductor Etching ProcessSIAM Review, Vol. 44, No. 4 | 4 August 2006
- Adaptive Speed Estimation Using Transfer Function Models for Real-Time Dynamic Traffic Assignment OperationTransportation Research Record: Journal of the Transportation Research Board, Vol. 1783, No. 1 | 1 January 2002
- A Trust-Region Approach to Nonlinear Systems of Equalities and InequalitiesSIAM Journal on Optimization, Vol. 9, No. 2 | 31 July 2006
- A Global Convergence Theory for Dennis, El-Alem, and Maciel's Class of Trust-Region Algorithms for Constrained Optimization without Assuming RegularitySIAM Journal on Optimization, Vol. 9, No. 4 | 31 July 2006
- Convergence Properties of Minimization Algorithms for Convex Constraints Using a Structured Trust RegionSIAM Journal on Optimization, Vol. 6, No. 4 | 31 July 2006
- Restricted Step and Levenberg–Marquardt Techniques in Proximal Bundle Methods for Nonconvex Nondifferentiable OptimizationSIAM Journal on Optimization, Vol. 6, No. 1 | 31 July 2006
- A Parallel Nonlinear Least-Squares Solver: Theoretical Analysis and Numerical ResultsSIAM Journal on Scientific and Statistical Computing, Vol. 13, No. 3 | 13 July 2006
- The Early Use of Matrix Diagonal Increments in Statistical ProblemsSIAM Review, Vol. 31, No. 3 | 18 July 2006
- Nonstandard Scaling Matrices for Trust Region Gauss–Newton MethodsSIAM Journal on Scientific and Statistical Computing, Vol. 10, No. 4 | 13 July 2006
- A Continuation Approach for Solving Large-Residual Nonlinear Least Squares ProblemsSIAM Journal on Scientific and Statistical Computing, Vol. 8, No. 4 | 14 July 2006
- The Use of Linear Programming for the Solution of Sparse Sets of Nonlinear EquationsSIAM Journal on Scientific and Statistical Computing, Vol. 8, No. 2 | 14 July 2006
- Newton’s Method with a Model Trust Region ModificationSIAM Journal on Numerical Analysis, Vol. 19, No. 2 | 17 July 2006
- Computing Optimal Locally Constrained StepsSIAM Journal on Scientific and Statistical Computing, Vol. 2, No. 2 | 16 May 2012
- Robust Methods for Solving Systems of Nonlinear EquationsSIAM Journal on Scientific and Statistical Computing, Vol. 1, No. 1 | 16 May 2012
- Some Problems in the Control of Distributed Systems, and Their Numerical SolutionSIAM Journal on Control and Optimization, Vol. 17, No. 1 | 18 July 2006
- Minimum Principles for Ill-Posed ProblemsSIAM Journal on Mathematical Analysis, Vol. 9, No. 4 | 17 February 2012
- Approximation to Data by Splines with Free KnotsSIAM Journal on Numerical Analysis, Vol. 15, No. 2 | 14 July 2006
- Dynamic Optimal Control Models in Advertising: a SurveySIAM Review, Vol. 19, No. 4 | 17 February 2012
- Use of Smoothing and Damping Techniques in the Solution of Nonlinear EquationsSIAM Review, Vol. 19, No. 1 | 18 July 2006
- Nonlinear Mean-Square Approximation of Finite SetsSIAM Journal on Numerical Analysis, Vol. 12, No. 1 | 14 July 2006
- Complex Linear Least SquaresSIAM Review, Vol. 15, No. 4 | 18 July 2006
- Multivariate Splines with Nondegenerate PartitionsSIAM Journal on Numerical Analysis, Vol. 10, No. 4 | 14 July 2006
- Parameter Selection for Modified Newton Methods for Function MinimizationSIAM Journal on Numerical Analysis, Vol. 7, No. 3 | 14 July 2006
- An Accelerated Gradient Projection Method for Linearly Constrained Nonlinear EstimationSIAM Journal on Applied Mathematics, Vol. 18, No. 2 | 1 August 2006
- Comparison of Gradient Methods for the Solution of Nonlinear Parameter Estimation ProblemsSIAM Journal on Numerical Analysis, Vol. 7, No. 1 | 14 July 2006
- A Survey of Numerical Methods for Unconstrained OptimizationSIAM Review, Vol. 12, No. 1 | 18 July 2006
- On a Theorem Used in Nonlinear Least SquaresSIAM Journal on Applied Mathematics, Vol. 14, No. 5 | 13 July 2006
- On the Stationary Values of a Second-Degree Polynomial on the Unit SphereJournal of the Society for Industrial and Applied Mathematics, Vol. 13, No. 4 | 13 July 2006
View Options
Get Access
- Access via your Institution
- Questions about how to access this content? Contact SIAM at [email protected].