SIAM Journal on Numerical Analysis


The Conjugate Gradient Method and Trust Regions in Large Scale Optimization

Related Databases

Web of Science

You must be logged in with an active subscription to view this.

Article Data

History

Submitted: 16 October 1981
Published online: 17 July 2006

Publication Data

ISSN (print): 0036-1429
ISSN (online): 1095-7170
CODEN: sjnaam

Algorithms based on trust regions have been shown to be robust methods for unconstrained optimization problems. All existing methods, either based on the dogleg strategy or Hebden-More iterations, require solution of system of linear equations. In large scale optimization this may be prohibitively expensive. It is shown in this paper that an approximate solution of the trust region problem may be found by the preconditioned conjugate gradient method. This may be regarded as a generalized dogleg technique where we asymptotically take the inexact quasi-Newton step. We also show that we have the same convergence properties as existing methods based on the dogleg strategy using an approximate Hessian.

Copyright © 1983 Society for Industrial and Applied Mathematics

Cited by

(2020) Sparsity-promoting optimal control of cyber–physical systems over shared communication networks. Automatica 122, 109217. Crossref
(2020) Mitigating effects of temperature variations through probabilistic-based machine learning for vibration-based bridge scour detection. Journal of Civil Structural Health Monitoring 10:5, 957-972. Crossref
(2020) Transverse relaxation rates of pulmonary dissolved‐phase Hyperpolarized 129 Xe as a biomarker of lung injury in idiopathic pulmonary fibrosis. Magnetic Resonance in Medicine 84:4, 1857-1867. Crossref
(2020) Challenges for biophysical modeling of microstructure. Journal of Neuroscience Methods 344, 108861. Crossref
(2020) An extension of the type-1 and singleton fuzzy logic system trained by scaled conjugate gradient methods for multiclass classification problems. Neurocomputing 411, 149-163. Crossref
(2020) Simultaneous iterative solutions for the trust-region and minimum eigenvalue subproblem. Optimization Methods and Software 2, 1-20. Crossref
(2020) Modeling and imaging of intestinal electrical impedance based on conjugate gradient method. International Journal for Numerical Methods in Biomedical Engineering 36:10. Crossref
(2020) A time-optimal wellbore trajectory design for slide drilling systems. Structural and Multidisciplinary Optimization 2. Crossref
(2020) On monotonic estimates of the norm of the minimizers of regularized quadratic functions in Krylov spaces. BIT Numerical Mathematics 60:3, 583-589. Crossref
(2020) Universal Functions Originator. Applied Soft Computing 94, 106417. Crossref
(2020) A Cauchy Point Direction Trust Region Algorithm for Nonlinear Equations. Mathematical Problems in Engineering 2020, 1-9. Crossref
(2020) Personalized Policy Learning Using Longitudinal Mobile Health Data. Journal of the American Statistical Association 25, 1-11. Crossref
(2020) SVM kernel based on particle swarm optimized vector and Bayesian optimized SVM in atmospheric particulate matter forecasting. Applied Soft Computing 93, 106410. Crossref
(2020) Riemannian Newton and trust‐region algorithms for analytic rotation in exploratory factor analysis. British Journal of Mathematical and Statistical Psychology 22. Crossref
(2020) A hybrid semismooth quasi-Newton method for nonsmooth optimal control with PDEs. Optimization and Engineering 25. Crossref
(2020) Multi-body 3D–2D registration for image-guided reduction of pelvic dislocation in orthopaedic trauma surgery. Physics in Medicine & Biology 65:13, 135009. Crossref
(2020) Stochastic trust region inexact Newton method for large-scale machine learning. International Journal of Machine Learning and Cybernetics 11:7, 1541-1555. Crossref
(2020) Bio‐SCOPE: fast biexponential T 1 ρ mapping of the brain using signal‐compensated low‐rank plus sparse matrix decomposition. Magnetic Resonance in Medicine 83:6, 2092-2106. Crossref
(2020) Robust pollution source parameter identification based on the artificial bee colony algorithm using a wireless sensor network. PLOS ONE 15:5, e0232843. Crossref
(2020) Trust-region algorithms for training responses: machine learning methods using indefinite Hessian approximations. Optimization Methods and Software 35:3, 460-487. Crossref
(2020) Optimal Settings of Fast Active Power Controller: Nordic Case. 2020 IEEE 7th International Conference on Energy Smart Systems (ESS), 63-67. Crossref
(2020) A Unified Efficient Implementation of Trust-region Type Algorithms for Unconstrained Optimization. INFOR: Information Systems and Operational Research 58:2, 290-309. Crossref
(2020) Accelerated mono‐ and biexponential 3D‐T1ρ relaxation mapping of knee cartilage using golden angle radial acquisitions and compressed sensing. Magnetic Resonance in Medicine 83:4, 1291-1309. Crossref
(2020) High‐resolution in vivo MR‐STAT using a matrix‐free and parallelized reconstruction algorithm. NMR in Biomedicine 33:4. Crossref
(2020) Distributed block-diagonal approximation methods for regularized empirical risk minimization. Machine Learning 109:4, 813-852. Crossref
(2020) Error estimates for iterative algorithms for minimizing regularized quadratic subproblems. Optimization Methods and Software 35:2, 304-328. Crossref
(2020) Insights into the passive mechanical behavior of left ventricular myocardium using a robust constitutive model based on full 3D kinematics. Journal of the Mechanical Behavior of Biomedical Materials 103, 103508. Crossref
(2020) SciPy 1.0: fundamental algorithms for scientific computing in Python. Nature Methods 17:3, 261-272. Crossref
(2020) A Newton-CG algorithm with complexity guarantees for smooth unconstrained optimization. Mathematical Programming 180:1-2, 451-488. Crossref
(2020) A non-revisiting genetic algorithm based on a novel binary space partition tree. Information Sciences 512, 661-674. Crossref
2020. Improving Algorithms for Learning Radial Basic Functions Networks to Solve the Boundary Value Problems. Avatar-Based Control, Estimation, Communications, and Development of Neuron Multi-Functional Technology Platforms, 66-106. Crossref
(2020) On Fluorophore Imaging by Diffusion Equation Model: Decompositions and Optimizations. Acta Mathematicae Applicatae Sinica, English Series 36:1, 203-222. Crossref
2020. Optimal Power Flow Dispatch Using Trust Region Based Multiplier Method. Advanced Intelligent Systems for Sustainable Development (AI2SD’2019), 187-199. Crossref
(2020) Design of a New Method for Detection of Occupancy in the Smart Home Using an FBG Sensor. Sensors 20:2, 398. Crossref
and . (2020) First-Order Methods for Nonconvex Quadratic Minimization. SIAM Review 62:2, 395-436. Abstract | PDF (2547 KB) 
, , , and . (2020) Implementing a Smooth Exact Penalty Function for Equality-Constrained Nonlinear Optimization. SIAM Journal on Scientific Computing 42:3, A1809-A1835. Abstract | PDF (647 KB) | Supplementary Materials 
, , , and . (2020) Implementing a Smooth Exact Penalty Function for General Constrained Nonlinear Optimization. SIAM Journal on Scientific Computing 42:3, A1836-A1859. Abstract | PDF (25782 KB) 
, , and . (2020) A Nonsmooth Trust-Region Method for Locally Lipschitz Functions with Application to Optimization Problems Constrained by Variational Inequalities. SIAM Journal on Optimization 30:3, 2163-2196. Abstract | PDF (708 KB) 
(2020) Avatar-Based Natural Neural Network as a Dynamic Virtual Model. International Journal of Applied Research in Bioinformatics 10:1, 1-25. Crossref
(2020) Riemannian Geometric Optimization Methods for Joint Design of Transmit Sequence and Receive Filter on MIMO Radar. IEEE Transactions on Signal Processing 68, 5602-5616. Crossref
(2019) Adaptive trust-region algorithms for unconstrained optimization. Optimization Methods and Software 123, 1-23. Crossref
(2019) A delayed weighted gradient method for strictly convex quadratic minimization. Computational Optimization and Applications 74:3, 729-746. Crossref
(2019) Large-scale quasi-Newton trust-region methods with low-dimensional linear equality constraints. Computational Optimization and Applications 74:3, 669-701. Crossref
(2019) A conjugate gradient-based algorithm for large-scale quadratic programming problem with one quadratic constraint. Computational Optimization and Applications 74:1, 195-223. Crossref
(2019) Rank-one Tensor Approximation with Beta-divergence Cost Functions. 2019 27th European Signal Processing Conference (EUSIPCO), 1-5. Crossref
(2019) Type-1 and singleton fuzzy logic system trained by a fast scaled conjugate gradient methods for dealing with binary classification problems. Neurocomputing 355, 57-70. Crossref
(2019) Trust Region Based Adversarial Attack on Neural Networks. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 11342-11351. Crossref
(2019) Nonlinear optimization for mixed attenuation polyenergetic image reconstruction. Inverse Problems 35:6, 064004. Crossref
(2019) Newton-type methods for non-convex optimization under inexact Hessian information. Mathematical Programming 24. Crossref
(2019) SE-Sync: A certifiably correct algorithm for synchronization over the special Euclidean group. The International Journal of Robotics Research 38:2-3, 95-125. Crossref
(2019) Preconditioned nonlinear conjugate gradient method for micromagnetic energy minimization. Computer Physics Communications 235, 179-186. Crossref
(2019) Compressed sensing acceleration of biexponential 3D‐T relaxation mapping of knee cartilage. Magnetic Resonance in Medicine 81:2, 863-880. Crossref
(2019) Prediction of atomization energy using graph kernel and active learning. The Journal of Chemical Physics 150:4, 044107. Crossref
(2019) SimNano: A Trust Region Strategy for Large-Scale Molecular Systems Energy Minimization Based on Exact Second-Order Derivative Information. Journal of Chemical Information and Modeling 59:1, 190-205. Crossref
(2019) Global rates of convergence for nonconvex optimization on manifolds. IMA Journal of Numerical Analysis 39:1, 1-33. Crossref
(2019) A matrix-free line-search algorithm for nonconvex optimization. Optimization Methods and Software 34:1, 1-24. Crossref
2019. Scalable Inference of Ordinary Differential Equation Models of Biochemical Processes. Gene Regulatory Networks, 385-422. Crossref
, , and . (2019) Euclidean-Norm Error Bounds for SYMMLQ and CG. SIAM Journal on Matrix Analysis and Applications 40:1, 235-253. Abstract | PDF (1775 KB) | Supplementary Materials 
2019. , 35. Crossref
, , and . (2019) An Efficient, Globally Convergent Method for Optimization Under Uncertainty Using Adaptive Model Reduction and Sparse Grids. SIAM/ASA Journal on Uncertainty Quantification 7:3, 877-912. Abstract | PDF (990 KB) 
and . (2019) The Conjugate Residual Method in Linesearch and Trust-Region Methods. SIAM Journal on Optimization 29:3, 1988-2025. Abstract | PDF (977 KB) 
, , and . (2019) Subdivision-Based Nonlinear Multiscale Cloth Simulation. SIAM Journal on Scientific Computing 41:5, S433-S461. Abstract | PDF (2251 KB) 
(2019) New particle formation from sulfuric acid and ammonia: nucleation and growth model based on thermodynamics derived from CLOUD measurements for a wide range of conditions. Atmospheric Chemistry and Physics 19:7, 5033-5050. Crossref
(2018) A Riemannian trust-region method for low-rank tensor completion. Numerical Linear Algebra with Applications 25:6, e2175. Crossref
(2018) An examination of the nature and dynamics of seismogenesis in South California, USA, based on Non-Extensive Statistical Physics. Physics of the Earth and Planetary Interiors 284, 51-71. Crossref
(2018) A trust-region method for optimal H 2 model reduction of discrete-time dynamical systems. Journal of Difference Equations and Applications, 1-17. Crossref
(2018) Rapid compositional mapping of knee cartilage with compressed sensing MRI. Journal of Magnetic Resonance Imaging 3. Crossref
(2018) Accelerating 3D-T mapping of cartilage using compressed sensing with different sparse and low rank models. Magnetic Resonance in Medicine 80:4, 1475-1491. Crossref
(2018) A penalty method with trust-region mechanism for nonlinear bilevel optimization problem. Journal of Computational and Applied Mathematics 340, 360-374. Crossref
(2018) Quantized Dominant Strategy Mechanisms with Constrained Marginal Valuations. 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton), 590-595. Crossref
(2018) Relaxed I-SHOT trust-region algorithm for solving multi-objective economic emission load dispatch problem. Journal of Taibah University for Science 12:5, 573-583. Crossref
(2018) An effective adaptive trust region algorithm for nonsmooth minimization. Computational Optimization and Applications 71:1, 251-271. Crossref
(2018) An approach for robust PDE-constrained optimization with application to shape optimization of electrical engines and of dynamic elastic structures under uncertainty. Optimization and Engineering 19:3, 697-731. Crossref
(2018) Learning Radial Basis Function Networks with the Trust Region Method for Boundary Problems. Automation and Remote Control 79:9, 1621-1629. Crossref
(2018) An active-set algorithm and a trust-region approach in constrained minimax problem. Computational and Applied Mathematics 37:3, 2605-2631. Crossref
(2018) Efficient Solving of Boundary Value Problems Using Radial Basis Function Networks Learned by Trust Region Method. International Journal of Mathematics and Mathematical Sciences 2018, 1-4. Crossref
(2018) trlib : a vector-free implementation of the GLTR method for iterative solution of the trust region problem. Optimization Methods and Software 33:3, 420-449. Crossref
(2018) A biologically inspired cognitive skills measurement approach. Biologically Inspired Cognitive Architectures 24, 35-46. Crossref
(2018) Error bounds of Lanczos approach for trust-region subproblem. Frontiers of Mathematics in China 13:2, 459-481. Crossref
(2018) Dominant Strategy Allocation of Divisible Network Resources with Limited Information Exchange. IEEE INFOCOM 2018 - IEEE Conference on Computer Communications, 2753-2761. Crossref
(2018) A new adaptive trust region algorithm for optimization problems. Acta Mathematica Scientia 38:2, 479-496. Crossref
(2018) Magnetic Resonance RF Pulse Design by Optimal Control With Physical Constraints. IEEE Transactions on Medical Imaging 37:2, 461-472. Crossref
(2018) Generalized Conjugate Gradient Methods for 1 Regularized Convex Quadratic Programming with Finite Convergence. Mathematics of Operations Research 43:1, 275-303. Crossref
(2018) Büttiker probes and the recursive Green's function: An efficient approach to include dissipation in general configurations. Physical Review B 97:8. Crossref
(2018) On global convergence of gradient descent algorithms for generalized phase retrieval problem. Journal of Computational and Applied Mathematics 329, 202-222. Crossref
, , , and . (2018) A Lanczos Method for Large-Scale Extreme Lorentz Eigenvalue Problems. SIAM Journal on Matrix Analysis and Applications 39:2, 611-631. Abstract | PDF (642 KB) 
, , and . (2018) Optimization Methods for Large-Scale Machine Learning. SIAM Review 60:2, 223-311. Abstract | PDF (1735 KB) 
and . (2018) Complexity Analysis of Second-Order Line-Search Algorithms for Smooth Nonconvex Optimization. SIAM Journal on Optimization 28:2, 1448-1477. Abstract | PDF (560 KB) 
2018. Are Seismogenetic Systems Random or Organized? A Treatise of Their Statistical Nature Based on the Seismicity of the North-Northeast Pacific Rim. Complexity of Seismic Time Series, 365-418. Crossref
and . (2018) Globally Solving the Trust Region Subproblem Using Simple First-Order Methods. SIAM Journal on Optimization 28:3, 1951-1967. Abstract | PDF (465 KB) 
and . (2018) A Nested Lanczos Method for the Trust-Region Subproblem. SIAM Journal on Scientific Computing 40:4, A2005-A2032. Abstract | PDF (739 KB) 
, , , and . (2018) Adaptive Quadratically Regularized Newton Method for Riemannian Optimization. SIAM Journal on Matrix Analysis and Applications 39:3, 1181-1207. Abstract | PDF (563 KB) 
(2018) GARLM: Greedy Autocorrelation Retrieval Levenberg–Marquardt Algorithm for Improving Sparse Phase Retrieval. Applied Sciences 8:10, 1797. Crossref
(2018) Phase measurement deflectometry with refraction model and its calibration. Optics Express 26:26, 33510. Crossref
(2018) Adjoint-based optimization of a source-term representation of vortex generators. Computers & Fluids 162, 139-151. Crossref
(2018) Gaussian Mixture Model for Millimeter-Wave Cellular Communication Networks. IEEE Transactions on Vehicular Technology, 1-1. Crossref
(2018) Practical Use of the Ensemble-Based Conjugate Gradient Method for Production Optimization in the Brugge Benchmark Study. SPE Norway One Day Seminar. Crossref
(2018) A Novel Ensemble-Based Conjugate Gradient Method for Reservoir Management. SPE Norway One Day Seminar. Crossref
(2017) Global Complexity Bound of the Inexact Levenberg–Marquardt Method. Journal of the Operations Research Society of China 81. Crossref
(2017) A New Restarting Adaptive Trust-Region Method for Unconstrained Optimization. Journal of the Operations Research Society of China 5:4, 487-507. Crossref
(2017) A Gauss-Newton Trust-Region Solver for Large-Scale History-Matching Problems. SPE Journal 22:06, 1999-2011. Crossref
(2017) Matrix-free algorithm for the optimization of multidisciplinary systems. Structural and Multidisciplinary Optimization 56:6, 1429-1446. Crossref
(2017) A Discriminant Parameter Determining Technique in Variational Multiscale Method for Stokes Equations. International Journal of Computational Methods 14:05, 1750048. Crossref
(2017) An adaptive trust region algorithm for large-residual nonsmooth least squares problems. Journal of Industrial and Management Optimization 13:2, 1-1. Crossref
2017. Optimization Methods for Supervised Machine Learning: From Linear Models to Deep Learning. The Operations Research Revolution, 89-113. Crossref
(2017) On the nature and dynamics of the seismogenetic systems of North California, USA: An analysis based on Non-Extensive Statistical Physics. Physics of the Earth and Planetary Interiors 270, 46-72. Crossref
(2017) Characterizing interwell connectivity in waterflooded reservoirs using data-driven and reduced-physics models: a comparative study. Neural Computing and Applications 28:7, 1729-1743. Crossref
(2017) Role of anchoring energy on the texture of cholesteric droplets: Finite-element simulations and experiments. Physical Review E 96:1. Crossref
(2017) Matrix Backward Forward Sweep for Unbalanced Power Flow in αβ 0 frame. Electric Power Systems Research 148, 273-281. Crossref
(2017) An Alternating Trust Region Algorithm for Distributed Linearly Constrained Nonlinear Programs, Application to the Optimal Power Flow Problem. Journal of Optimization Theory and Applications 173:3, 844-877. Crossref
(2017) Numerical optimization algorithms for wavefront phase retrieval from multiple measurements. Inverse Problems and Imaging 11:4, 721-743. Crossref
(2017) Space mapping surrogate-based microwave circuit design centering using a new statistical technique. International Journal of Numerical Modelling: Electronic Networks, Devices and Fields 30:3-4, e2108. Crossref
(2017) A stochastic methodology to evaluate the optimal multi-site investment solution for photovoltaic plants. Journal of Cleaner Production 151, 526-536. Crossref
(2017) A joint inventory reliable capacitated facility location problem using a continuum approximation. International Journal of Management Science and Engineering Management 12:2, 104-110. Crossref
(2017) Statistical Analysis of Path Losses for Sectorized Wireless Networks. IEEE Transactions on Communications 65:4, 1828-1838. Crossref
(2017) On efficiently combining limited-memory and trust-region techniques. Mathematical Programming Computation 9:1, 101-134. Crossref
(2017) Tomographic absorption spectroscopy for the study of gas dynamics and reactive flows. Progress in Energy and Combustion Science 59, 1-31. Crossref
(2017) An active-set trust-region algorithm for solving warehouse location problem. Journal of Taibah University for Science 11:2, 353-358. Crossref
(2017) The dimensional reduction method for identification of parameters that trade-off due to similar model roles. Mathematical Biosciences 285, 119-127. Crossref
(2017) Full Waveform Inversion and the Truncated Newton Method. SIAM Review 59:1, 153-195. Abstract | PDF (7228 KB) 
(2017) Solving boundary value problems of mathematical physics using radial basis function networks. Computational Mathematics and Mathematical Physics 57:1, 145-155. Crossref
, , , and . (2017) Solving the Trust-Region Subproblem By a Generalized Eigenvalue Problem. SIAM Journal on Optimization 27:1, 269-291. Abstract | PDF (618 KB) 
2017. Ottimizzazione numerica. Calcolo Scientifico, 243-302. Crossref
, , and . (2017) On the Generalized Lanczos Trust-Region Method. SIAM Journal on Optimization 27:3, 2110-2142. Abstract | PDF (620 KB) 
and . (2017) Sparse Optimal Control of the KdV-Burgers Equation on a Bounded Domain. SIAM Journal on Control and Optimization 55:6, 3673-3706. Abstract | PDF (835 KB) 
(2016) A trust-region approach with novel filter adaptive radius for system of nonlinear equations. Numerical Algorithms 73:4, 999-1016. Crossref
(2016) Simulating granular materials by energy minimization. Computational Particle Mechanics 3:4, 463-475. Crossref
(2016) On gradient descent algorithm for generalized phase retrieval problem. 2016 IEEE 13th International Conference on Signal Processing (ICSP), 320-325. Crossref
(2016) An interior-point penalty active-set trust-region algorithm. Journal of the Egyptian Mathematical Society 24:4, 672-680. Crossref
(2016) Theoretical and experimental study of anti-helical motion for underwater glider. Applied Ocean Research 60, 121-140. Crossref
(2016) Least-squares symmetric solution to the matrix equation AXB = C with the norm inequality constraint. International Journal of Computer Mathematics 93:9, 1564-1578. Crossref
(2016) A modified approach to objective surface generation within the Gauss-Newton parameter identification to ignore outlier data points. Biomedical Signal Processing and Control 30, 162-169. Crossref
(2016) Target-oriented linear least squares and nonlinear, trust-region Newton inversions of plane waves using AVA and PVA data for elastic model parameters. GEOPHYSICS 81:5, R325-R338. Crossref
(2016) Buckling optimization of composite laminates using a hybrid algorithm under Puck failure criterion constraint. Journal of Reinforced Plastics and Composites 35:16, 1233-1247. Crossref
(2016) A design method of robust optimal PI controller with saturation link for different processes. 2016 12th World Congress on Intelligent Control and Automation (WCICA), 284-291. Crossref
(2016) A parametric augmented Lagrangian algorithm for real-tim economic NMPC. 2016 European Control Conference (ECC), 123-128. Crossref
(2016) Numerical optimization of laboratory combustor geometry for NO suppression. Applied Thermal Engineering 102, 1328-1336. Crossref
(2016) Design of optimal PI controller with dead-zone link for low-order processes with time delay. 2016 Chinese Control and Decision Conference (CCDC), 734-740. Crossref
(2016) Interior point-based slack-bus free-power flow solution for balanced islanded microgrids. International Transactions on Electrical Energy Systems 26:5, 968-992. Crossref
(2016) 3D CSEM data inversion using Newton and Halley class methods. Inverse Problems 32:5, 055002. Crossref
(2016) The FFTRR-based fast decomposition methods for solving complex biharmonic problems and incompressible flows. IMA Journal of Numerical Analysis 36:2, 824-850. Crossref
(2016) BFS Algorithm for Voltage-Constrained Meshed DC Traction Networks With Nonsmooth Voltage-Dependent Loads and Generators. IEEE Transactions on Power Systems 31:2, 1526-1536. Crossref
(2016) The SEISCOPE optimization toolbox: A large-scale nonlinear optimization library based on reverse communication. GEOPHYSICS 81:2, F1-F15. Crossref
(2016) Two globally convergent nonmonotone trust-region methods for unconstrained optimization. Journal of Applied Mathematics and Computing 50:1-2, 529-555. Crossref
(2016) On a globally convergent trust region algorithm with infeasibility control for equality constrained optimization. Journal of Applied Mathematics and Computing 50:1-2, 275-298. Crossref
(2016) Computationally efficient and robust kinematic calibration methodologies and their application to industrial robots. Robotics and Computer-Integrated Manufacturing 37, 33-48. Crossref
(2016) Efficient high-resolution RF pulse design applied to simultaneous multi-slice excitation. Journal of Magnetic Resonance 263, 33-44. Crossref
(2016) Virtual Storages as Theoretically Motivated Demand Response Models for Enhanced Smart Grid Operations. Energy Technology 4:1, 163-176. Crossref
(2015) Smoothing Trust Region for Digital Image Restoration. 2015 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT), 40-43. Crossref
(2015) Time optimal control of the monodomain model in cardiac electrophysiology. IMA Journal of Applied Mathematics 80:6, 1664-1683. Crossref
(2015) Sparse Spike Deconvolution of Seismic Data Using Trust-Region Based SQP Algorithm. Journal of Computational Acoustics 23:04, 1540002. Crossref
(2015) Trust Region Methods for the Estimation of a Complex Exponential Decay Model in MRI With a Single-Shot or Multi-Shot Trajectory. IEEE Transactions on Image Processing 24:11, 3694-3706. Crossref
(2015) RF cavity design exploiting a new derivative-free trust region optimization approach. Journal of Advanced Research 6:6, 915-924. Crossref
(2015) A Modified BFGS Formula Using a Trust Region Model for Nonsmooth Convex Minimizations. PLOS ONE 10:10, e0140606. Crossref
(2015) Statistical design centering of RF cavity linear accelerator via non-derivative trust region optimization. 2015 IEEE MTT-S International Conference on Numerical Electromagnetic and Multiphysics Modeling and Optimization (NEMO), 1-3. Crossref
(2015) Recent advances in trust region algorithms. Mathematical Programming 151:1, 249-281. Crossref
(2015) An object oriented data structure designed for multiphysics simulations on parallel computers. 2015 9th International Symposium on Advanced Topics in Electrical Engineering (ATEE), 448-451. Crossref
(2015) A derivative-free trust-funnel method for equality-constrained nonlinear optimization. Computational Optimization and Applications 61:1, 25-49. Crossref
(2015) Ordinal Regression by a Generalized Force-Based Model. IEEE Transactions on Cybernetics 45:4, 844-857. Crossref
(2015) Generating Conformational Transitions Using the Euclidean Distance Matrix. IEEE Transactions on NanoBioscience 14:2, 203-209. Crossref
(2015) POD enriched boundary models and their optimal stabilisation. International Journal for Numerical Methods in Fluids 77:2, 92-107. Crossref
(2015) A Flexible Iterative Solver for Nonconvex, Equality-Constrained Quadratic Subproblems. SIAM Journal on Scientific Computing 37:4, A1801-A1824. Abstract | PDF (893 KB) 
(2015) A Semismooth Newton-CG Method for Constrained Parameter Identification in Seismic Tomography. SIAM Journal on Scientific Computing 37:5, S334-S364. Abstract | PDF (1022 KB) 
(2015) Evidence of non extensivity in the evolution of seismicity along the San Andreas Fault, California, USA: An approach based on Tsallis statistical physics. Physics and Chemistry of the Earth, Parts A/B/C 85-86, 56-68. Crossref
2015. Distributed Newton Methods for Regularized Logistic Regression. Advances in Knowledge Discovery and Data Mining, 690-703. Crossref
2015. Particle Swarm Global Optimization Search Algorithm. Molecular Structures and Structural Dynamics of Prion Proteins and Prions, 309-310. Crossref
(2014) TRUST-REGION-BASED METHODS FOR NONLINEAR PROGRAMMING: RECENT ADVANCES AND PERSPECTIVES. Pesquisa Operacional 34:3, 447-462. Crossref
(2014) Heat flux evaluation in high temperature ring-on-ring contacts. Wear. Crossref
(2014) Exploring trust region method for the solution of logit-based stochastic user equilibrium problem. European Journal of Operational Research 239:1, 46-57. Crossref
(2014) On board accumulator model for power flow studies in DC traction networks. Electric Power Systems Research 116, 266-275. Crossref
(2014) A regularized trust region method for joint reconstruction of spin magnitude, T<inf>2</inf><sup>&#x2217;</sup> decay, and off-resonance field map. 2014 IEEE International Conference on Image Processing (ICIP), 1882-1886. Crossref
(2014) A matrix-free approach to build band preconditioners for large-scale bound-constrained optimization. Journal of Computational and Applied Mathematics 268, 82-92. Crossref
(2014) An inexact and nonmonotone proximal method for smooth unconstrained minimization. Journal of Computational and Applied Mathematics 269, 86-100. Crossref
(2014) Adaptive Control for Laser Transmitter Feedforward Linearization System. IEEE Photonics Journal 6:4, 1-10. Crossref
(2014) Drilling-risk assessment with joint electromagnetic and seismic data. The Leading Edge 33:8, 876-880. Crossref
(2014) A model-hybrid approach for unconstrained optimization problems. Numerical Algorithms 66:4, 741-759. Crossref
(2014) Optimization Algorithm for Systems Governed by Chaotic Dynamics. 15th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference. Crossref
(2014) Efficient tridiagonal preconditioner for the matrix-free truncated Newton method. Applied Mathematics and Computation 235, 394-407. Crossref
(2014) Unbalanced Power Flow in Distribution Systems With Embedded Transformers Using the Complex Theory in <formula formulatype="inline"> <tex Notation="TeX">$\alpha \beta 0\;$</tex></formula> Stationary Reference Frame. IEEE Transactions on Power Systems 29:3, 1012-1022. Crossref
(2014) Large-Scale Linear RankSVM. Neural Computation 26:4, 781-817. Crossref
2014. Bibliography. Computational Design of Lightweight Structures, 114-134. Crossref
(2014) Density functional theory and molecular dynamics study of the uranyl ion (UO2)2+. Journal of Molecular Modeling 20:3. Crossref
(2014) Multi-objective economic emission load dispatch problem with trust-region strategy. Electric Power Systems Research 108, 254-259. Crossref
(2014) Trust-Region Algorithm for the Inversion of Molecular Diffusion NMR Data. Analytical Chemistry 86:1, 592-599. Crossref
(2014) Scalable Nonlinear Programming via Exact Differentiable Penalty Functions and Trust-Region Newton Methods. SIAM Journal on Optimization 24:1, 528-558. Abstract | PDF (548 KB) 
(2014) A Matrix-Free Trust-Region SQP Method for Equality Constrained Optimization. SIAM Journal on Optimization 24:3, 1507-1541. Abstract | PDF (506 KB) 
(2014) A Nonmonotone Adaptive Trust Region Method Based on Conic Model for Unconstrained Optimization. Journal of Optimization 2014, 1-8. Crossref
(2014) Robust and efficient Trust-Region based stability analysis and multiphase flash calculations. Fluid Phase Equilibria 362, 51-68. Crossref
(2014) The Regional Conjugate Optimisation Approach: A Novel Method for Three Parameter Identification of Physiological Models. IFAC Proceedings Volumes 47:3, 3893-3898. Crossref
(2014) Reducing the Effect of Outlying Data on the Identification of Insulinaemic Pharmacokinetic Parameters with an Adapted Gauss-Newton Approach. IFAC Proceedings Volumes 47:3, 5635-5640. Crossref
2014. Evaluating the Effects of Local Search in Genetic Programming. EVOLVE - A Bridge between Probability, Set Oriented Numerics, and Evolutionary Computation V, 213-228. Crossref
(2014) Method and experiment for compensating the interferential magnetic field in underwater vehicle. Measurement 47, 651-657. Crossref
2014. Optimal Design of Computationally Expensive EM-Based Systems: A Surrogate-Based Approach. Solving Computationally Expensive Engineering Problems, 171-194. Crossref
(2013) Exploiting Information Geometry to Improve the Convergence Properties of Variational Active Contours. IEEE Journal of Selected Topics in Signal Processing 7:4, 700-707. Crossref
(2013) A continuation approach to mode-finding of multivariate Gaussian mixtures and kernel density estimates. Journal of Global Optimization 56:2, 459-487. Crossref
(2013) Nonmonotone retrospective conic trust region method for unconstrained optimization. Numerical Algebra, Control and Optimization 3:2, 309-325. Crossref
(2013) Nonlinear least squares and Sobolev gradients. Applied Numerical Mathematics 65, 91-104. Crossref
(2013) Unscented/ensemble transform-based variational filter. Physica D: Nonlinear Phenomena 246:1, 1-14. Crossref
(2013) On the convergence of an inexact Gauss–Newton trust-region method for nonlinear least-squares problems with simple bounds. Optimization Letters 7:3, 447-465. Crossref
(2013) Minimization of the Ginzburg–Landau energy functional by a Sobolev gradient trust-region method. Applied Mathematics and Computation 219:11, 5936-5942. Crossref
(2013) Full Waveform Inversion and the Truncated Newton Method. SIAM Journal on Scientific Computing 35:2, B401-B437. Abstract | PDF (6515 KB) 
(2013) Optimization-Based Algorithms for Tensor Decompositions: Canonical Polyadic Decomposition, Decomposition in Rank-$(L_r,L_r,1)$ Terms, and a New Generalization. SIAM Journal on Optimization 23:2, 695-720. Abstract | PDF (1376 KB) 
(2013) Monotone and nonmonotone trust-region-based algorithms for large scale unconstrained optimization problems. Computational Optimization and Applications 54:1, 27-43. Crossref
(2013) On optimizing the sum of the Rayleigh quotient and the generalized Rayleigh quotient on the unit sphere. Computational Optimization and Applications 54:1, 111-139. Crossref
(2013) Norm-Constrained Least-Squares Solutions to the Matrix Equation A X B = C . Abstract and Applied Analysis 2013, 1-10. Crossref
2013. Multi-object Tracking Using Particle Swarm Optimization on Target Interactions. Advances in Heuristic Signal Processing and Applications, 63-78. Crossref
2013. A Newton-CG Method for Full-Waveform Inversion in a Coupled Solid-Fluid System. Advanced Computing, 99-117. Crossref
(2012) A feasible direction method for image restoration. Optimization Letters 6:8, 1795-1817. Crossref
(2012) A note on the implementation of an interior-point algorithm for nonlinear optimization with inexact step computations. Mathematical Programming 136:1, 209-227. Crossref
(2012) Fast solution of direct and inverse design problems concerning furnace operation conditions in steel industry. Applied Thermal Engineering 47, 41-53. Crossref
(2012) Trust-region method for box-constrained semismooth equations and its applications to complementary problems. International Journal of Computer Mathematics 89:17, 2281-2306. Crossref
(2012) Optimal control of a non-isothermal tube drawing process. Journal of Engineering Mathematics 76:1, 1-17. Crossref
(2012) Updating the regularization parameter in the adaptive cubic regularization algorithm. Computational Optimization and Applications 53:1, 1-22. Crossref
(2012) A TRUST REGION SUBSPACE METHOD FOR LARGE-SCALE UNCONSTRAINED OPTIMIZATION. Asia-Pacific Journal of Operational Research 29:04, 1250021. Crossref
(2012) Unified AC/DC Power Flow for Traction Systems: A New Concept. IEEE Transactions on Vehicular Technology 61:6, 2421-2430. Crossref
(2012) A new trust region method with adaptive radius for unconstrained optimization. Optimization Methods and Software 27:3, 419-429. Crossref
(2012) An Efficient Method for Evaluating Analog Circuit Performance Bounds Under Process Variations. IEEE Transactions on Circuits and Systems II: Express Briefs 59:6, 351-355. Crossref
(2012) Transmission Loss Analysis of a Parallel-Coupled Helmholtz Resonator Network. AIAA Journal 50:6, 1339-1346. Crossref
(2012) Inexact trust region PGC method for large sparse unconstrained optimization. Computational Optimization and Applications 51:3, 981-999. Crossref
(2012) Nonlinear output constraints handling for production optimization of oil reservoirs. Computational Geosciences 16:2, 499-517. Crossref
(2012) Riemannian Trust-Region Method for the Maximal Correlation Problem. Numerical Functional Analysis and Optimization 33:3, 338-362. Crossref
(2012) An $\ell_1$ Elastic Interior-Point Method for Mathematical Programs with Complementarity Constraints. SIAM Journal on Optimization 22:1, 187-211. Abstract | PDF (363 KB) 
(2012) An Application of Random Projection to Parameter Estimation in Partial Differential Equations. SIAM Journal on Scientific Computing 34:4, A2344-A2365. Abstract | PDF (4147 KB) 
2012. Quantitative Models of the Mechanisms that Control Genome-Wide Patterns of Animal Transcription Factor Binding. Computational Methods in Cell Biology, 263-283. Crossref
(2012) A Game Model for Adversarial Classification in Spam Filtering. Advanced Materials Research 433-440, 5053-5057. Crossref
2012. Generalized Multilevel SQP-methods for PDAE-constrained Optimization Based on Space-Time Adaptive PDAE Solvers. Constrained Optimization and Optimal Control for Partial Differential Equations, 51-74. Crossref
(2011) Discovery of Novel MDR-Mycobacterium tuberculosis Inhibitor by New FRIGATE Computational Screen. PLoS ONE 6:12, e28428. Crossref
(2011) Optimal convective heat transfer in double pipe with parabolic fins. International Journal of Heat and Mass Transfer 54:25-26, 5415-5426. Crossref
(2011) Cooperative Co-evolution with Weighted Random Grouping for Large-Scale Crossing Waypoints Locating in Air Route Network. 2011 IEEE 23rd International Conference on Tools with Artificial Intelligence, 215-222. Crossref
(2011) Block relaxation and majorization methods for the nearest correlation matrix with factor structure. Computational Optimization and Applications 50:2, 327-349. Crossref
2011. Structural Health Monitoring OrientedModelling. Structural Health Monitoring of Long-Span Suspension Bridges. Crossref
(2011) On the Use of Stochastic Hessian Information in Optimization Methods for Machine Learning. SIAM Journal on Optimization 21:3, 977-995. Abstract | PDF (732 KB) 
(2011) Optimal configuration of finned annulus in a double pipe with fully developed laminar flow. Applied Thermal Engineering 31:8-9, 1435-1446. Crossref
(2011) A practical method for solving large-scale TRS. Optimization Letters 5:2, 207-227. Crossref
(2011) A Group Update Sparse Method Using Truncated Trust Region Strategy. 2011 Fourth International Joint Conference on Computational Sciences and Optimization, 90-93. Crossref
2011. Methods For Large-Scale Unconstrained Optimization. Wiley Encyclopedia of Operations Research and Management Science. Crossref
(2011) Quantitative Models of the Mechanisms That Control Genome-Wide Patterns of Transcription Factor Binding during Early Drosophila Development. PLoS Genetics 7:2, e1001290. Crossref
(2011) Recent advances in numerical methods for nonlinear equations and nonlinear least squares. Numerical Algebra, Control and Optimization 1:1, 15-34. Crossref
(2011) A new non-monotone self-adaptive trust region method for unconstrained optimization. Journal of Applied Mathematics and Computing 35:1-2, 53-62. Crossref
(2011) Best Low Multilinear Rank Approximation of Higher-Order Tensors, Based on the Riemannian Trust-Region Scheme. SIAM Journal on Matrix Analysis and Applications 32:1, 115-135. Abstract | PDF (406 KB) 
(2011) Accelerating the LSTRS Algorithm. SIAM Journal on Scientific Computing 33:1, 175-194. Abstract | PDF (465 KB) 
(2010) Nonmonotone trust region algorithm for unconstrained optimization problems. Applied Mathematics and Computation 217:8, 4274-4281. Crossref
(2010) Second-order adjoint-based control for multiphase flow in subsurface oil reservoirs. 49th IEEE Conference on Decision and Control (CDC), 1866-1871. Crossref
(2010) Estimating Nonparametric Random Utility Models with an Application to the Value of Time in Heterogeneous Populations. Transportation Science 44:4, 537-549. Crossref
(2010) Design of robust optimal proportional–integral–derivative controller based on new interval polynomial stability criterion and Lyapunov theorem in the multiple parameters' perturbations circumstance. IET Control Theory & Applications 4:11, 2427-2440. Crossref
(2010) The Inexact Newton Method with Semi Automatic Differentiation. 2010 Third International Symposium on Information Processing, 286-290. Crossref
(2010) Mining adversarial patterns via regularized loss minimization. Machine Learning 81:1, 69-83. Crossref
(2010) A Statistical Framework for Optimal Design Matrix Generation With Application to fMRI. IEEE Transactions on Medical Imaging 29:9, 1573-1611. Crossref
(2010) High-resolution seismic imaging in deep sea from a joint deep-towed/OBH reflection experiment: application to a Mass Transport Complex offshore Nigeria. Geophysical Journal International 182:3, 1524-1542. Crossref
(2010) A retrospective trust-region method for unconstrained optimization. Mathematical Programming 123:2, 395-418. Crossref
(2010) Structure of the Hessian matrix and an economical implementation of Newton’s method in the problem of canonical approximation of tensors. Computational Mathematics and Mathematical Physics 50:6, 927-945. Crossref
(2010) Combination of an adaptive multilevel SQP method and a space-time adaptive PDAE solver for optimal control problems. Procedia Computer Science 1:1, 1435-1443. Crossref
(2010) Optimal Control of Glass Cooling Using Simplified P N Theory. Transport Theory and Statistical Physics 39:2-4, 282-311. Crossref
(2010) Nonlinear programming without a penalty function or a filter. Mathematical Programming 122:1, 155-196. Crossref
(2010) On solving trust-region and other regularised subproblems in optimization. Mathematical Programming Computation 2:1, 21-57. Crossref
(2010) A Heuristic for Nonlinear Global Optimization. INFORMS Journal on Computing 22:1, 59-70. Crossref
(2010) Convexity and Concavity Detection in Computational Graphs: Tree Walks for Convexity Assessment. INFORMS Journal on Computing 22:1, 26-43. Crossref
(2010) Riemannian Newton Method for the Multivariate Eigenvalue Problem. SIAM Journal on Matrix Analysis and Applications 31:5, 2972-2996. Abstract | PDF (383 KB) 
(2010) A Riemannian Optimization Approach for Computing Low-Rank Solutions of Lyapunov Equations. SIAM Journal on Matrix Analysis and Applications 31:5, 2553-2579. Abstract | PDF (349 KB) 
(2010) An Interior-Point Algorithm for Large-Scale Nonlinear Optimization with Inexact Step Computations. SIAM Journal on Scientific Computing 32:6, 3447-3475. Abstract | PDF (431 KB) 
(2010) A Newton-CG Augmented Lagrangian Method for Semidefinite Programming. SIAM Journal on Optimization 20:4, 1737-1765. Abstract | PDF (353 KB) 
(2010) A Matrix-Free Algorithm for Equality Constrained Optimization Problems with Rank-Deficient Jacobians. SIAM Journal on Optimization 20:3, 1224-1249. Abstract | PDF (317 KB) 
(2010) Convergence of a Regularized Euclidean Residual Algorithm for Nonlinear Least-Squares. SIAM Journal on Numerical Analysis 48:1, 1-29. Abstract | PDF (349 KB) 
(2010) A Subspace Minimization Method for the Trust-Region Step. SIAM Journal on Optimization 20:3, 1439-1461. Abstract | PDF (292 KB) 
(2010) An interior-point method for large constrained discrete ill-posed problems. Journal of Computational and Applied Mathematics 233:5, 1288-1297. Crossref
(2010) A nonmonotone adaptive trust-region algorithm for symmetric nonlinear equations. Natural Science 02:04, 373-378. Crossref
2010. On the Best Low Multilinear Rank Approximation of Higher-order Tensors*. Recent Advances in Optimization and its Applications in Engineering, 145-164. Crossref
(2009) A self-adaptive trust region method with line search based on a simple subproblem model. Journal of Computational and Applied Mathematics 232:2, 514-522. Crossref
(2009) The convergence of subspace trust region methods. Journal of Computational and Applied Mathematics 231:1, 365-377. Crossref
(2009) BFGS trust-region method for symmetric nonlinear equations. Journal of Computational and Applied Mathematics 230:1, 44-58. Crossref
(2009) Dealing with singularities in nonlinear unconstrained optimization. European Journal of Operational Research 196:1, 33-42. Crossref
(2009) Algorithm 896. ACM Transactions on Mathematical Software 36:3, 1-29. Crossref
(2009) A nearly exact method for solving large-scale TRS. 2009 7th IEEE International Conference on Industrial Informatics, 337-342. Crossref
(2009) Subspace methods for large scale nonlinear equations and nonlinear least squares. Optimization and Engineering 10:2, 207-218. Crossref
(2009) A Generalized Approach to Portfolio Optimization: Improving Performance by Constraining Portfolio Norms. Management Science 55:5, 798-812. Crossref
(2009) An Algorithm for Image Denoising with Automatic Noise Estimate. Journal of Mathematical Imaging and Vision 34:1, 98-106. Crossref
(2009) Trust-region and other regularisations of linear least-squares problems. BIT Numerical Mathematics 49:1, 21-53. Crossref
(2009) Molecular Embedding via a Second Order Dissimilarity Parameterized Approach. SIAM Journal on Scientific Computing 31:4, 2733-2756. Abstract | PDF (523 KB) 
(2009) Generalized Newton-Type Methods for Energy Formulations in Image Processing. SIAM Journal on Imaging Sciences 2:2, 508-531. Abstract | PDF (3318 KB) 
(2009) Iterative Methods for Finding a Trust-region Step. SIAM Journal on Optimization 20:2, 1110-1131. Abstract | PDF (322 KB) 
(2009) Accelerated Line-search and Trust-region Methods. SIAM Journal on Numerical Analysis 47:2, 997-1018. Abstract | PDF (291 KB) 
(2009) A Trust-Region-Based BFGS Method with Line Search Technique for Symmetric Nonlinear Equations. Advances in Operations Research 2009, 1-22. Crossref
(2009) A Collinear Scaling Algorithm with Adaptive Trust Region for Unconstrained Optimization. 2009 Second International Conference on Information and Computing Science, 204-207. Crossref
(2008) Numerical research on the sensitivity of nonmonotone trust region algorithms to their parameters. Computers & Mathematics with Applications 56:11, 2932-2940. Crossref
(2008) On Lagrange multipliers of trust-region subproblems. BIT Numerical Mathematics 48:4, 763-768. Crossref
(2008) A variant of trust-region methods for unconstrained optimization. Applied Mathematics and Computation 203:1, 297-307. Crossref
(2008) A projected Newton-CG method for nonnegative astronomical image deblurring. Numerical Algorithms 48:4, 279-300. Crossref
(2008) Conformal equivalence of triangle meshes. ACM Transactions on Graphics 27:3, 1-11. Crossref
(2008) A smoothing trust-region Newton-CG method for minimax problem. Applied Mathematics and Computation 199:2, 581-589. Crossref
(2008) A modified trust region method with Beale’s PCG technique for optimization. Computational Optimization and Applications 40:1, 59-72. Crossref
2008. Reliability analysis and reliability-based design optimization using moment methods. Structural Design Optimization Considering Uncertainties, 57-85. Crossref
2008. A decoupled approach to reliability-based topology optimization for structural synthesis. Structural Design Optimization Considering Uncertainties, 281-305. Crossref
(2008) Algorithm 873. ACM Transactions on Mathematical Software 34:2, 1-28. Crossref
(2008) Optimisation of NMR dynamic models I. Minimisation algorithms and their performance within the model-free and Brownian rotational diffusion spaces. Journal of Biomolecular NMR 40:2, 107-119. Crossref
(2008) Inexact Newton Dogleg Methods. SIAM Journal on Numerical Analysis 46:4, 2112-2132. Abstract | PDF (334 KB) 
(2008) Dynamic Control of Infeasibility in Equality Constrained Optimization. SIAM Journal on Optimization 19:3, 1299-1325. Abstract | PDF (319 KB) 
(2008) Recursive Trust-Region Methods for Multiscale Nonlinear Optimization. SIAM Journal on Optimization 19:1, 414-444. Abstract | PDF (302 KB) 
2008. A Numerical Study of Active-Set and Interior-Point Methods for Bound Constrained Optimization. Modeling, Simulation and Optimization of Complex Processes, 273-292. Crossref
(2007) Design Of 2-D Recursive Digital Filters Using Nonsymmetric Half-Plane Allpass Filters. IEEE Transactions on Signal Processing 55:12, 5604-5618. Crossref
(2007) A nonmonotone trust region method based on nonincreasing technique of weighted average of the successive function values. Journal of Computational and Applied Mathematics 209:1, 97-108. Crossref
(2007) Trust-region interior-point method for large sparse l 1 optimization. Optimization Methods and Software 22:5, 737-753. Crossref
(2007) An improved inexact Newton method. Journal of Global Optimization 39:2, 221-234. Crossref
(2007) Convergence analysis of the Levenberg–Marquardt method. Optimization Methods and Software 22:4, 659-678. Crossref
(2007) Numerical simulation of geodynamic processes with the Portable Extensible Toolkit for Scientific Computation. Physics of the Earth and Planetary Interiors 163:1-4, 52-68. Crossref
(2007) Second-Order Approach to Optimal Semiconductor Design. Journal of Optimization Theory and Applications 133:2, 179-199. Crossref
(2007) Affine conjugate adaptive Newton methods for nonlinear elastomechanics. Optimization Methods and Software 22:3, 413-431. Crossref
(2007) Newton's method for optimal temperature-tracking of glass cooling processes. Inverse Problems in Science and Engineering 15:4, 303-323. Crossref
(2007) Dynamic level set regularization for large distributed parameter estimation problems. Inverse Problems 23:3, 1271-1288. Crossref
(2007) 3D human model and joint parameter estimation from monocular image. Pattern Recognition Letters 28:7, 797-805. Crossref
(2007) Augmented penalty algorithms based on BFGS secant approximations and trust regions. Applied Numerical Mathematics 57:3, 320-334. Crossref
(2007) A modified nearly exact method for solving low-rank trust region subproblem. Mathematical Programming 109:2-3, 385-411. Crossref
(2007) Iterative Solution of Augmented Systems Arising in Interior Methods. SIAM Journal on Optimization 18:2, 666-690. Abstract | PDF (276 KB) 
(2007) An Interior‐Point Trust‐Region Algorithm for General Symmetric Cone Programming. SIAM Journal on Optimization 18:1, 65-86. Abstract | PDF (234 KB) 
(2007) Improving Performance By Constraining Portfolio Norms: A Generalized Approach to Portfolio Optimization. SSRN Electronic Journal. Crossref
(2006) A subspace implementation of quasi-Newton trust region methods for unconstrained optimization. Numerische Mathematik 104:2, 241-269. Crossref
(2006) An interior algorithm for nonlinear optimization that combines line search and trust region steps. Mathematical Programming 107:3, 391-408. Crossref
(2006) A truncated-CG style method for symmetric generalized eigenvalue problems. Journal of Computational and Applied Mathematics 189:1-2, 274-285. Crossref
(2006) New Approach for System Reliability-Based Design Optimization. AIAA Journal 44:5, 1087-1096. Crossref
(2006) Matrix-free algorithm for the large-scale constrained trust-region subproblem. Optimization Methods and Software 21:2, 233-245. Crossref
(2006) A proximal-point SQP trust region method for solving some special class of nonlinear semi-definite programming problems. Applied Mathematics and Computation 174:2, 810-832. Crossref
(2006) A practical penalty trust-region method for equality-constrained optimization problems. Applied Mathematics and Computation 174:1, 578-587. Crossref
(2006) On the Solution of the Tikhonov Regularization of the Total Least Squares Problem. SIAM Journal on Optimization 17:1, 98-118. Abstract | PDF (272 KB) 
(2006) Subspace Trust‐Region Methods for Large Bound‐Constrained Nonlinear Equations. SIAM Journal on Numerical Analysis 44:4, 1535-1555. Abstract | PDF (237 KB) 
(2006) Finding Optimal Algorithmic Parameters Using Derivative‐Free Optimization. SIAM Journal on Optimization 17:3, 642-664. Abstract | PDF (283 KB) 
2006. Efficient methods for large-scale unconstrained optimization. Large-Scale Nonlinear Optimization, 185-210. Crossref
(2005) Exploiting Hessian matrix and trust-region algorithm in hyperparameters estimation of Gaussian process. Applied Mathematics and Computation 171:2, 1264-1281. Crossref
(2005) A descent method for regularization of ill-posed problems. Optimization Methods and Software 20:4-5, 615-625. Crossref
(2005) Minimization of Linear Functionals Defined on Solutions of Large-Scale Discrete Ill-Posed Problems. BIT Numerical Mathematics 45:2, 329-340. Crossref
(2005) Nonmonotone adaptive trust-region method for unconstrained optimization problems. Applied Mathematics and Computation 163:1, 489-504. Crossref
(2005) An adaptive approach of conic trust-region method for unconstrained optimization problems. Journal of Applied Mathematics and Computing 19:1-2, 165-177. Crossref
(2005) A trust region method for solving the decentralized static output feedback design problem. Journal of Applied Mathematics and Computing 18:1-2, 1-23. Crossref
(2005) Tomographic fluorescence imaging in tissue phantoms: a novel reconstruction algorithm and imaging geometry. IEEE Transactions on Medical Imaging 24:2, 137-154. Crossref
(2005) An Inexact Newton Method Derived from Efficiency Analysis. Journal of Global Optimization 31:2, 287-315. Crossref
(2005) Convergence of the Iterates of Descent Methods for Analytic Cost Functions. SIAM Journal on Optimization 16:2, 531-547. Abstract | PDF (277 KB) 
(2005) Parallel Lagrange--Newton--Krylov--Schur Methods for PDE-Constrained Optimization. Part II: The Lagrange--Newton Solver and Its Application to Optimal Control of Steady Viscous Flows. SIAM Journal on Scientific Computing 27:2, 714-739. Abstract | PDF (537 KB) 
(2005) A trust-region interior-point method for nonlinear programming. 2005 Richard Tapia Celebration of Diversity in Computing Conference, 7-9. Crossref
(2005) Globally Convergent Algorithm for Solving Large Nonlinear Systems of Equations. Numerical Functional Analysis and Optimization 25:3-4, 199-219. Crossref
2005. Adaptive Model Trust Region Methods for Generalized Eigenvalue Problems. Computational Science – ICCS 2005, 33-41. Crossref
2005. Recover Human Pose from Monocular Image Under Weak Perspective Projection. Computer Vision in Human-Computer Interaction, 36-46. Crossref
(2004) The bounded smooth reformulation and a trust region algorithm for semidefinite complementarity problems. Applied Mathematics and Computation 159:1, 157-170. Crossref
(2004) On the Convergence of a Trust-Region Method for Solving Constrained Nonlinear Equations with Degenerate Solutions. Journal of Optimization Theory and Applications 123:1, 187-211. Crossref
(2004) Keyframe-based tracking for rotoscoping and animation. ACM Transactions on Graphics 23:3, 584-591. Crossref
(2004) Active-Set Projected Trust-Region Algorithm for Box-Constrained Nonsmooth Equations. Journal of Optimization Theory and Applications 120:3, 601-625. Crossref
(2004) The trust region subproblem and semidefinite programming*. Optimization Methods and Software 19:1, 41-67. Crossref
(2003) An increasing-angle property of the conjugate gradient method and the implementation of large-scale minimization algorithms with line searches. Numerical Linear Algebra with Applications 10:4, 323-334. Crossref
(2003) Solving nonlinear magnetic problems using newton trust region methods. IEEE Transactions on Magnetics 39:3, 1709-1712. Crossref
(2003) Combining Trust Region and Line Search Methods for Equality Constrained Optimization. Numerical Functional Analysis and Optimization 24:1-2, 143-162. Crossref
(2003) Solving Karush--Kuhn--Tucker Systems via the Trust Region and the Conjugate Gradient Methods. SIAM Journal on Optimization 14:2, 439-463. Abstract | PDF (255 KB) 
(2003) Truncated Newton Methods for Optimization with Inaccurate Functions and Gradients. Journal of Optimization Theory and Applications 116:1, 83-98. Crossref
(2003) Trust region methods for solving the optimal output feedback design problem. International Journal of Control 76:5, 501-519. Crossref
2003. Inexactness Issues in the Lagrange-Newton-Krylov-Schur Method for PDE-constrained Optimization. Large-Scale PDE-Constrained Optimization, 93-114. Crossref
2003. Assessing the Potential of Interior Methods for Nonlinear Optimization. Large-Scale PDE-Constrained Optimization, 167-183. Crossref
2003. A truncated SQP algorithm for solving nonconvex equality constrained optimization problems. High Performance Algorithms and Software for Nonlinear Optimization, 149-176. Crossref
(2002) An iterative working-set method for large-scale nonconvex quadratic programming. Applied Numerical Mathematics 43:1-2, 109-128. Crossref
(2002) Exploiting the connection between PLS, Lanczos methods and conjugate gradients: alternative proofs of some properties of PLS. Journal of Chemometrics 16:7, 361-367. Crossref
(2002) Computational methods for a large-scale inverse problem arising in atmospheric optics. Inverse Problems 18:1, 237-252. Crossref
(2002) An Interior Point Constrained Trust Region Method for a Special Class of Nonlinear Semidefinite Programming Problems. SIAM Journal on Optimization 12:4, 1048-1074. Abstract | PDF (267 KB) 
(2002) Analysis of Inexact Trust-Region SQP Algorithms. SIAM Journal on Optimization 12:2, 283-302. Abstract | PDF (218 KB) 
2002. Numerical Methods for Large-Scale Non-Convex Quadratic Programming. Trends in Industrial and Applied Mathematics, 149-179. Crossref
(2001) A family of improved secant methods via nonmonotone curvilinear paths technique for equality constrained optimization. Journal of Computational and Applied Mathematics 136:1-2, 73-97. Crossref
(2001) Algorithm 809: PREQN. ACM Transactions on Mathematical Software 27:1, 83-91. Crossref
(2001) A New Matrix-Free Algorithm for the Large-Scale Trust-Region Subproblem. SIAM Journal on Optimization 11:3, 611-646. Abstract | PDF (347 KB) 
(2001) On the Solution of Equality Constrained Quadratic Programming Problems Arising in Optimization. SIAM Journal on Scientific Computing 23:4, 1376-1395. Abstract | PDF (204 KB) 
2001. A survey of truncated-Newton methods. Numerical Analysis: Historical Developments in the 20th Century, 265-279. Crossref
(2001) Further improvement of the Newton-PCG algorithm with automatic differentiation. Optimization Methods and Software 16:1-4, 151-178. Crossref
(2000) A survey of truncated-Newton methods. Journal of Computational and Applied Mathematics 124:1-2, 45-59. Crossref
(2000) Variable metric methods for unconstrained optimization and nonlinear least squares. Journal of Computational and Applied Mathematics 124:1-2, 61-95. Crossref
(2000) Theoretical Efficiency of an Inexact Newton Method. Journal of Optimization Theory and Applications 105:1, 97-112. Crossref
(2000) Implicitly restarted projection algorithm for solving optimization problems. Numerical Functional Analysis and Optimization 21:3-4, 319-336. Crossref
2000. Efficient Solution of Dynamic Optimization and NMPC Problems. Nonlinear Model Predictive Control, 219-243. Crossref
(1999) Two-Step Algorithms for Nonlinear Optimization with Structured Applications. SIAM Journal on Optimization 9:4, 924-947. Abstract | PDF (401 KB) 
(1999) Solving the Trust-Region Subproblem using the Lanczos Method. SIAM Journal on Optimization 9:2, 504-525. Abstract | PDF (432 KB) 
(1999) A Trust Region Method for Parabolic Boundary Control Problems. SIAM Journal on Optimization 9:4, 1064-1081. Abstract | PDF (371 KB) 
(1999) A Trust-Region Approach to Nonlinear Systems of Equalities and Inequalities. SIAM Journal on Optimization 9:2, 291-315. Abstract | PDF (436 KB) 
(1999) A Subspace, Interior, and Conjugate Gradient Method for Large-Scale Bound-Constrained Minimization Problems. SIAM Journal on Scientific Computing 21:1, 1-23. Abstract | PDF (396 KB) 
(1999) Incomplete Cholesky Factorizations with Limited Memory. SIAM Journal on Scientific Computing 21:1, 24-45. Abstract | PDF (403 KB) 
(1999) Newton's Method for Large Bound-Constrained Optimization Problems. SIAM Journal on Optimization 9:4, 1100-1127. Abstract | PDF (456 KB) 
(1999) An Interior Point Algorithm for Large-Scale Nonlinear Programming. SIAM Journal on Optimization 9:4, 877-900. Abstract | PDF (374 KB) 
(1998) Trust-Region Interior-Point SQP Algorithms for a Class of Nonlinear Programming Problems. SIAM Journal on Control and Optimization 36:5, 1750-1794. Abstract | PDF (650 KB) 
(1998) On the Implementation of an Algorithm for Large-Scale Equality Constrained Optimization. SIAM Journal on Optimization 8:3, 682-706. Abstract | PDF (418 KB) 
(1998) A Trust Region Method for Nonlinear Programming Based on Primal Interior-Point Techniques. SIAM Journal on Scientific Computing 20:1, 282-305. Abstract | PDF (465 KB) 
(1998) Computational experience with globally convergent descent methods for large sparse systems of nonlinear equations . Optimization Methods and Software 8:3-4, 201-223. Crossref
1998. The use of Band Matrices for Second Derivative Approximations in Trust Region Algorithms. Advances in Nonlinear Programming, 3-28. Crossref
(1997) Truncated Trust Region Methods Based on Preconditioned Iterative Subalgorithms for Large Sparse Systems of Nonlinear Equations. Journal of Optimization Theory and Applications 95:3, 637-658. Crossref
(1997) Automatic Determination of an Initial Trust Region in Nonlinear Programming. SIAM Journal on Scientific Computing 18:6, 1788-1803. Abstract | PDF (735 KB) 
(1997) On the Convergence Theory of Trust-Region-Based Algorithms for Equality-Constrained Optimization. SIAM Journal on Optimization 7:4, 927-950. Abstract | PDF (370 KB) 
(1997) Non-monotone trust-region algorithms for nonlinear optimization subject to convex constraints. Mathematical Programming 77:3, 69-94. Crossref
(1997) A Global Convergence Theory for General Trust-Region-Based Algorithms for Equality Constrained Optimization. SIAM Journal on Optimization 7:1, 177-207. Abstract | PDF (414 KB) 
(1997) Minimization of a Large-Scale Quadratic FunctionSubject to a Spherical Constraint. SIAM Journal on Optimization 7:1, 141-161. Abstract | PDF (321 KB) 
(1996) A Reflective Newton Method for Minimizing a Quadratic Function Subject to Bounds on Some of the Variables. SIAM Journal on Optimization 6:4, 1040-1058. Abstract | PDF (2363 KB) 
(1996) Convergence Properties of Minimization Algorithms for Convex Constraints Using a Structured Trust Region. SIAM Journal on Optimization 6:4, 1059-1086. Abstract | PDF (3077 KB) 
(1996) Hybrid methods for large sparse nonlinear least squares. Journal of Optimization Theory and Applications 89:3, 575-595. Crossref
(1996) An Interior Trust Region Approach for Nonlinear Minimization Subject to Bounds. SIAM Journal on Optimization 6:2, 418-445. Abstract | PDF (2671 KB) 
(1996) Interval methods for global optimization. Applied Mathematics and Computation 75:2-3, 179-206. Crossref
1996. Towards a Discrete Newton Method with Memory for Large-Scale Optimization. Nonlinear Optimization and Applications, 1-12. Crossref
1996. Trust-Region Interior-Point Algorithms for Minimization Problems with Simple Bounds. Applied Mathematics and Parallel Computing, 97-107. Crossref
1996. An Algorithm using Quadratic Interpolation for Unconstrained Derivative Free Optimization. Nonlinear Optimization and Applications, 27-47. Crossref
(1995) An Implicit Filtering Algorithm for Optimization of Functions with Many Local Minima. SIAM Journal on Optimization 5:2, 269-285. Abstract | PDF (1712 KB) 
(1995) An Interval Algorithm for Bound Constrained Global Optimization. Optimization Methods and Software 6:2, 145-159. Crossref
(1994) Inexact trust region method for large sparse systems of nonlinear equations. Journal of Optimization Theory and Applications 81:3, 569-590. Crossref
(1994) Convergence Theory of Nonlinear Newton–Krylov Algorithms. SIAM Journal on Optimization 4:2, 297-330. Abstract | PDF (3538 KB) 
1994. An Overview of Unconstrained Optimization. Algorithms for Continuous Optimization, 109-143. Crossref
1994. Large-scale Nonlinear Constrained Optimization: a Current Survey. Algorithms for Continuous Optimization, 287-332. Crossref
1994. Performance of a Multifrontal Scheme for Partially Separable Optimization. Advances in Optimization and Numerical Analysis, 79-96. Crossref
(1993) Non-linear optimization for seismic traveltime tomography. Geophysical Journal International 115:3, 929-940. Crossref
(1993) Nonmonotonic trust region algorithm. Journal of Optimization Theory and Applications 76:2, 259-285. Crossref
(1992) Nonmonotone trust region methods with curvilinear path in unconstrained optimization. Computing 48:3-4, 303-317. Crossref
(1992) Superlinear convergence theorems for Newton-type methods for nonlinear systems of equations. Journal of Optimization Theory and Applications 73:2, 269-277. Crossref
(1992) Theory of algorithms for unconstrained optimization. Acta Numerica 1, 199-242. Crossref
(1991) Convergence of Trust Region Algorithms for Optimization with Bounds when Strict Complementarity Does Not Hold. SIAM Journal on Numerical Analysis 28:2, 476-495. Abstract | PDF (1928 KB) 
(1991) A Globally Convergent Augmented Lagrangian Algorithm for Optimization with General Constraints and Simple Bounds. SIAM Journal on Numerical Analysis 28:2, 545-572. Abstract | PDF (2878 KB) 
(1991) On the Global Convergence of Trust Region Algorithms Using Inexact Gradient Information. SIAM Journal on Numerical Analysis 28:1, 251-265. Abstract | PDF (1611 KB) 
(1990) Hybrid Krylov Methods for Nonlinear Systems of Equations. SIAM Journal on Scientific and Statistical Computing 11:3, 450-481. Abstract | PDF (3231 KB) 
(1989) On the limited memory BFGS method for large scale optimization. Mathematical Programming 45:1-3, 503-528. Crossref
(1989) A truncated Newton method with nonmonotone line search for unconstrained optimization. Journal of Optimization Theory and Applications 60:3, 401-419. Crossref
(1989) Truncated Newton method for sparse unconstrained optimization using automatic differentiation. Journal of Optimization Theory and Applications 60:2, 261-275. Crossref
1989. Chapter I A view of unconstrained optimization. Optimization, 1-72. Crossref
(1988) Partially separable optimization and parallel computing. Annals of Operations Research 14:1, 213-224. Crossref
(1988) Large-Scale Unconstrained Optimization On the Fps 164 and Cray X-MP Vector Processors. The International Journal of Supercomputing Applications 2:1, 66-81. Crossref
(1988) Numerical experience with the truncated Newton method for unconstrained optimization. Journal of Optimization Theory and Applications 56:2, 245-255. Crossref
(1988) A chordal preconditioner for large-scale optimization. Mathematical Programming 40-40:1-3, 265-287. Crossref
(1987) An algorithm for solving sparse Nonlinear Least Squares problems. Computing 39:4, 307-325. Crossref
(1987) On Large Scale Nonlinear Least Squares Calculations. SIAM Journal on Scientific and Statistical Computing 8:3, 416-435. Abstract | PDF (2199 KB) 
1987. Curvilinear path and trust region in unconstrained optimization: A convergence analysis. Nonlinear Analysis and Optimization, 82-101. Crossref
(1985) Conditions for convergence of trust region algorithms for nonsmooth optimization. Mathematical Programming 31:2, 220-228. Crossref
(1985) An inexact Levenberg-Marquardt method for large sparse nonlinear least squres. The Journal of the Australian Mathematical Society. Series B. Applied Mathematics 26:4, 387-403. Crossref
1984. Chapter 5 Large unconstrained optimization problems. Large Sparse Numerical Optimization, 68-97. Crossref
(1983) Local and superlinear convergence for truncated iterated projections methods. Mathematical Programming 27:2, 176-190. Crossref
Incomplete Cholesky factorization in fixed memory with flexible drop-tolerance strategy. Second IEEE International Workshop on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications, 2003. Proceedings, 87-93. Crossref
Scalable libraries for solving systems of nonlinear equations and unconstrained minimization problems. Proceedings Scalable Parallel Libraries Conference, 60-67. Crossref
Combining regularization frameworks for image deblurring: optimization of combined hyper-parameters. Canadian Conference on Electrical and Computer Engineering 2004 (IEEE Cat. No.04CH37513), 723-726. Crossref