Parameter Estimation Schemes for Solving ADH Groundwater Models

1. Use of Derivatives Parameter Estimation Schemes for Solving ADH Groundwater Models Mark Byers¹ Miguel Argáez¹, Jackie Hallberg² and Leticia Velázquez¹ ² US Army Corps of Engineers ¹ Department of Mathematical Sciences The University of Texas at El Paso ADH The hybrid optimization code is intended to solve large-scale problems of interest to ERDC. The code is based on the coupling of Simultaneous Perturbation Stochastic Approximation (SPSA) approach by Spall (a global derivative free optimization method) with two local and derivative dependent optimization methods: a globalized Newton-Krylov Interior-Point (NKIP) algorithm developed by Argaez, and the Global Levenberg-Marquardt (GLM) method introudced by Velazquez et. al. Finding a global solution in parameter estimation is difficult since models are usually nonlinear, non-smooth and subject to different sources of errors. SPSA performs random simultaneous perturbations of all model parameters to generate a descent direction at each iteration. Advantages of the SPSA algorithm are its simplicity, flexibility and low computational cost (at most 2 function evaluations at each iteration). A multi-start initial guess can be used with SPSA to help speed up the process of detecting the most promising search regions. Next, a sequence of surrogate models are built, and then the use of NKIP or GLM precedes until convergence to an optimal solution is reached. Hybrid Optimization Code Future Plans • ADH is a state-of-the-art modeling system, developed by the Coastal and Hydraulics Laboratory at ERDC, that is capable of handling both saturated and unsaturated groundwater, overland flow, three-dimensional Navier-Stokes flow, and two- or three-dimensional shallow water problems. Applications include the drainage through heterogeneous soil and rainfall/runoff in a simple test basin. • ADH uses the Galerkin Finite Element Method to solve the heat equation problem with local mesh refinement/coarsening to capture steep gradients. A linear system must be solved in each Newton iteration. ADH offers 4 preconditioners including Point Jacobi and Two-Level Additive Schwarz that can dramatically reduce the number of iterations. • We plan to couple the hybrid optimization algorithm with ADH to demonstrate the effectiveness of this scheme. We will compare the results obtained by the PEST and hybrid scheme. Abstract References • A hybrid optimization MATLAB code is being developed by the University of Texas at El Paso (UTEP) and University of Texas at Austin that is to be used with the ADH (ADaptive Hydraulics) groundwater model constructed at the Engineering Research Development Center (ERDC).  The hybrid code offers a combined global and local optimization method by coupling Newton-Krylov Interior-Point (NKIP), Global Levenberg-Marquardt (GLM) and the Simultaneous Perturbation Stochastic Analysis (SPSA) methods. The current model problem uses ADH in conjunction with a nonlinear parameter estimation package named PEST. Our goal is to replace PEST with our hybrid optimization code that has potential application to the parameter estimation problems faced by the ERDC. • A Hybrid Optimization Approach for Automated Parameter Estimation Problem, Miguel Argaez, Hector Klie, Carlos Quintero, Leticia Velazquez and Mary Wheeler, Technical Report 2007. • Projected Conjugate Gradient for Constrained Optimization, Miguel Argaez, Technical Report 2007. • PEST, Parameter Estimation and Uncertainty Analysis Software, 2006 • Numerical Comparisons of path-following Strategies for a Primal-Dual Interior-Point Method for Nonlinear Programming}, Miguel Argaez, R. Tapia, and L. Velazquez, Journal of Optimization Theory and Applications, Vol. 114(2):255-272, 2002. • Selective Search for Global Optimization of Zero or Small Residual Least-Squares Problems: A Numerical Study, Leticia Velazquez, Richard Tapia, and Yin Zhang, Computational Optimization and Applications: An international Journal, Vol. 20(3):299-315, 2001. • User's manual for Groundwater/Surface Water Interaction using ADH, S. E. Howington, R. C. Berger, E. W. Jenkins, J. P. Hallberg, K. R. Kavanagh, and J. H. Schmidt, July 2003. • M. Argáez, R. Sáenz, and L. Velázquez. A trust–region interior–point algorithm for nonnegative constrained minimization. Technical report, Department of Mathematics, The University of Texas at El Paso, 2004 • J. C. Spall. Introduction to stochastic search and optimization: Estimation, simulation and control. John Wiley & Sons, Inc., New Jersey, 2003. • M. Argáez and R.A. Tapia. On the global convergence of a modified augmented Lagrangian linesearch interior-point Newton method for nonlinear programming. J. Optim. Theory Appl., 114:1–25, 2002. Heat equation in 3d Model Problem where Global Search Via SPSA STOP • u is the temperature as a function of time and space • ut is the rate of change of temperature at a point over time • k is a material-specific quantity depending on the • thermal conductivity, density and heat capacity • ADH is modeling a heat transport problem using measurements from an arid region. The site is a desert landscape with disturbed soil at 768 meters in elevation. During a period of 5 days, various types of measurements that were taken include temperature, velocity, saturation, soil properties and wind speed. There are m=468 observations and n=7 parameters. The parameters are the specific heat and thermal conductivity of the undisturbed silt, disturbed soil and road surface, and the bulk emissivity of the road surface Iterate and look for another prospective Explore Space Enough Sampling? Compute NLS residuals until convergence is reached No PEST Yes • PEST is a nonlinear parameter estimation package capable of estimating parameters for any computer model. It solves a nonlinear least squares problem and minimizes the differences between the model's outputs and field measurements such as the calculated and measured temperature. PEST communicates with a model through the model's input and output files and uses a roubust variant of the Gauss-Marquardt-Levenberg method of nonlinear parameter estimation. Further, through adjustment of a number of control variables, a user is able to "tune" PEST's implementation of the method to suit the model for which parameters are sought. ADH and PEST work together to solve the current model problem. Surrogate Model Exploit sensitivity structure of the problem Arid Region Model Input elevation(m), Latitude, Longitude, GMT-Local 768 3433 2 24.26 250.79 -3 1 9999 2 Press Temp Rh WdSp Dirct Vis Aer Prec C l o u d x x Solar Solar Solar … Day Hour (mb) (C) (%) (m/s) (deg) (km) H mm/hrP t L t M t H Global Direct diffuse 344 0 974.3 6.9 25.8 0.70 126.1 30.9 10 0 1 0 0 0 0 0 0 0.00 999.00 0.00 344 1 974.0 6.0 27.1 0.52 207.9 33.5 10 0 1 0 0 0 0 0 0 0.00 999.00 0.00 344 2 973.9 7.3 23.5 0.98 330.3 33.8 10 0 1 0 0 0 0 0 0 0.00 999.00 0.00 344 3 973.2 7.7 22.0 0.68 332.2 33.9 10 0 1 0 0 0 0 0 0 0.00 999.00 0.00 344 4 973.0 5.8 25.2 0.05 155.7 34.2 10 0 1 0 0 0 0 0 0 0.00 999.00 0.00 …………………………………………………………………………………………..…………. …………………………………………………………………………………………………….. 349 19 975.1 11.8 19.5 0.69 133.2 28.2 10 0 1 0 0 0 0 0 0 0.00 999.00 80.02 349 20 975.9 11.2 20.6 0.84 117.9 13.1 10 0 1 0 0 0 0 0 0 0.00 999.00 92.8 349 21 976.0 10.0 22.3 0.47 164.6 18.4 10 0 1 0 0 0 0 0 0 0.00 999.00 111.43 349 22 976.0 6.4 27.0 0.09 223.5 25.4 10 0 1 0 0 0 0 0 0 0.00 999.00 127.70 349 23 976.0 6.6 27.5 0.26 241.8 24.6 10 0 1 0 0 0 0 0 0 0.00 999.00 136.02 Nonlinear Least Squares (NLS) Solution via GLM/NKIP Acknowledgement Preliminary Numerical Results This work is being supported by the US Corps of Engineers Contract No. W912HZ-06-P-0402. We conducted an independent experimentation on a parameter estimation problem using sensor pressure data applying GLM. This analysis shows that even do we have full information of the fluid flow pressure field in this small case, the inverse problem is still highly ill-posed and has multiple local minima. We also conducted the same experimentation using SPSA combined with NKIP (see poster presentation by Carlos Quintero), and we also obtained promising results. Contact Information Mark Byers, Graduate Student The University of Texas at El Paso Department of Mathematical Sciences 500 W. University Avenue El Paso, Texas 79968-0514 Email: markb@utep.edu Phone: (915) 747-7005 ADH-PEST Output Machine: AMD 3200+, CPU Time: 32 minutes Residual_L2_norm = f(w*)= 3.670591534e-07 Total number of linear iterations = 68178 Total number of nonlinear iterations = 2542 Parameter Name: shs=specific heat thk=thermal conductivity ems=bulk emissivity Material Property: 1= Undisturbed Silt, 2=Disturbed Soil, 3= Road Surface Solution w*= (shs1,thk1,shs2,thk2,shs3,thk3,ems3)= (3.74x10-4 , 0.397, 1.03x10-4, 0.340, 1.56x10-4, 0.268, 0.938) Arid Region Landscape