Suspended sediment yield estimation using genetic algorithm-based artificial intelligence models: case study of Mahanadi River,India

The estimation of sediment yield is important in design, planning and management of river systems. Unfortunately, its accurate estimation using traditional methods is difficult as it involves various complex processes and variables. This investigation deals with a hybrid approach which comprises genetic algorithm-based artificial intelligence (GA-AI) models for the prediction of sediment yield in the Mahanadi River basin, India. Artificial neural network (ANN) and support vector machine (SVM) models are developed for sediment yield prediction, where all parameters associated with the models are optimized using genetic algorithms simultaneously. Water discharge, rainfall and temperature are used as input to develop the GA-AI models. The performance of the GA-AI models is compared to that of traditional AI models (ANN and SVM), multiple linear regression (MLR) and sediment rating curve (SRC) method for evaluating the predictive capability of the models. The results suggest that GA-AI models exhibit better performance than other models.     

Prediction of flow rate of karstic springs using support vector machines

Complex void space structure and flow patterns in karstic aquifers render behaviour prediction of karstic springs difficult. Four support vector regression-based models are proposed to predict flow rates from two adjacent karstic springs in Greece (Mai Vryssi and Pera Vryssi). Having no accurate estimates of the groundwater flow pattern, we used four kernels: linear, polynomial, Gaussian radial basis function and exponential radial basis function (ERBF). The data used for training and testing included daily and mean monthly precipitation, and spring flow rates. The support vector machine (SVM) performance depends on hyper-parameters, which were optimized using a grid search approach. Model performance was evaluated using root mean square error and correlation coefficient. Polynomial kernel performed better for Mai Vryssi and the ERBF for Pera Vryssi. All models except one performed better for Pera Vryssi. Our models performed better than generalized regression neural network, radial basis function neural network and ARIMA models.     

A hybrid machine learning ensemble approach based on a Radial Basis Function neural network and Rotation Forest for landslide susceptibility modeling: A case study in the Himalayan area,India

In this paper, a hybrid machine learning ensemble approach namely the Rotation Forest based Radial Basis Function (RFRBF) neural network is proposed for spatial prediction of landslides in part of the Himalayan area (India). The proposed approach is an integration of the Radial Basis Function (RBF) neural network classifier and Rotation Forest ensemble, which are state-of-the art machine learning algorithms for classification problems. For this purpose, a spatial database of the study area was established that consists of 930 landslide locations and fifteen influencing parameters (slope angle, road density, curvature, land use, distance to road, plan curvature, lineament density, distance to lineaments, rainfall, distance to river, profile curvature, elevation, slope aspect, river density, and soil type). Using the database, training and validation datasets were generated for constructing and validating the model. Performance of the model was assessed using the Receiver Operating Characteristic (ROC) curve, area under the ROC curve (AUC), statistical analysis methods, and the Chi square test. In addition, Logistic Regression (LR), Multi-layer Perceptron Neural Networks (MLP Neural Nets), Naïve Bayes (NB), and the hybrid model of Rotation Forest and Decision Trees (RFDT) were selected for comparison. The results show that the proposed RFRBF model has the highest prediction capability in comparison to the other models (LR, MLP Neural Nets, NB, and RFDT); therefore, the proposed RFRBF model is promising and should be used as an alternative technique for landslide susceptibility modeling.     

Real‐time recurrent learning neural network for stream‐flow forecasting

Various types of neural networks have been proposed in previous papers for applications in hydrological events. However, most of these applied neural networks are classified as static neural networks, which are based on batch processes that update action only after the whole training data set has been presented. The time variate characteristics in hydrological processes have not been modelled well. In this paper, we present an alternative approach using an artificial neural network, termed real‐time recurrent learning (RTRL) for stream‐flow forecasting. To define the properties of the RTRL algorithm, we first compare the predictive ability of RTRL with least‐square estimated autoregressive integrated moving average models on several synthetic time‐series. Our results demonstrate that the RTRL network has a learning capacity with high efficiency and is an adequate model for time‐series prediction. We also investigated the RTRL network by using the rainfall–runoff data of the Da‐Chia River in Taiwan. The results show that RTRL can be applied with high accuracy to the study of real‐time stream‐flow forecasting networks. Copyright © 2002 John Wiley & Sons, Ltd.     

Time-domain modeling of global ocean tides generated by the full lunisolar potential

Traditionally, ocean tides have been modeled in frequency domain with a forcing from selected tidal constituents. It is a natural approach; however, it implicitly neglects non-linearities of ocean dynamics. An alternative approach is time-domain modeling with a forcing given by the full lunisolar potential, i.e., all tidal waves are a priori included. This approach has been applied in several ocean tide models; however, some challenging tasks still remain, for example, assimilation of satellite altimetry data. In this paper, we introduce the assimilative scheme applicable in a time-domain model, which is an alternative to existing techniques used in assimilative ocean tide models. We present results from DEBOT, a global barotropic ocean tide model, which has two modes: DEBOT-h, a purely hydrodynamical mode, and DEBOT-a, an assimilative mode. The accuracy of DEBOT in both modes is assessed through a series of tests against tide gauge data which demonstrate that DEBOT is comparable to state-of-the-art global ocean tide models for major tidal constituents. Furthermore, as signals of all tidal frequencies are included in DEBOT, we also discuss modeling of minor tidal constituents and non-linear compound tides. Our modeling approach can be useful for those applications where the frequency domain approach is not suitable.     

Modelling evapotranspiration using discrete wavelet transform and neural networks

This study combines wavelet transforms and feed‐forward neural network methods for reference evapotranspiration estimation. The climatic data (air temperature, solar radiation, wind speed, relative humidity) from two stations in the United States was evaluated for estimating models. For wavelet and neural network (WNN) model, the input data was decomposed into wavelet sub‐time series by wavelet transformation. Later, the new series (reconstructed series) are produced by adding the available wavelet components and these reconstructed series are used as the input of the WNN model. This phase is pre‐processing of raw data and the main different of the WNN model. The performance of the WNN model was compared with classical neural networks approach [artificial neural network (ANN)], multi‐linear regression and Hargreaves empirical method. This study shows that the wavelet transforms and neural network methods could be applied successfully for evapotranspiration modelling from climatic data. Copyright © 2009 John Wiley & Sons, Ltd.     

Neural networks for quick earthquake damage estimation

This paper proposes the use of neural networks to predict damage due to earthquakes from the indices of recorded ground motion. Since the relationship between ground motion indices and resulting damage is difficult to express in mathematical form, neural networks are conveniently applied for this problem. Simulated earthquake ground motions are used to have a well-distributed data set and the ductility factor from non-linear analysis of two single-degree-of-freedom structural models is used to represent the damage. A sensitivity analysis procedure is described to identify qualitatively the input parameters that have a greater influence on the damage. The result of the trained neural network is then verified by using several recorded earthquake ground motions. It is found that some instability in the prediction can occur. Instability occurs when input values exceed the range of the training data. The neural network model using PGA and SI as input give the best performance in the recall tests using actual earthquake ground motion, demonstrating the usefulness of neural network models for the quick estimation of damage through earthquake intensity monitoring.     

Interpretation of spontaneous potential anomalies from some simple geometrically shaped bodies using neural network inversion

A new approach is proposed in order to interpret spontaneous potential (self-potential) anomalies related to simple geometric-shaped models such as sphere, horizontal cylinder, and vertical cylinder. This approach is mainly based on using neural network inversion of SP anomalies, particularly modular algorithm, for estimating the parameters of different simple geometrical bodies. However, Hilbert transforms are involved to determine the origin location in order to reduce the parameters which minimize the ambiguity in the inverted models. The inversion has been tested first on synthetic data from different models, using only one well-trained network. The results of inversion show that the parameter values derived by the inversion are identical to the true values of parameters. Noise analysis has been also examined, where the results of the inversion produce acceptable results up to 10% of white Gaussian noise. The validity of the neural network inversion is demonstrated through published real field SP taken from southern Bavarian Woods, Germany. A comparable and acceptable agreement is shown between the results of inversion derived by the neural network and those from the real field data.     

A systematic approach to the input determination for neural network rainfall–runoff models

Input determination has a great influence on the performance of artificial neural network (ANN) rainfall–runoff models. To improve the performance of ANN models, a systematic approach to the input determination for ANN models is proposed. In the proposed approach, the irrelevant inputs are removed. Then an adequate ANN model, which only includes highly relevant inputs, is constructed. Unlike the trial‐and‐error procedure, the proposed approach is more systematic and avoids unnecessary trials. To demonstrate the effectiveness of the proposed approach, an application to actual typhoon events is presented. The results show that the proposed ANN model, which is constructed by the proposed approach, has advantages over those obtained by the trial‐and‐error procedure. The proposed ANN model has a simpler architecture, needs less training time, and performs better. The proposed ANN model is recommended as an alternative to existing rainfall–runoff ANN models. Copyright © 2007 John Wiley & Sons, Ltd.     

Combining discrete cosine transform and convolutional neural networks to speed up the Hamiltonian Monte Carlo inversion of pre-stack seismic data

Markov chain Monte Carlo algorithms are commonly employed for accurate uncertainty appraisals in non-linear inverse problems. The downside of these algorithms is the considerable number of samples needed to achieve reliable posterior estimations, especially in high-dimensional model spaces. To overcome this issue, the Hamiltonian Monte Carlo algorithm has recently been introduced to solve geophysical inversions. Different from classical Markov chain Monte Carlo algorithms, this approach exploits the derivative information of the target posterior probability density to guide the sampling of the model space. However, its main downside is the computational cost for the derivative computation (i.e. the computation of the Jacobian matrix around each sampled model). Possible strategies to mitigate this issue are the reduction of the dimensionality of the model space and/or the use of efficient methods to compute the gradient of the target density. Here we focus the attention to the estimation of elastic properties (P-, S-wave velocities and density) from pre-stack data through a non-linear amplitude versus angle inversion in which the Hamiltonian Monte Carlo algorithm is used to sample the posterior probability. To decrease the computational cost of the inversion procedure, we employ the discrete cosine transform to reparametrize the model space, and we train a convolutional neural network to predict the Jacobian matrix around each sampled model. The training data set for the network is also parametrized in the discrete cosine transform space, thus allowing for a reduction of the number of parameters to be optimized during the learning phase. Once trained the network can be used to compute the Jacobian matrix associated with each sampled model in real time. The outcomes of the proposed approach are compared and validated with the predictions of Hamiltonian Monte Carlo inversions in which a quite computationally expensive, but accurate finite-difference scheme is used to compute the Jacobian matrix and with those obtained by replacing the Jacobian with a matrix operator derived from a linear approximation of the Zoeppritz equations. Synthetic and field inversion experiments demonstrate that the proposed approach dramatically reduces the cost of the Hamiltonian Monte Carlo inversion while preserving an accurate and efficient sampling of the posterior probability.     

A wavelet based approach for combining the outputs of different rainfall–runoff models

The rainfall–runoff modelling being a stochastic process in nature is dependent on various climatological variables and catchment characteristics and therefore numerous hydrological models have been developed to simulate this complex process. One approach to modelling this complex non-linear rainfall–runoff process is to combine the outputs of various models to get more accurate and reliable results. This multi-model combination approach relies on the fact that various models capture different features of the data, and hence combination of these features would yield better result. This study for the first time presented a novel wavelet based combination approach for estimating combined runoff The simulated daily output (Runoff) of five selected conventional rainfall–runoff models from seven different catchments located in different parts of the world was used in current study for estimating combined runoff for each time period. Five selected rainfall–runoff models used in this study included four data driven models, namely, the simple linear model, the linear perturbation model, the linearly varying variable gain factor model, the constrained linear systems with a single threshold and one conceptual model, namely, the soil moisture accounting and routing model. The multilayer perceptron neural network method was used to develop combined wavelet coupled models to evaluate the effect of wavelet transformation (WT). The performance of the developed wavelet coupled combination models was compared with their counterpart simple combination models developed without WT. It was concluded that the presented wavelet coupled combination approach outperformed the existing approaches of combining different models without applying input WT. The study also recommended that different models in a combination approach should be selected on the basis of their individual performance.     

Predicting catchment flow in a semi‐arid region via an artificial neural network technique

A model of rainfall–runoff relationships is an essential tool in the process of evaluation of water resources projects. In this paper, we applied an artificial neural network (ANN) based model for flow prediction using the data for a catchment in a semi‐arid region in Morocco. Use of this method for non‐linear modelling has been demonstrated in several scientific fields such as biology, geology, chemistry and physics. The performance of the developed neural network‐based model was compared against multiple linear regression‐based model using the same observed data. It was found that the neural network model consistently gives superior predictions. Based on the results of this study, artificial neural network modelling appears to be a promising technique for the prediction of flow for catchments in semi‐arid regions. Accordingly, the neural network method can be applied to various hydrological systems where other models may be inappropriate. Copyright © 2004 John Wiley & Sons, Ltd.     

Intelligent reservoir operation system based on evolving artificial neural networks

We propose a novel intelligent reservoir operation system based on an evolving artificial neural network (ANN). Evolving means the parameters of the ANN model are identified by the GA evolutionary optimization technique. Accordingly, the ANN model should represent the operational strategies of reservoir operation. The main advantages of the Evolving ANN Intelligent System (ENNIS) are as follows: (i) only a small number of parameters to be optimized even for long optimization horizons, (ii) easy to handle multiple decision variables, and (iii) the straightforward combination of the operation model with other prediction models. The developed intelligent system was applied to the operation of the Shihmen Reservoir in North Taiwan, to investigate its applicability and practicability. The proposed method is first built to a simple formulation for the operation of the Shihmen Reservoir, with single objective and single decision. Its results were compared to those obtained by dynamic programming. The constructed network proved to be a good operational strategy. The method was then built and applied to the reservoir with multiple (five) decision variables. The results demonstrated that the developed evolving neural networks improved the operation performance of the reservoir when compared to its current operational strategy. The system was capable of successfully simultaneously handling various decision variables and provided reasonable and suitable decisions.     

Simulating and predicting river discharge time series using a wavelet‐neural network hybrid modelling approach

Accurate simulation and prediction of the dynamic behaviour of a river discharge over any time interval is essential for good watershed management. It is difficult to capture the high‐frequency characteristics of a river discharge using traditional time series linear and nonlinear model approaches. Therefore, this study developed a wavelet‐neural network (WNN) hybrid modelling approach for the predication of river discharge using monthly time series data. A discrete wavelet multiresolution method was employed to decompose the time series data of river discharge into sub‐series with low (approximation) and high (details) frequency, and these sub‐series were then used as input data for the artificial neural network (ANN). WNN models with different wavelet decomposition levels were employed to predict river discharge 48 months ahead of time. Comparison of results from the WNN models with those of the ANN models alone indicated that WNN models performed a more accurate prediction. Copyright © 2011 John Wiley & Sons, Ltd.     

Modeling and Prediction of Monthly Total Ozone Concentrations by Use of an Artificial Neural Network Based on Principal Component Analysis

In the work discussed in this paper we considered total ozone time series over Kolkata (22°34′10.92″N, 88°22′10.92″E), an urban area in eastern India. Using cloud cover, average temperature, and rainfall as the predictors, we developed an artificial neural network, in the form of a multilayer perceptron with sigmoid non-linearity, for prediction of monthly total ozone concentrations from values of the predictors in previous months. We also estimated total ozone from values of the predictors in the same month. Before development of the neural network model we removed multicollinearity by means of principal component analysis. On the basis of the variables extracted by principal component analysis, we developed three artificial neural network models. By rigorous statistical assessment it was found that cloud cover and rainfall can act as good predictors for monthly total ozone when they are considered as the set of input variables for the neural network model constructed in the form of a multilayer perceptron. In general, the artificial neural network has good potential for predicting and estimating monthly total ozone on the basis of the meteorological predictors. It was further observed that during pre-monsoon and winter seasons, the proposed models perform better than during and after the monsoon.     

Inference model derivation with a pattern analysis for predicting the risk of microbial pollution in a sewer system

Developing a mathematical model for predicting fecal coliform bacteria concentration is very important because it can provide a basis for water quality management decisions that can minimize microbial pollution risk to the public. This paper introduces a hybrid modeling methodology which is a combined use of a neural network-based pattern analysis and an evolutionary process model induction system. The neural network-based pattern analysis technique is applied to extract knowledge on inter-relationships between fecal coliform concentrations and other measurable variables in a sewer system. Based on the result of neural network-based pattern analysis, an evolutionary process model induction system is used to derive mathematical inference models that can predict fecal coliform bacteria concentration from easily measurable variables instead of directly measuring fecal coliform bacteria concentration in a sewer system. The neural network-based pattern analysis extracts that temperature and ammonia concentration are the most important driving forces leading to an increase in fecal coliform bacteria concentration in the sewer system at Paraparaumu City, New Zealand. Fecal coliform bacteria concentration is also positively correlated with dissolved phosphorus and inversely with flow rate. The multivariate inference models that are able to predict fecal coliform bacteria concentration are successfully derived as functions of flow rate, temperature, ammonia, and dissolved phosphorus in the form of understandable mathematical formulae using the evolutionary process model induction system, even if a priori mathematical knowledge of the dynamic nature of fecal coliform bacteria is poor. The multivariate inference models evolved by the evolutionary process model induction system produce a slightly better performance than the multi-layer perceptron neural network model.     

Wavelet analysis residual kriging vs. neural network residual kriging

 This paper deals with the problem of spatial data mapping. A new method based on wavelet interpolation and geostatistical prediction (kriging) is proposed. The method – wavelet analysis residual kriging (WARK) – is developed in order to assess the problems rising for highly variable data in presence of spatial trends. In these cases stationary prediction models have very limited application. Wavelet analysis is used to model large-scale structures and kriging of the remaining residuals focuses on small-scale peculiarities. WARK is able to model spatial pattern which features multiscale structure. In the present work WARK is applied to the rainfall data and the results of validation are compared with the ones obtained from neural network residual kriging (NNRK). NNRK is also a residual-based method, which uses artificial neural network to model large-scale non-linear trends. The comparison of the results demonstrates the high quality performance of WARK in predicting hot spots, reproducing global statistical characteristics of the distribution and spatial correlation structure.     

Modified NLPM-ANN model and its application

The non-linear perturbation model based on artificial neural network (NLPM-ANN) takes advantage of the consideration of seasonal information by the linear perturbation model (LPM) and the notable non-linear simulation capability of artificial neural network (ANN). However, this model does not take account of antecedent catchment wetness that may effect the simulation and forecasting accuracy. A modified NLPM-ANN model is proposed and developed to take the consideration of antecedent catchment wetness. The output perturbing terms of the response function in the simple linear model (SLM) in an auxiliary component are taken as inputs of ANN to represent catchment wetness. The simulated total runoff is obtained by integrating the outputs of ANN with that of the seasonal model. The rainfall–runoff data of eight catchments were selected and used to compare the modified NLPM-ANN with the NLPM-ANN models. Results show that the modified NLPM-ANN is significantly superior to the NLPM-ANN, and the model component efficiency index values are 16.82% and 16.74% over the NLPM-ANN during calibration and verification periods, respectively.     

基于遗传神经网络的大地电磁反演

为进一步提高大地电磁非线性反演的稳定性、运算效率及准确度,将遗传神经网络算法引入大地电磁反演.首先针对大地电磁二维地电模型建立BP（Back Propagation）神经网络基本框架进行学习训练,网络输入为已知地电模型的视电阻率参数,输出为该地电模型参数;再利用遗传算法对神经网络学习训练过程进行优化,计算出多种地电模型网络连接权值和阈值的最优解;最后将最优连接权值和阈值对未知模型进行反演测试,网络输入为未知地电模型的视电阻率参数,输出为该地电模型参数.模型实验表明：遗传神经网络算法充分结合了遗传算法的全局寻优性和神经网络的局部寻优性,相比单一神经网络算法,在网络学习训练中提高了解的收敛成功率和计算速度,在反演测试中能更准确地逼近真实模型.将遗传神经网络算法与最小二乘正则化反演进行对比,理论模型和实测数据都验证了遗传神经网络算法在大地电磁反演中的可行性和有效性.