Incorporating synoptic-scale climate signals for streamflow modelling over the Mediterranean region using machine learning models

ABSTRACT

Understanding streamflow patterns by incorporating climate signal information can contribute remarkably to the knowledge of future local environmental flows. Three machine learning models, the multivariate adaptive regression splines (MARS), the M5 Model Tree and the least squares support vector machine (LSSVM) are established to predict the streamflow pattern over the Mediterranean region of Turkey (Besiri and Baykan stations). The structure of the predictive models is built using synoptic-scale climate signal information and river flow data from antecedent records. The predictive models are evaluated and assessed using quantitative and graphical statistics. The correlation analysis demonstrates that the North Pacific (NP) and the East Central Tropical Pacific Sea Surface Temperature (Niño3.4) indices have a substantial influence on the streamflow patterns, in addition to the historical information obtained from the river flow data. The model results reveal the utility of the LSSVM model over the other models through incorporating climate signal information for modelling streamflow.     

Streamflow forecasting using least-squares support vector machines

Abstract

This paper investigates the ability of a least-squares support vector machine (LSSVM) model to improve the accuracy of streamflow forecasting. Cross-validation and grid-search methods are used to automatically determine the LSSVM parameters in the forecasting process. To assess the effectiveness of this model, monthly streamflow records from two stations, Tg Tulang and Tg Rambutan of the Kinta River in Perak, Peninsular Malaysia, were used as case studies. The performance of the LSSVM model is compared with the conventional statistical autoregressive integrated moving average (ARIMA), the artificial neural network (ANN) and support vector machine (SVM) models using various statistical measures. The results of the comparison indicate that the LSSVM model is a useful tool and a promising new method for streamflow forecasting.

Editor D. Koutsoyiannis; Associate editor L. See

Citation Shabri, A. and Suhartono, 2012. Streamflow forecasting using least-squares support vector machines. Hydrological Sciences Journal, 57 (7), 1275–1293.     

Applicability of artificial intelligence to reservoir induced earthquakes

This paper proposes to use least square support vector machine (LSSVM) and relevance vector machine (RVM) for prediction of the magnitude (M) of induced earthquakes based on reservoir parameters. Comprehensive parameter (E) and maximum reservoir depth (H) are used as input variables of the LSSVM and RVM. The output of the LSSVM and RVM is M. Equations have been presented based on the developed LSSVM and RVM. The developed RVM also gives variance of the predicted M. A comparative study has been carried out between the developed LSSVM, RVM, artificial neural network (ANN), and linear regression models. Finally, the results demonstrate the effectiveness and efficiency of the LSSVM and RVM models.     

基于最小二乘支持向量机的砂土液化预测方法

使用最小二乘支持向量机分类方法建立了两个砂土液化预测模型,预测结果与野外实际情况全部相符,表明该分类方法用于预测砂土液化是可行的,且预测准确率高。     

地震预警现地PGV连续预测的最小二乘支持向量机模型

为提升现地仪器地震烈度预测的准确性与连续性,研究面向地震预警的PGV连续预测模型.以中国仪器地震烈度标准的计算参数:0.1~10 Hz带通滤波三分向矢量合成速度峰值PGV为预测目标,利用日本K-net与KiK-net台网P波触发后1~10 s强震数据,基于人工智能中的机器学习方法-最小二乘支持向量机,选取7种特征参数作为输入构建最小二乘支持向量机PGV预测模型LSSVM-PGV.结果表明,本文建立的LSSVM-PGV模型在训练数据集与测试数据集上的预测误差标准差变化趋于一致,具备泛化性能;P波触发后3 s预测PGV与实测PGV即可整体符合1∶1关系,随着时间窗的增长,PGV预测的误差标准差显著减小、并在P波触发后6 s趋向收敛,具备准确连续预测能力;对比同为P波触发后3 s的常用P d-PGV模型,LSSVM-PGV模型的PGV预测误差标准差明显减小,“小值高估”与“大值低估”现象明显改善,预测准确性得到提升.熊本地震序列的震例分析表明,对于6.5级以下地震,LSSVM-PGV模型最多在P波触发后3 s即可预测出与实测PGV整体符合1∶1关系的PGV;对于7.3级主震,由于其破裂过程的复杂性,P波触发后3 s的预测结果出现一定程度的低估,但随着时间窗增长至6 s时,预测PGV与实测PGV符合1∶1关系、并直到10 s整体趋势保持一致.本文构建的LSSVM-PGV模型可用于现地地震预警仪器地震烈度的预测.     

基于最小二乘支持向量机算法的高层建筑结构的强震抗毁性估计模型

采用现有的估计模型对混凝土建筑结构的抗毁性进行估计时,存在估计精度低、耗时长等问题。为此,提出一种基于最小二乘支持向量机的强震作用下混凝土高层建筑结构的抗毁性估计模型。该模型采用最小二乘支持向量机对混凝土结构强震损伤程度相关数据的训练样本进行训练,创建混凝土结构抗毁性估计模型;为了减少可能存在的模型误差,采用KLASSO调参模型对结构抗毁性估计模型中的参数进行调节和优化,得出可靠、稳定的强震作用下混凝土高层建筑结构抗毁性估计模型。仿真实验证明,该模型估计精度相对较高,可节省估计用时,为更好地提升建筑行业的安全检测工作效率提供很好的依据。     

基于最近邻支撑向量特征线融合算法的核爆地震识别

为增强核爆地震模式分类器的泛化能力以提高对核爆炸事件的准确识别能力,论文提出了一种选择支撑向量样本集来表征训练样本集的最近邻支撑向量特征线分类算法,用以训练时扩展核爆地震的训练样本库,提高分类器的泛化能力.该算法用于核爆炸和地震的识别结果发现,和最近邻特征线分类器相比,提出的算法降低了计算复杂度,但识别能力却有些许降低.对新算法的分析发现,纯粹的支撑向量集不能完全代表原始样本空间集,支撑向量比例在其中有重要作用,为发挥支撑向量比例的作用以提高核爆分类器的识别能力,提出了最近邻支撑向量特征线融合算法.最后以核爆地震数据库对上述算法进行了检验和分析,理论分析和识别结果证实,在相同的训练样本选择条件下,最近邻支撑向量特征线融合算法对于核爆炸的识别来说具有较好的泛化能力,正确识别率达到90.3%,且优于支持向量机算法和最近邻特征线算法.     

基于最小二乘支持向量机的城市桥梁震害预测模型研究

针对地震中城市桥梁震害状态具有较强的非线性、复杂性的特点,采用了具有RBF核函数的最小二乘支持向量机(LS-SVM)算法。在大量收集我国地震中城市桥梁震害资料的基础上,将此算法引入桥梁的震害预测中,选取了地震烈度、上部结构、地基失效程度、支座类型、墩台高度、桥梁跨数和场地类别等因素作为模型的特征输入向量,建立了最小二乘支持向量机的桥梁震害预测模型。通过反复地样本训练及模型参数设置,仿真结果表明,该方法具有一定的准确度和可行性。基于最小二乘支持向量机的桥梁震害预测方法是一种可以用于地震中桥梁震害预测的良好方法。     

Machine Learning Approach to Predict Sediment Load – A Case Study

In this study, a novel machine learning technique called the support vector machine (SVM) method is proposed as a new predictive model to predict sediment loads in three Malaysian rivers. The SVM is employed without any restriction to an extensive database compiled from measurements in the Muda, Langat, and Kurau rivers. The SVM technique demonstrated a superior performance compared to other traditional sediment‐load methods. The coefficient of determination, 0.958, and the mean square error, 0.0698, of the SVM method are higher than those of the traditional method. The performance of the SVM method demonstrates its predictive capability and the possibility of the generalization of the model to nonlinear problems for river engineering applications.     

主成分分析法和遗传算法优化的支持向量机模型在地震伤亡人数预测中的应用

为有效解决地震伤亡人数预测所需影响因子多、 运算量大、 模型训练烦琐等问题, 构建了主成分分析法(PCA)和遗传算法(GA)优化的支持向量机(SVM)模型, 采用PCA对地震伤亡人数影响因子进行降维以去除贡献率较低的主成分, 将贡献率较大的主成分作为支持向量机的输入变量, 以地震伤亡人数作为输出变量, 利用GA对SVM模型性能参数进行优化, 建立基于PCA-GA-SVM的地震伤亡人数预测模型, 并对测试样本进行预测, 结果表明: 与SVM模型、 GA-SVM模型和PCA-GA-BP模型相比, PCA-GA-SVM模型的预测准确率和运行效率分别提高 4.73%、 1.14%、 9.99% 和47.05%、 36.76%、 44.55%。结果显示, PCA-GA-SVM模型预测精度高, 泛化能力强, 能够科学合理地对地震伤亡人数作出预测。     

测井岩性识别新方法研究

为了更好地解决测井岩性识别问题,引入了一种基于粒子群优化的支持向量机算法.通过实际测井资料和岩性剖面资料进行学习训练支持向量机,并利用粒子群优化算法对支持向量机参数进行优化,建立了测井岩性识别的支持向量机模型,应用该方法对准噶尔盆地某井的测井岩性进行识别,并将该方法的识别结果与BP神经网络方法的识别结果进行了比较,结果表明该方法优于BP神经网络方法,具有识别正确率高、收敛速度快、推广能力强等优点.     

基于粒子群优化最小二乘向量机的地震预测模型

为解决地震预测中最小二乘向量机(LSSVM)模型的参数难以确定的问题,利用粒子群算法(PSO)的收敛速度快和全局优化能力,优化LSSVM模型的惩罚因子和核函数参数,建立了PSO-LSSVM地震预测模型.通过对地震实例的预测仿真及其相关分析表明该方法的有效性.该方法优于传统的神经网络和支持向量机的地震预测方法,可以有效提高预测效能.     

River flow modelling: comparison of performance and evaluation of uncertainty using data-driven models and conceptual hydrological model

Hydrological and statistical models are playing an increasing role in hydrological forecasting, particularly for river basins with data of different temporal scales. In this study, statistical models, e.g. artificial neural networks, adaptive network-based fuzzy inference system, genetic programming, least squares support vector machine, multiple linear regression, were developed, based on parametric optimization methods such as particle swarm optimization (PSO), genetic algorithm (GA), and data-preprocessing techniques such as wavelet decomposition (WD) for river flow modelling using daily streamflow data from four hydrological stations for a period of 1954–2009. These models were used for 1-, 3- and 5-day streamflow forecasting and the better model was used for uncertainty evaluation using bootstrap resampling method. Meanwhile, a simple conceptual hydrological model GR4J was used to evaluate parametric uncertainty based on generalized likelihood uncertainty estimation method. Results indicated that: (1) GA and PSO did not help improve the forecast performance of the model. However, the hybrid model with WD significantly improved the forecast performance; (2) the hybrid model with WD as a data preprocessing procedure can clarify hydrological effects of water reservoirs and can capture peak high/low flow changes; (3) Forecast accuracy of data-driven models is significantly influenced by the availability of streamflow data. More human interferences from the upper to the lower East River basin can help to introduce greater uncertainty in streamflow forecasts; (4) The structure of GR4J may introduce larger parametric uncertainty at the Longchuan station than at the Boluo station in the East river basin. This study provides a theoretical background for data-driven model-based streamflow forecasting and a comprehensive view about data and parametric uncertainty in data-scarce river basins.     

基于支持向量机的地震序列分类

介绍了人工智能领域最新的基于结构风险最小化原理的数据挖掘算法——支持向量机算法。根据支持向量机线性分类和可以具有不同核函数的非线性分类两种算法,建立了地震序列分类模型。通过试算和分析比较得到了地震序列最佳分类模型,最佳模型的分类结果与实际地震序列分类基本一致。综合分析认为支持向量机算法无论在学习或者预测精度方面都具有很大的优越性,其获得的地震序列分类知识库可以较为准确地实现地震序列类型的分类,因此基于支持向量机理论建立的地震序列分类模型应该是可行的。     

中国大陆强震时间序列预测的支持向量机方法

统计学习理论（Statistical Learning Theory或SLT）是研究有限样本情况下机器学习规律的理论。支持向量机（Support Vector Machines或SVM）是基于统计学习理论框架下的一种新的通用机器学习方法。它不但较好地解决了以往困扰很多学习方法的小样本、过学习、高维数、局部最小等实际难题，而且具有很强的泛化（预测）能力。文中使用支持向量机对中国大陆最大地震时间序列进行预测，预测次年的我国大陆最大地震震级，结果表明该方法具有较好的预报效果。研究结果还表明我国大陆强震活动除了与强震时间序列本身有关外，还与全球的强震活动、太阳黑子活动等有密切的关系。尽管这种关系还不清楚，但是通过支持向量机可以很好地反应出这种非线性关系。     

最小二乘支持向量回归滤波系统性能分析

支持向量机(Support Vector Machine: SVM)一直作为机器学习方法在统计学习理论基础上被研究和发展,本文从信号与系统的角度出发,证明了平移不变核最小二乘支持向量机(Least Squares SVM: LS-SVM)是一个线性时不变系统.以Ricker子波核为例,探讨了不同参数对最小二乘支持向量回归(Least Squares Support Vector Regression: LS-SVR)滤波器频率响应特性的影响,这些参数的不同选择相应地控制着滤波器通带上升沿的陡峭性、通带的中心频率、通带带宽以及信号能量的衰减,即滤波器长度越长通带的上升沿越陡,核参数值越大通带的中心频率越高,且通带带宽越宽,正则化参数值越小,通带带宽越窄(但通带中心频率基本保持恒定),有效信号幅度衰减越严重.合成地震记录的仿真实验结果表明,Ricker子波核LS-SVR滤波器在处理地震勘探信号的应用中,滤波性能优于径向基函数(Radial Basic Function: RBF)核LS-SVR滤波器以及小波变换滤波和Wiener滤波方法.     

Prediction of flow rate of karstic springs using support vector machines

Complex void space structure and flow patterns in karstic aquifers render behaviour prediction of karstic springs difficult. Four support vector regression-based models are proposed to predict flow rates from two adjacent karstic springs in Greece (Mai Vryssi and Pera Vryssi). Having no accurate estimates of the groundwater flow pattern, we used four kernels: linear, polynomial, Gaussian radial basis function and exponential radial basis function (ERBF). The data used for training and testing included daily and mean monthly precipitation, and spring flow rates. The support vector machine (SVM) performance depends on hyper-parameters, which were optimized using a grid search approach. Model performance was evaluated using root mean square error and correlation coefficient. Polynomial kernel performed better for Mai Vryssi and the ERBF for Pera Vryssi. All models except one performed better for Pera Vryssi. Our models performed better than generalized regression neural network, radial basis function neural network and ARIMA models.     

基于PCA-GSM-SVM的地震伤亡人数预测

针对影响地震伤亡人数的评价指标数量较多且各指标之间存在着复杂的非线性关系,运用机器学习理论,提出了基于支持向量机(Support Vector Machine)的地震伤亡人数预测模型;首先利用主成分分析法(Principle Component Analysis)对7个地震死亡人数影响指标进行数据降维,然后对提取出的主成分进行归一化处理,将归一化的主成分数据作为预测模型的输入向量,将地震伤亡人数作为预测模型的输出向量;以27个地震伤亡实例作为学习样本进行训练,运用网格搜索法(Grid Search Method)寻优获得最优支持向量机参数,最终建立基于PCA-GSM-SVM的地震死亡人数预测模型,并对5组样本进行死亡人数预测。结果表明:PCA-GSM-SVM模型的最小误差、最大误差和平均误差分别为5.12%、15.7%和9.16%,其平均误差相比于GSM-SVM模型和SVM模型分别降低6.51%和7.11%,因此PCA-GSM-SVM模型预测精度较高,可在工程实际中推广。     

Optimal seismic design of reinforced concrete structures under timehistory earthquake loads using an intelligent hybrid algorithm

A reliable seismic-resistant design of structures is achieved in accordance with the seismic design codes by designing structures under seven or more pairs of earthquake records. Based on the recommendations of seismic design codes, the average time-history responses(ATHR) of structure is required. This paper focuses on the optimal seismic design of reinforced concrete(RC) structures against ten earthquake records using a hybrid of particle swarm optimization algorithm and an intelligent regression model(IRM). In order to reduce the computational time of optimization procedure due to the computational efforts of time-history analyses, IRM is proposed to accurately predict ATHR of structures. The proposed IRM consists of the combination of the subtractive algorithm(SA), K-means clustering approach and wavelet weighted least squares support vector machine(WWLS-SVM). To predict ATHR of structures, first, the input-output samples of structures are classified by SA and K-means clustering approach. Then, WWLS-SVM is trained with few samples and high accuracy for each cluster. 9- and 18-storey RC frames are designed optimally to illustrate the effectiveness and practicality of the proposed IRM. The numerical results demonstrate the efficiency and computational advantages of IRM for optimal design of structures subjected to time-history earthquake loads.     

Forecasting effective drought index using a wavelet extreme learning machine (W-ELM) model

A drought forecasting model is a practical tool for drought-risk management. Drought models are used to forecast drought indices (DIs) that quantify drought by its onset, termination, and subsequent properties such as the severity, duration, and peak intensity in order to monitor and evaluate the impacts of future drought. In this study, a wavelet-based drought model using the extreme learning machine (W-ELM) algorithm where the input data are first screened through the wavelet pre-processing technique for better accuracy is developed to forecast the monthly effective DI (EDI). The EDI is an intensive index that considers water accumulation with a weighting function applied to rainfall data with the passage of time in order to analyze the drought-risk. Determined by the autocorrelation function (ACF) and partial ACFs, the lagged EDI signals for the current and past months are used as significant inputs for 1 month lead-time EDI forecasting. For drought model development, 97 years of data for three hydrological stations (Bathurst Agricultural, Wilsons Promontory and Merredin in Australia) are partitioned in approximately 90:5:5 ratios for training, cross-validation and test purposes, respectively. The discrete wavelet transformation (DWT) is applied to the predictor datasets to decompose inputs into their time–frequency components that capture important information on periodicities. DWT sub-series are used to develop new EDI sub-series as inputs for the W-ELM model. The forecasting capability of W-ELM is benchmarked with ELM, artificial neural network (ANN), least squares support vector regression (LSSVR) and their wavelet-equivalent (W-ANN, W-LSSVR) models. Statistical metrics based on agreement between the forecasted and observed EDI, including the coefficient of determination, Willmott’s index, Nash–Sutcliffe coefficient, percentage peak deviation, root-mean-square error, mean absolute error, and model execution time are used to assess the effectiveness of the models. The results demonstrate enhanced forecast skill of the drought models that use wavelet pre-processing of the predictor dataset. Based on statistical measures, W-ELM outperformed traditional ELM, LSSVR, ANN and their wavelet-equivalent counterparts (W-ANN, W-LSSVR). It is found that the W-ELM model is computationally efficient as shown by a faster running time with the majority of forecasting errors in lower frequency bands. The results demonstrate the usefulness of W-ELM over W-ANN and W-LSSVR models and the benefits of wavelet transformation of input data to improve the performance of drought forecasting models.