Recognition of disturbances with specified morphology in time series. Part 1: Spikes on magnetograms of the worldwide INTERMAGNET network

The International Real-time Magnetic Observatory Network (INTERMAGNET) is the world’s biggest international network of ground-based observatories, providing geomagnetic data almost in real time (within 72 hours of collection) [Kerridge, 2001]. The observation data are rapidly transferred by the observatories participating in the program to regional Geomagnetic Information Nodes (GINs), which carry out a global exchange of data and process the results. The observations of the main (core) magnetic field of the Earth and its study are one of the key problems of geophysics. The INTERMAGNET system is the basis of monitoring the state of the Earth’s magnetic field; therefore, the information provided by the system is required to be very reliable. Despite the rigid high-quality standard of the recording devices, they are subject to external effects that affect the quality of the records. Therefore, an objective and formalized recognition with the subsequent remedy of the anomalies (artifacts) that occur on the records is an important task. Expanding on the ideas of Agayan [Agayan et al., 2005] and Gvishiani [Gvishiani et al., 2008a; 2008b], this paper suggests a new algorithm of automatic recognition of anomalies with specified morphology, capable of identifying both physically- and anthropogenically-derived spikes on the magnetograms. The algorithm is constructed using fuzzy logic and, as such, is highly adaptive and universal. The developed algorithmic system formalizes the work of the expert-interpreter in terms of artificial intelligence. This ensures identical processing of large data arrays, almost unattainable manually. Besides the algorithm, the paper also reports on the application of the developed algorithmic system for identifying spikes at the INTERMAGNET observatories. The main achievement of the work is the creation of an algorithm permitting the almost unmanned extraction of spike-free (definitive) magnetograms from preliminary records. This automated system is developed for the first time with the application of fuzzy logic system for geomagnetic measurements. It is important to note that the recognition of time disturbances is formalized and identical. The algorithm presented here appreciably increases the reliability of spike-free INTERMAGNET magnetograms, thus increasing the objectivity of our knowledge of the Earth’s magnetic field. At the same time, the created system can accomplish identical, formalized, and retrospective analysis of large archives of digital and digitized magnetograms, accumulated in the system of Worldwide Data Centers. The relevant project has already been initiated as a collaborative initiative of the Worldwide Data Center at Geophysical Center (Russian Academy of Sciences) and the NOAA National Geophysical Data Center (Unite States). Thus, by improving and adding objectivity to both new and historical initial data, the developed algorithmic system may contribute appreciably to improving our understanding of the Earth’s magnetic field.     

Recognition of disturbances with specified morphology in time series: Part 2. Spikes on 1-s magnetograms

Preliminary magnetograms contain different types of temporal anthropogenic disturbances: spikes, baseline jumps, drifts, etc. These disturbances should be identified and filtered out during the preprocessing of the preliminary records for the definitive data. As of now, at the geomagnetic observatories, such filtering is carried out manually. Most of the disturbances in the records sampled every second are spikes, which are much more abundant than those on the magnetograms sampled every minute. Another important feature of the 1-s magnetograms is the presence of a plenty of specific disturbances caused by short-period geomagnetic pulsations, which must be retained in the definitive records. Thus, creating an instrument for formalized and unified recognition of spikes on the preliminary 1-s magnetograms would largely solve the problem of labor-consuming manual preprocessing of the magnetic records. In the context of this idea, in the present paper, we focus on recognition of the spikes on the 1-s magnetograms as a key point of the problem. We describe here the new algorithm of pattern recognition, SPs, which is capable of automatically identifying the spikes on the 1-s magnetograms with a low probability of missed events and false alarms. The algorithm was verified on the real magnetic data recorded at the French observatory located on Easter Island in the Pacific.     

Survey of Geomagnetic Observations Made in the Northern Sector of Russia and New Methods for Analysing Them

An overview of the geomagnetic observations made in the northern part of Russia is presented from a historical perspective. Several stations were deployed on the territory of the former Soviet Union during the International Geophysical Year, 1957–1958, with the active participation and guidance of the Interagency Geophysical Committee which is inherited by the Geophysical Center of the Russian Academy of Sciences (GC RAS). In the 1990s, the majority of these stations, especially those in the remoter regions, were closed. Nowadays, the geomagnetic network, including the observatories of the INTERMAGNET program, has been restored. Examples of high-latitude geomagnetic variations in the Russian longitudinal sector are shown, and maps and trends of the secular variation over the territory of Russia presented. Particular attention is paid to the automated processing of data and to the analysis methods used. To process the growing amount of high-resolution geomagnetic data, sophisticated mathematical methods based on the fuzzy logic approach and new discrete mathematical analysis algorithms have been developed. The formal methods and algorithms for recognizing both artificial and natural disturbances in the magnetograms are described.     

国际地磁台网发展现状与展望

从国际地磁台站分布、地磁信息节点分布、地磁观测技术指标、数据产品及服务应用等5个方面介绍了国际地磁台网的发展现状。通过综合分析,得出地磁场和空间环境的全球性精细化监测及预报已经成为地球科学家关注的焦点。在此基础上,从4个方面预测了国际地磁台网未来发展趋势,以期为我国开展相关工作提供参考和借鉴。     

Correlation Analysis of Geomagnetic Data Synchronously Recorded by the INTERMAGNET Magnetic Laboratories

The results of the analysis of geomagnetic data synchronously recorded by the INTERMAGNET magnetic stations are presented. The goal of this research was to distinguish internal correlations between the data and to determine the optimal spatial interval of the geographical coordinates within which the efficient operation of only one magnetic observatory would be satisfactory in most occasions. The results of the observation of correlations between the geomagnetic data on a global scale are summarized and presented. Possible regions of application of these results are determined.     

Approach to Assessment of the Relative Informational Efficiency of Intermagnet Magnetic Observatories

The IAGA-2002 1-min geomagnetic time series published by the International Real-time Magnetic Observatory Network (INTERMAGNET) are considered. Their completeness and anomalies are analyzed. The concept of the relative informational efficiency index is introduced. Theory elements are developed for its qualitative and quantitative assessment. Time series of geomagnetic data published by INTERMAGNET for 2014–2017 are used to find the range for the determination of this index and its basic statistical characteristics. An approach to the classification of INTERMAGNET magnetic observatories by the relative informational efficiency index is proposed. The nature of the geospatial distribution of the appropriate classes of magnetic observatories is investigated.     

Analysis of latitudinal distribution of Pi2 geomagnetic pulsations using the generalized variance method

The spatial dynamics of bursts of geomagnetic Pi2-type pulsations during a typical event of a magnetospheric substorm (April 13, 2010) drifting to the pole was investigated using the method of generalized variance characterizing the integral time increment of the total horizontal amplitude of the wave at a given point in the selected time interval. The digital data of Scandinavian profile observations from IMAGE magnetometers with 10-second sampling and data of the INTERMAGNET project observations at the equatorial, middle-latitude and subauroral latitudes with a 1-second sampling were used in the analysis. It was shown that Pi2 pulsation bursts in a frequency band of 8–20 mHz appear simultaneously on a global scale: from the polar to equatorial latitudes with maximum amplitudes at latitudes of the maximum intensity of the auroral electrojet and with a maximum amplitude of geomagnetic pulsations Pi3 within a band of 1.5–6 mHz. The first (left-polarized) intensive Pi2 burst appeared at auroral latitudes several minutes after breakup, while the second (right-polarized) burst occurred 15 min after breakup but at higher (polar) latitudes where the substorm had displaced by that time. The direction of wave-polarization vector rotation was opposite for auroral and subauroral latitudes, but it was identical at the equator and in the subauroral zone. The pulsation amplitude at the equator was maximal in the night sector.     

Geomagnetic solar flare effect on February 4 and 6, 1986 at the China Antarctic Great Wall Station

Taking the sampled every minute values of the horizontal, declination and vertical componentsH, D, Z and the intensity of total field F calculated fromH andZ on the magnetograms at ten geomagnetic observatories in China in the same periods, and at the China Antarctic Great Wall Station (CAGWS), the authors conducted the maximum entropy analysis and band-pass filtration of these data and obtained the following results: (1) At the periodT=10 ? 90 min geomagnetic solar flare effect (sfe) is evident on the sunlit hemisphere. It is more pronounced at periods 15, 20, 25 and 30 min, and most prominent at 30 – 35 min. The solar X-ray spectra at the same time showed their peaks at 10 and 15 min; (2) The periodT=10 ? 70 min of sfe at the CAGWS in the western Hemisphere was also recognizable after spectral analysis and filtration, but the corresponding period of the maximum amplitude was different from that in the sunlit hemisphere. The results further proved that the geomagnetic effect of solar flares could also be observed in the dark hemisphere; (3) The subsolar points of two solar flares were found around Lanzhou, and the associated current density in the ionosphere was about 24 A/km. The transitional zone from positive to negative sfe was found around the geographic latitude?=22° ? 24°N, where the sfe inH-crochet was almost illegible.     

1996年世界地磁台网CD-ROM 评述

通过对１９９６年世界地磁台网ＣＤ－ＲＯＭ中的有关台站分布、仪器装备、系统组成、数据处理、资料质量、运行状况等的简要评述,分析了当今地磁观测技术的发展潮流及世界地磁台网台站在数据处理和运行中存在的主要问题。这些认识对发展我国地磁观测技术有启示和参考作用。     

Effects of solar and geomagnetic activities in variations of power spectra of electrical and meteorological parameters in the near-Earth atmosphere in Kamchatka during October 2003 solar events

We perform spectral analysis of records of meteorological (temperature, humidity, pressure of the atmosphere) and electrical (strength of quasi-static electric field and electric conductivity of air) parameters observed simultaneously at the Paratunka observatory during the solar events of October 21–31, 2003. Also, we use simultaneous records of X-ray fluxes of solar radiation, galactic cosmic rays, and the horizontal component of the geomagnetic field. We show that the power spectra of the meteorological parameters under fine weather conditions involve oscillations with a period of thermal tidal waves (T ～ 12 and 24 h) caused by the influx of thermal radiation of the Sun. During strong solar flares and geomagnetic storm of October 29–31 with a prevailing component of T ～ 24 h, their spectra involve an additional component of T ～ 48 h (the period of planetary-scale waves). With the development of solar and geomagnetic activities, the power spectra of atmospheric electric conductivity and electric field stress involve components of both thermal tidal and planetary-scale waves, which vary highly by intensity. In the power spectra of galactic cosmic rays accompanying the strong solar flares, components with T ～ 48 h were dominant with the appearance of additional (weaker by intensity) components with T ～ 24 h. The simultaneous amplification of components with T ～ 48 h in the power spectra of electric conductivity and electric field strength provides evidence of the fact that the lower troposphere is mainly ionized by galactic cosmic rays during strong solar flares and geomagnetic storms. The specified oscillation period with T ～ 48 h in their spectra, as well as in the spectra of X-ray radiation of the sun, is apparently caused by the dynamics of solar and geomagnetic activities with this time scale.     

Geomagnetic field intensity: How high can it get? How fast can it change? Constraints from Iron Age copper slag

The intensity of the geomagnetic field varies over different time scales. Yet, constraints on the maximum intensity of the field as well as for its maximum rate of change are inadequate due to poor temporal resolution and large uncertainties in the geomagnetic record. The purpose of this study is to place firm limits on these fundamental properties by constructing a high-resolution archaeointensity record of the Levant from the 11th century to the early 9th century BCE, a period over which the geomagnetic field reached its maximum intensity in Eurasia over the past 50,000 years. We investigate a ¹⁴C-dated sequence of ten layers of slag material, which accumulated within an ancient industrial waste mound of an Iron Age copper-smelting site in southern Israel. Depositional stratigraphy constrains relative ages of samples analyzed for paleointensity, and ¹⁴C dates from different horizons of the mound constrain the age of the whole sequence. The analysis yielded 35 paleointenisty data points with accuracy better than 94% and precision better than 6%, covering a period of less than 350 years, most probably 200 years. We construct a new high-resolution quasi-continuous archaeointensity curve of the Levant that displays two dramatic spikes in geomagnetic intensity, each corresponding to virtual axial dipole moment (VADM) in excess of 200 ZAm². The geomagnetic spikes rise and fall over a period of less than 30 years and are associated with VADM fluctuations of at least 70 ZAm². Thus, the Levantine archaeomagnetic record places new constraints on maximum geomagnetic intensity as well as for its rate of change. Yet, it is not clear whether the geomagnetic spikes are local non-dipolar features or a geomagnetic dipolar phenomenon.     

Numerical correlation of speleothem stable isotope records using a genetic algorithm

The correlation of geological records is commonly based on subjective and arbitrary interpretation by a researcher. Geological data are usually collected as a series on a depth scale, and then chronologies of the profiles are constructed. The correlation of geological records based on matching quality indicators requires an efficient method of searching for the best position. GenCorr is a software based on a genetic algorithm, for correlation of records with or without accompanying chronological control. Where their age information is available, points on both records may be moved in the range limited by the age uncertainties. GenCorr has been developed by the authors in Borland RAD Studio 2007 environment. The authors tested the impact of matched record length, noise level, sampling resolution, or additional linear components and hiatuses on the correlation results using artificial test data. Finally, the genetic algorithm was applied to stable isotope records obtained from two stalagmites collected from the Demianova Cave System (Low Tatras, Slovakia). The results show that the genetic algorithm correlation method is similar to that used in pattern recognition by the human eye without prior knowledge of the ages. The genetic algorithm is able to correlate in multidimensional space and is free from human biases, but we accept that there are also occasions where additional expert opinion may be also important. GenCorr can be run on every PC with MS Windows operating system, the package was not tested in Mac environment. GenCorr is available as a freeware from the authors. For downloading, please contact: dzeq@twarda.pan.pl.     

Studies of ionospheric variations during geomagnetic activities at the low-latitude station, Ile-Ife, Nigeria

The dual frequency SCINDA NovAtel GSV 4004B GPS receiver installed at the Ile-Ife (low-latitude station) has been in operation since December 2009. Data records for the year 2010 were processed to obtain Total Electron Content (TEC) and S ₄ index. These were interpreted to analyze the ionospheric condition during low geomagnetic activity period (when Dst is from ?40 to 0 nT) and during geomagnetic storm events (with Dst about ?100 nT). Seasonal variations of the TEC and S ₄ index were also investigated. The occurrence of scintillations is closely linked to the peak value of TEC during the daytime; this is very evident during the equinox months when TEC ≥ 30 TECu. When the maximum TEC value is below 30 TECu, as shown by most of the days in the summer months, the scintillation phenomenon does not occur. During geomagnetic storms, the daytime segment of the TEC plot experiences fluctuations (even bifurcations) in values with the peak TEC value of about 40 TECu. From the interpreted data, the occurrence of geomagnetic storm does not necessarily suggest an increase in the level of scintillations at a low-latitude region. Also, there is a remarkable difference between the IRI 2007 model and the observed TEC values, as the daytime TEC peak differs in magnitude and time of occurrence from the observed TEC.     

Wavelet analysis of geomagnetic field data

Variations in geomagnetic field data at different spectral frequencies and with different periods are observed during increased geomagnetic activity. The formed local structures depend on the field disturbance and contain information on the magnetic storm intensity and character of development. Numerical solutions and algorithms based on wavelet transforms, which make it possible to “automatically” detect periods of increased geomagnetic activity and identify and analyze the structures forming this process, have been proposed in order to study the time characteristics of geomagnetic field variations, using the H component as an example. The separated components, characterizing disturbances, make it possible to estimate variations in the field energy characteristics. An analysis of the constructed wavelet images makes it possible to trace the dynamics of variations in the H component the day before and during a magnetic storm.     

Geomagnetic field effects of the Chelyabinsk meteoroid

An analysis was conducted of time variations in geomagnetic field components on the day of the Chelyabinsk meteorite event (February 15, 2013) and on control days (February 12 and 16, 2013). The analysis uses the data collected by magnetic observatories in Novosibirsk, Almaty, Kyiv, and Lviv. The distance R from the explosion site to the observatories varies in the range 1200–2700 km. The flyby and explosion of the Chelyabinsk cosmic body is found to have been accompanied by variations mainly in the horizontal component of the geomagnetic field. The variations are quasi-periodic with a period of 30–40 min, an amplitude of 0.5–2 nT for R ≈ 2700?1200 km, respectively, and a duration of 2–3 h. The horizontal velocity of the geomagnetic field disturbances is close to 260–370 m/s. A theoretical model of wave disturbances is proposed. According to the model, wave disturbances in the geomagnetic field are caused (a) by the motion of the gravity wave generated in the atmosphere by the falling space body and (b) by traveling ionospheric disturbances, which modulate the ionospheric current at dynamo altitudes. The calculated amplitudes of the wave disturbances are 0.6–1.8 nT for R ≈ 2700?1200 km, respectively. The estimates are in good agreement with the observational data. Disturbances in the geomagnetic field level (geomagnetic pulsations) in the period range 1–1000 s are negligible (less than 1 nT).     

Scaling characteristics of SEGMA magnetic field data around the Mw 6.3 Aquila earthquake

We apply detrended fluctuation analysis (DFA) on fluxgate and search-coil data in ULF range (scales 10–90 s or 0.1–0.011 Hz) for the months January–April 2009 available from the South European GeoMagnetic Array stations: Castello Tesino (CST), Ranchio (RNC), and L’Aquila (AQU) in Italy; Nagycenk (NCK) in Hungary; and Panagyuriste (PAG) in Bulgaria. DFA is a data processing method that allows for the detection of scaling behaviors in observational time series even in the presence of non-stationarities. The H and Z magnetic field components at night hours (00-03 UT, 01–04 LT) and their variations at the stations CST, AQU, NCK, and PAG have been examined and their scaling characteristics are analyzed depending on geomagnetic and local conditions. As expected, the scaling exponents are found to increase when the K _p index increases, indicating a good correlation with geomagnetic activity. The scaling exponent reveals also local changes (at L’Aquila), which include an increase for the Z (vertical) component, followed by a considerable decrease for the X (horizontal) component in the midst of February 2009. Attempts are made to explain this unique feature with artificial and/or natural sources including the enhanced earthquake activity in the months January–April 2009 at the L’Aquila district.     

Pc3 geomagnetic pulsations at near-equatorial latitudes at the initial phase of the magnetic storm of April 5, 2010

An analysis of sampled 1-s observational data on geomagnetic pulsations within the Pc3 range on the INTERMAGNET network of near-equatorial and low-latitude observatories spaced over longitude during the initial phase of a moderate magnetic storm (April 5–7, 2010) was carried out for the first time. The obtained results were compared with magnetic observations at the low-latitude Chambon-la-Foret (CLF) and subauroral Kerguelen (PAF) observatories, as well as with observations at six Australian observatories located at low and middle latitudes. Two time intervals were studied in detail: the sudden commencement (SC) of the storm and the onset of the great global substorm. In the first interval, maximal amplitudes of near-equatorial pulsations were observed in the near-noon sector; in the second interval, in the near-midnight sector. The dynamics of the spectral structure of Pc3 pulsations in the considered events was shown to be different in spite of the fact that in both cases an amplification of waves was observed in two close spectral bands of the Pc3 spectrum: ～20–30 and ～30–40 mHz. The considered Pc3 pulsations were characterized by very small azimuthal wavenumbers (0.5 and less). Possible generation mechanisms for the observed Pc3 pulsations are discussed.     

Effect of solar dynamics parameters on the formation of substorm activity

An algorithm for retrieving the AL index dynamics from the parameters of solar-wind plasma and the interplanetary magnetic field (IMF) has been developed. Along with other geoeffective parameters of the solar wind, an integral parameter in the form of the cumulative sum Σ[N*V ²] is used to determine the process of substorm formation. The algorithm is incorporated into a framework developed to retrieve the AL index of an Elman-type artificial neural network (ANN) containing an additional layer of neurons that provides an “internal memory” of the prehistory of the dynamical process to be retrieved. The ANN is trained on data of 70 eight-hour-long time intervals, including the periods of isolated magnetospheric substorms. The efficiency of this approach is demonstrated by numerical neural-network experiments on retrieving the dynamics of the AL index from the of solar wind and IMF parameters during substorms.     

Planetary distribution of geomagnetic pulsations during a geomagnetic storm at solar minimum

We investigate the features of the planetary distribution of wave phenomena (geomagnetic pulsations) in the Earth’s magnetic shell (the magnetosphere) during a strong geomagnetic storm on December 14–15, 2006, which is untypical of the minimum phase of solar activity. The storm was caused by the approach of the interplanetary magnetic cloud towards the Earth’s magnetosphere. The study is based on the analysis of 1-min data of global digital geomagnetic observations at a few latitudinal profiles of the global network of ground-based magnetic stations. The analysis is focused on the Pc5 geomagnetic pulsations, whose frequencies fall in the band of 1.5–7 mHz (T ～ 2–10 min), on the fluctuations in the interplanetary magnetic field (IMF) and in the solar wind density in this frequency band. It is shown that during the initial phase of the storm with positive IMF Bz, most intense geomagnetic pulsations were recorded in the dayside polar regions. It was supposed that these pulsations could probably be caused by the injection of the fluctuating streams of solar wind into the Earth’s ionosphere in the dayside polar cusp region. The fluctuations arising in the ionospheric electric currents due to this process are recorded as the geomagnetic pulsations by the ground-based magnetometers. Under negative IMF Bz, substorms develop in the nightside magnetosphere, and the enhancement of geomagnetic pulsations was observed in this latitudinal region on the Earth’s surface. The generation of these pulsations is probably caused by the fluctuations in the field-aligned magnetospheric electric currents flowing along the geomagnetic field lines from the substorm source region. These geomagnetic pulsations are not related to the fluctuations in the interplanetary medium. During the main phase of the magnetic storm, when fluctuations in the interplanetary medium are almost absent, the most intense geomagnetic pulsations were observed in the dawn sector in the region corresponding to the closed magnetosphere. The generation of these pulsations is likely to be associated with the resonance of the geomagnetic field lines. Thus, it is shown that the Pc5 pulsations observed on the ground during the magnetic storm have a different origin and a different planetary distribution.     

Interplanetary medium condition effects in the South Atlantic Magnetic Anomaly: A case study

One way to investigate the magnetosphere–ionosphere coupling is through the simultaneous observation of different parameters measured at different locations of the geospace environment and try to determine some relationships among them. The main objective of this work is to examine how the solar energetic particles and the interplanetary medium conditions may affect the space and time configuration of the ring current at low-latitudes and also to get a better understanding on how these particles interfere with the lower ionosphere in the South Atlantic Magnetic Anomaly region (SAMA). To accomplish this, the cosmic noise absorption (CNA) and the horizontal component of the Earth's magnetic field data measured from sites located in the SAMA region were compared with the proton and electron fluxes, interplanetary medium conditions (solar wind and the north–south component of the interplanetary magnetic field measured on board satellites), the SYM-H index and magnetometer data from Kakioka (KAK-Japan), located significantly outside the SAMA region. The time series analyzed correspond to the geomagnetic disturbance that occurred on August 25–30, 1998. The analysis was performed by implementing wavelet techniques, with particular attention to singularities detection, which highlights the presence of transient signals. The results are discussed in terms of the first three wavelet decomposition levels of the parameters. The magnitude of wavelet coefficients of the solar wind and proton flux at the two energy ranges analyzed is timely well correlated, indicating that these two signals are energetically linked. The larger wavelet coefficient amplitude of KAK and VSS magnetograms shows time delays that are compatible with an asymmetric configuration of the ring current, considering that at the storm time, VSS was at the dawn sector of the magnetosphere and KAK at the dusk side. The wavelet analysis of CNA signals reveals that the signal may be sensitive to the ionization produced by energetic electrons and protons as well. The time delays observed in wavelet coefficients may give an indication of the different accelerating process to which the particles are submitted when traveling along the magnetic field lines, from higher to lower latitudes, and the likely contribution of these particles to the ionization measured as an absorption of the cosmic noise in the lower ionosphere.