Tree Crown Detection,Delineation and Counting in UAV Remote Sensed Images: A Neural Network Based Spectral–Spatial Method

UAVs are fast emerging as a remote sensing platform to complement satellite based remote sensing. Agriculture and ecology is one of the important applications of UAV remote sensing, also known as low altitude remote sensing (LARS). This work demonstrates the use and potential of LARS in agriculture, particularly small holder open field agriculture. Two UAVs are used for remote sensing. The first UAV is a fixed wing aircraft with a high spatial resolution visible spectrum also known as RGB camera as a payload. The second UAV is a quadrotor UAV with an RGB camera interfaced to an on-board single board computer as the payload. LARS was carried out to acquire aerial high spatial resolution RGB images of different farms. Spectral–spatial classification of high spatial resolution RGB images for detection, delineation and counting of tree crowns in the image is presented. Supervised classification is carried out using extreme learning machine (ELM), a single hidden layer feed forward network neural network classifier. ELM was modelled for RGB values as input feature vectors and binary (tree and non-tree pixels) output class. Due to similarities in spectral intensities, some of the non-tree pixels were classified as tree pixels and in order to remove them, spatial classification was performed on the image. Spatial classification was carried out using thresholded geometrical property filtering techniques. Threshold values chosen for carrying out spatial classification were analysed to obtain optimal values. Finally in the delineation and counting, the connected tree crowns were segmented using Watershed algorithm performed on the image after marking individual tree crowns using Distance Transform method. Five representative UAV images captured at different altitudes with different crowns of banana plant, mango trees and coconut trees were used to demonstrate the performance of the proposed method. The performance was compared with the traditional KMeans spectral–spatial method of clustering. Results and comparison of performance parameters of KMeans spectral–spatial and ELM spectral–spatial classification methods are presented. Results indicate that ELM performed better than KMeans.     

Tree survey and allometric models for tiger bush in northern Senegal and comparison with tree parameters derived from high resolution satellite data

A tree survey and an analysis of high resolution satellite data were performed to characterise the woody vegetation within a 10 × 10 km² area around a site located close to the town of Dahra in the semi-arid northern part of Senegal. The surveyed parameters were tree species, height, tree crown radius, and diameter at breast height (DBH), for which allometric models were determined. An object-based classification method was used to determine tree crown cover (TCC) from Quickbird data. The average TCC from the tree survey and the respective TCC from remote sensing were both about 3.0%. For areas beyond the surveyed areas TCC varied between 3.0% and 4.5%. Furthermore, an empirical correction factor for tree clumping was obtained, which considerably improved the estimated number of trees and the estimated average tree crown area and radius. An allometric model linking TCC to tree stem crosssectional area (CSA) was developed, which allows to estimate tree biomass from remote sensing. The allometric models for the three main tree species found performed well and had r²-values of about 0.7–0.8.     

Tree species classification in subtropical forests using small-footprint full-waveform LiDAR data

The accurate classification of tree species is critical for the management of forest ecosystems, particularly subtropical forests, which are highly diverse and complex ecosystems. While airborne Light Detection and Ranging (LiDAR) technology offers significant potential to estimate forest structural attributes, the capacity of this new tool to classify species is less well known. In this research, full-waveform metrics were extracted by a voxel-based composite waveform approach and examined with a Random Forests classifier to discriminate six subtropical tree species (i.e., Masson pine (Pinus massoniana Lamb.)), Chinese fir (Cunninghamia lanceolata (Lamb.) Hook.), Slash pines (Pinus elliottii Engelm.), Sawtooth oak (Quercus acutissima Carruth.) and Chinese holly (Ilex chinensis Sims.) at three levels of discrimination. As part of the analysis, the optimal voxel size for modelling the composite waveforms was investigated, the most important predictor metrics for species classification assessed and the effect of scan angle on species discrimination examined. Results demonstrate that all tree species were classified with relatively high accuracy (68.6% for six classes, 75.8% for four main species and 86.2% for conifers and broadleaved trees). Full-waveform metrics (based on height of median energy, waveform distance and number of waveform peaks) demonstrated high classification importance and were stable among various voxel sizes. The results also suggest that the voxel based approach can alleviate some of the issues associated with large scan angles. In summary, the results indicate that full-waveform LIDAR data have significant potential for tree species classification in the subtropical forests.     

Tree species classification using UAS-based digital aerial photogrammetry point clouds and multispectral imageries in subtropical natural forests

Tree species composition of forest stand is an important indicator of forest inventory attributes for assessing ecosystem health, understanding successional processes, and digitally displaying forest biodiversity. In this study, we acquired high spatial resolution multispectral and RGB imagery over a subtropical natural forest in southwest China using a fixed-wing UAV system. Digital aerial photogrammetric (DAP) technique was used to generate multi-spectral and RGB derived point clouds, upon which individual tree crown (ITC) delineation algorithms and a machine learning classifier were used to identify dominant tree species. To do so, the structure-from-motion method was used to generate RGB imagery-based DAP point clouds. Then, three ITC delineation algorithms (i.e., point cloud segmentation (PCS), image-based multiresolution segmentation (IMRS), and advanced multiresolution segmentation (AMRS)) were used and assessed for ITC detection. Finally, tree-level metrics (i.e., multispectral, texture and point cloud metrics) were used as metrics in the random forest classifier used to classify eight dominant tree species. Results indicated that the accuracy of the AMRS ITC segmentation was highest (F₁-score = 82.5 %), followed by the segmentation using PCS (F₁-score = 79.6 %), the IMRS exhibited the lowest accuracy (F₁-score = 78.6 %); forest types classification (coniferous and deciduous) had a higher accuracy than the classification of all eight tree species, and the combination of spectral, texture and structural metrics had the highest classification accuracy (overall accuracy = 80.20 %). In the classification of both eight tree species and two forest types, the classification accuracies were lowest when only using spectral metrics, indicated that the texture metrics and point cloud structural metrics had a positive impact on the classification (the overall accuracy and kappa accuracy increased by 1.49–4.46 % and 2.86–6.84 %, respectively).     

Individual tree crown delineation using localized contour tree method and airborne LiDAR data in coniferous forests

Individual tree crown delineation is of great importance for forest inventory and management. The increasing availability of high-resolution airborne light detection and ranging (LiDAR) data makes it possible to delineate the crown structure of individual trees and deduce their geometric properties with high accuracy. In this study, we developed an automated segmentation method that is able to fully utilize high-resolution LiDAR data for detecting, extracting, and characterizing individual tree crowns with a multitude of geometric and topological properties. The proposed approach captures topological structure of forest and quantifies topological relationships of tree crowns by using a graph theory-based localized contour tree method, and finally segments individual tree crowns by analogy of recognizing hills from a topographic map. This approach consists of five key technical components: (1) derivation of canopy height model from airborne LiDAR data; (2) generation of contours based on the canopy height model; (3) extraction of hierarchical structures of tree crowns using the localized contour tree method; (4) delineation of individual tree crowns by segmenting hierarchical crown structure; and (5) calculation of geometric and topological properties of individual trees. We applied our new method to the Medicine Bow National Forest in the southwest of Laramie, Wyoming and the HJ Andrews Experimental Forest in the central portion of the Cascade Range of Oregon, U.S. The results reveal that the overall accuracy of individual tree crown delineation for the two study areas achieved 94.21% and 75.07%, respectively. Our method holds great potential for segmenting individual tree crowns under various forest conditions. Furthermore, the geometric and topological attributes derived from our method provide comprehensive and essential information for forest management.     

Markov-random-field-based super-resolution mapping for identification of urban trees in VHR images

Identification of tree crowns from remote sensing requires detailed spectral information and submeter spatial resolution imagery. Traditional pixel-based classification techniques do not fully exploit the spatial and spectral characteristics of remote sensing datasets. We propose a contextual and probabilistic method for detection of tree crowns in urban areas using a Markov random field based super resolution mapping (SRM) approach in very high resolution images. Our method defines an objective energy function in terms of the conditional probabilities of panchromatic and multispectral images and it locally optimizes the labeling of tree crown pixels. Energy and model parameter values are estimated from multiple implementations of SRM in tuning areas and the method is applied in QuickBird images to produce a 0.6 m tree crown map in a city of The Netherlands. The SRM output shows an identification rate of 66% and commission and omission errors in small trees and shrub areas. The method outperforms tree crown identification results obtained with maximum likelihood, support vector machines and SRM at nominal resolution (2.4 m) approaches.     

Assessing plantation canopy condition from airborne imagery using spectral mixture analysis and fractional abundances

Pine plantations in Australia are subject to a range of abiotic and biotic damaging agents that affect tree health and productivity. In order to optimise management decisions, plantation managers require regular intelligence relating to the status and trends in the health and condition of trees within individual compartments. Remote sensing technology offers an alternative to traditional ground-based assessment of these plantations. Automated estimation of foliar crown health, especially in degraded crowns, can be difficult due to mixed pixels when there is low or fragmented vegetation cover. In this study we apply a linear spectral unmixing approach to high spatial resolution (50 cm) multispectral imagery to quantify the fractional abundances of the key image endmembers: sunlit canopy, shadow, and soil. A number of Pinus radiata tree crown attributes were modelled using multiple linear regression and endmember fraction images. We found high levels of significance (r² = 0.80) for the overall crown colour and colour of the crown leader (r² = 0.79) in tree crowns affected by the fungal pathogen Sphaeropsis sapinea, which produces both needle necrosis and chlorosis. Results for stands associated with defoliation and chlorosis through infestation by the aphid Essigella californica were lower with an r² = 0.33 for crown transparency and r² = 0.31 for proportion of crown affected. Similar analysis of data from a nitrogen deficient site produced an outcome somewhat in between the other two damaging agents. Overall the sunlit canopy image fraction has been the most important variable used in the modelling of forest condition for all damaging agents.     

Individual tree crown approach for predicting site index in boreal forests using airborne laser scanning and hyperspectral data

Site productivity is essential information for sustainable forest management and site index (SI) is the most common quantitative measure of it. The SI is usually determined for individual tree species based on tree height and the age of the 100 largest trees per hectare according to stem diameter. The present study aimed to demonstrate and validate a methodology for the determination of SI using remotely sensed data, in particular fused airborne laser scanning (ALS) and airborne hyperspectral data in a forest site in Norway. The applied approach was based on individual tree crown (ITC) delineation: tree species, tree height, diameter at breast height (DBH), and age were modelled and predicted at ITC level using 10-fold cross validation. Four dominant ITCs per 400 m² plot were selected as input to predict SI at plot level for Norway spruce (Picea abies (L.) Karst.) and Scots pine (Pinus sylvestris L.). We applied an experimental setup with different subsets of dominant ITCs with different combinations of attributes (predicted or field-derived) for SI predictions. The results revealed that the selection of the dominant ITCs based on the largest DBH independent of tree species, predicted the SI with similar accuracy as ITCs matched with field-derived dominant trees (RMSE: 27.6% vs 23.3%). The SI accuracies were at the same level when dominant species were determined from the remotely sensed or field data (RMSE: 27.6% vs 27.8%). However, when the predicted tree age was used the SI accuracy decreased compared to field-derived age (RMSE: 27.6% vs 7.6%). In general, SI was overpredicted for both tree species in the mature forest, while there was an underprediction in the young forest. In conclusion, the proposed approach for SI determination based on ITC delineation and a combination of ALS and hyperspectral data is an efficient and stable procedure, which has the potential to predict SI in forest areas at various spatial scales and additionally to improve existing SI maps in Norway.     

Assessing the potential of multi-seasonal WorldView-2 imagery for mapping West African agroforestry tree species

High resolution satellite systems enable efficient and detailed mapping of tree cover, with high potential to support both natural resource monitoring and ecological research. This study investigates the capability of multi-seasonal WorldView-2 imagery to map five dominant tree species at the individual tree crown level in a parkland landscape in central Burkina Faso. The Random Forest algorithm is used for object based tree species classification and for assessing the relative importance of WorldView-2 predictors. The classification accuracies from using wet season, dry season and multi-seasonal datasets are compared to gain insights about the optimal timing for image acquisition. The multi-seasonal dataset produced the most accurate classifications, with an overall accuracy (OA) of 83.4%. For classifications based on single date imagery, the dry season (OA = 78.4%) proved to be more suitable than the wet season (OA = 68.1%). The predictors that contributed most to the classification success were based on the red edge band and visible wavelengths, in particular green and yellow. It was therefore concluded that WorldView-2, with its unique band configuration, represents a suitable data source for tree species mapping in West African parklands. These results are particularly promising when considering the recently launched WorldView-3, which provides data both at higher spatial and spectral resolution, including shortwave infrared bands.     

大兴安岭林区无人机可见光影像散发枯立木识别算法

枯立木识别对森林资源管理,生物多样性保护,以及森林碳储量变化评估具有重要价值.无人机高分辨率影像为枯立木调查提供了较为便捷的方式.现有枯立木识别算法多依靠拥有红边、近红外波段的多光谱影像来实现.相比于多光谱相机,消费级无人机通常搭载的是用于获取可见光(RGB)影像的普通数码相机,较少的波段信息为基于RGB影像的枯立木自...     

A preliminary exploration of the cooling effect of tree shade in urban landscapes

Mitigating urban heat island (UHI) effects, especially under climate change, is necessary for the promotion of urban sustainability. Shade is one of the most important functions provided by urban trees for mitigating UHI. However, the cooling effect of tree shade has not been adequately investigated. In this study, we used a simple and straightforward method to quantify the spatial and temporal variation of tree shade and examined its effect on land surface temperature (LST). We used the hillshade function in a geographic information system to quantify the spatiotemporal patterns of tree shade by integrating sun location and tree height. Relationships between shade and LST were then compared in two cities, Tampa, Florida and New York City (NYC), New York. We found that: (1) Hillshade function combining the sun location and tree height can accurately capture the spatial and temporal variation of tree shade; (2) Tree shade, particularly at 07:30, has significant cooling effect on LST in Tampa and NYC; and (3) Shade has a stronger cooling effect in Tampa than in NYC, which is most likely due to the differences in the ratio of tree canopy to impervious surface cover, the spatial arrangements of trees and buildings, and their relative heights. Comparing the cooling effects of tree shade in two cities, this study provides important insights for urban planners for UHI mitigation in different cities.     

A comprehensive but efficient framework of proposing and validating feature parameters from airborne LiDAR data for tree species classification

Tree species information is crucial for digital forestry, and efficient techniques for classifying tree species are extensively demanded. To this end, airborne light detection and ranging (LiDAR) has been introduced. However, the literature review suggests that most of the previous airborne LiDAR-based studies were only based on limited kinds of tree signatures. To address this gap, this study proposed developing a novel modular framework for LiDAR-based tree species classification, by deriving feature parameters in a systematic way. Specifically, feature parameters of point-distribution (PD), laser pulse intensity (IN), crown-internal (CI) and tree-external (TE) structures were proposed and derived. With a support-vector-machine (SVM) classifier used, the classifications were conducted in a leave-one-out-for-cross-validation (LOOCV) mode. Based on the samples of four typical boreal tree species, i.e., Picea abies, Pinus sylvestris, Populus tremula and Quercus robur, tests showed that the accuracies of the classifications based on the acquired PD-, IN-, CI- and TE-categorized feature parameters as well as the integration of their individual optimal parameters are 65.00%, 80.00%, 82.50%, 85.00% and 92.50%, respectively. These results indicate that the procedures proposed in this study can be used as a comprehensive but efficient framework of proposing and validating feature parameters from airborne LiDAR data for tree species classification.     

Multi-level filtering segmentation to measure individual tree parameters based on Lidar data: Application to a mountainous forest with heterogeneous stands

This paper presents a method for individual tree crown extraction and characterisation from a canopy surface model (CSM). The method is based on a conventional algorithm used for localising LM on a smoothed version of the CSM and subsequently for modelling the tree crowns around each maximum at the plot level. The novelty of the approach lies in the introduction of controls on both the degree of CSM filtering and the shape of elliptic crowns, in addition to a multi-filtering level crown fusion approach to balance omission and commission errors. The algorithm derives the total tree height and the mean crown diameter from the elliptic tree crowns generated. The method was tested and validated on a mountainous forested area mainly covered by mature and even-aged black pine (Pinus nigra ssp. nigra [Arn.]) stands. Mean stem detection per plot, using this method, was 73.97%. Algorithm performance was affected slightly by both stand density and heterogeneity (i.e. tree diameter classes’ distribution). The total tree height and the mean crown diameter were estimated with root mean squared error values of 1.83 m and 1.48 m respectively. Tree heights were slightly underestimated in flat areas and overestimated on slopes. The average crown diameter was underestimated by 17.46% on average.     

A tree counting algorithm for precision agriculture tasks

Abstract

This study proposes an automatic procedure for individual fruit tree identification using GeoEye-1 sensor data. Depending on site-specific pruning practices, the morphologic characteristics of tree crowns may generate one or more brightness peaks (tree top) on the imagery. To optimize tree counting and to minimize typical background noises from orchards (i.e. bare soil, weeds, and man-made objects), a four-step algorithm was implemented with spatial transforms and functions suitable for spaced stands (asymmetrical smoothing filter, local minimum filter, mask layer, and spatial aggregation operator). System performance was evaluated through objective criteria, showing consistent results in fast capturing tree position for precision agriculture tasks.     

Integration of WorldView-2 and airborne LiDAR data for tree species level carbon stock mapping in Kayar Khola watershed,Nepal

Integration of WorldView-2 satellite image with small footprint airborne LiDAR data for estimation of tree carbon at species level has been investigated in tropical forests of Nepal. This research aims to quantify and map carbon stock for dominant tree species in Chitwan district of central Nepal. Object based image analysis and supervised nearest neighbor classification methods were deployed for tree canopy retrieval and species level classification respectively. Initially, six dominant tree species (Shorea robusta, Schima wallichii, Lagerstroemia parviflora, Terminalia tomentosa, Mallotus philippinensis and Semecarpus anacardium) were able to be identified and mapped through image classification. The result showed a 76% accuracy of segmentation and 1970.99 as best average separability. Tree canopy height model (CHM) was extracted based on LiDAR’s first and last return from an entire study area. On average, a significant correlation coefficient (r) between canopy projection area (CPA) and carbon; height and carbon; and CPA and height were obtained as 0.73, 0.76 and 0.63, respectively for correctly detected trees. Carbon stock model validation results showed regression models being able to explain up to 94%, 78%, 76%, 84% and 78% of variations in carbon estimation for the following tree species: S. robusta, L. parviflora, T. tomentosa, S. wallichii and others (combination of rest tree species).     

Combining QuickBird,LiDAR, and GIS topography indices to identify a single native tree species in a complex landscape using an object-based classification approach

There are now a wide range of techniques that can be combined for image analysis. These include the use of object-based classifications rather than pixel-based classifiers, the use of LiDAR to determine vegetation height and vertical structure, as well terrain variables such as topographic wetness index and slope that can be calculated using GIS. This research investigates the benefits of combining these techniques to identify individual tree species. A QuickBird image and low point density LiDAR data for a coastal region in New Zealand was used to examine the possibility of mapping Pohutukawa trees which are regarded as an iconic tree in New Zealand. The study area included a mix of buildings and vegetation types. After image and LiDAR preparation, single tree objects were identified using a range of techniques including: a threshold of above ground height to eliminate ground based objects; Normalised Difference Vegetation Index and elevation difference between the first and last return of LiDAR data to distinguish vegetation from buildings; geometric information to separate clusters of trees from single trees, and treetop identification and region growing techniques to separate tree clusters into single tree crowns. Important feature variables were identified using Random Forest, and the Support Vector Machine provided the classification. The combined techniques using LiDAR and spectral data produced an overall accuracy of 85.4% (Kappa 80.6%). Classification using just the spectral data produced an overall accuracy of 75.8% (Kappa 67.8%). The research findings demonstrate how the combining of LiDAR and spectral data improves classification for Pohutukawa trees.     

Object-based class modelling for multi-scale riparian forest habitat mapping

Object-based class modelling allows for mapping complex, hierarchical habitat systems. The riparian zone, including forests, represents such a complex ecosystem. Forests within riparian zones are biologically high productive and characterized by a rich biodiversity; thus considered of high community interest with an imperative to be protected and regularly monitored. Satellite earth observation (EO) provides tools for capturing the current state of forest habitats such as forest composition including intermixture of non-native tree species. Here we present a semi-automated object based image analysis (OBIA) approach for the mapping of riparian forests by applying class modelling of habitats based on the European Nature Information System (EUNIS) habitat classifications and the European Habitats Directive (HabDir) Annex 1. A very high resolution (VHR) WorldView-2 satellite image provided the required spatial and spectral details for a multi-scale image segmentation and rule-base composition to generate a six-level hierarchical representation of riparian forest habitats. Thereby habitats were hierarchically represented within an image object hierarchy as forest stands, stands of homogenous tree species and single trees represented by sunlit tree crowns. 522 EUNIS level 3 (EUNIS-3) habitat patches with a mean patch size (MPS) of 12,349.64 m² were modelled from 938 forest stand patches (MPS = 6868.20 m²) and 43,742 tree stand patches (MPS = 140.79 m²). The delineation quality of the modelled EUNIS-3 habitats (focal level) was quantitatively assessed to an expert-based visual interpretation showing a mean deviation of 11.71%.     

Generic rule-sets for automated detection of urban tree species from very high-resolution satellite data

The sustainable management and monitoring of urban forests is an important activity in the urbanized world, and operational approaches require information about the status of urban trees to determine the best strategy. One limitation in urban forest studies is the detection and discrimination of tree species using limited training data. Thus, this study focuses on developing generic rule sets from high-resolution WorldView-2 imagery in conjunction with spectral, spatial, colour and textural information for automated urban tree species detection. The object-based image analysis and its combination with statistical analysis of object features is utilized for this purpose. Results of attribute selection indicated that from 55 attributes, only 26 were useful to discriminate urban tree species, namely Messua ferrea L., Samanea saman and Casuarina sumatrana. Finally, the high overall accuracy, approximately 86.87% with kappa of 0.75 confirmed the transferability of the generic model.     

Texture augmented detection of macrophyte species using decision trees

Image classification using multispectral sensors has shown good performance in detecting macrophytes at the species level. However, species level classification often does not utilize the texture information provided by high resolution images. This study investigated whether image texture provides useful vector(s) for the discrimination of monospecific stands of three floating macrophyte species in Quickbird imagery of the South Nation River. Semivariograms indicated that window sizes of 5 × 5 and 13 × 13 pixels were the most appropriate spatial scales for calculation of the grey level co-occurrence matrix and subsequent texture attributes from the multispectral and panchromatic bands. Of the 214 investigated vectors (13 Haralick texture attributes * 15 bands + 9 spectral bands + 10 transformations/indices), feature selection determined which combination of spectral and textural vectors had the greatest class separability based on the Mann–Whitney U-test and Jefferies–Matusita distance. While multispectral red and near infrared (NIR) performed satisfactorily, the addition of panchromatic-dissimilarity slightly improved class separability and the accuracy of a decision tree classifier (Kappa: red/NIR/panchromatic-dissimilarity – 93.2% versus red/NIR – 90.4%). Class separability improved by incorporating a second texture attribute, but resulted in a decrease in classification accuracy. The results suggest that incorporating image texture may be beneficial for separating stands with high spatial heterogeneity. However, the benefits may be limited and must be weighed against the increased complexity of the classifier.     

基于GIS的族谱空间信息查询与可视化研究

族谱是一个家族的生命史,记录家族的起源和发展,具有很大的研究价值。如何实现族谱空间信息化,是GIS社会化研究领域的一个重要课题。文中选择河南省域内某模拟族谱作为研究对象,运用GIS技术整合海量族谱数据,建立地图空间数据库和家族成员基本信息表,以ArcGIS Engine 9.3、SQL Server为平台,开发族谱GIS信息系统,实现族谱空间查询及家族成员迁徙路线可视化等功能。族谱GIS信息系统为族谱研究提供新的思路、方法和技术。