Abstract
Citrus black spot (CBS) is a fungal disease caused by Phyllosticta citricarpa (synonym Guignardia citricarpa). CBS causes fruit lesions and significant yield loss in all citrus (Citrus) species. The most distinguishing CBS symptom is called hard spot, which is a circular lesion with gray tissue at the center surrounded by a black margin. The spectral characteristic of CBS lesions was investigated and compared with the spectral signature of healthy fruit tissue to determine the best distinguishing wave band. Healthy and CBS-affected samples presented similar reflectance below 500 nm and above 900 nm. However, healthy samples reflected more light between 500 and 900 nm, especially within the visible band. Also, spectral reflectance of the same symptomatic lesion was acquired six times over a 2-month period to determine the variation of symptom’s spectral signatures over time after being harvested. A two-sample t test was employed to compare each pair of consecutive repetitions. The results showed that the spectral signature of the CBS lesion did not change significantly over 2 months. The wavelengths between 587 and 589 nm were identified as the distinguishing band to develop a monochrome vision–based sensor for CBS diagnosis. A support vector machine (SVM) classifier was trained using the spectral reflectance data at the selected bands to identify CBS-affected samples in each repetition. The overall CBS detection accuracies varied between 93.3% and 94.6%.
Florida citrus industry has been threatened by several, previously exotic citrus diseases during the past few years. Citrus canker (caused by Xanthomonas axonopodis pv. citri), a bacterial disease, was discovered in 1995 near the Miami International Airport (Gottwald et al., 2002) and despite all the efforts to eradicate the disease, it became widespread in Florida mainly because of the 2004–05 hurricanes (Stover et al., 2014). In 2005, another destructive bacterial disease called Huanglongbing (HLB) or citrus greening caused by Candidatus Liberibacter asiaticus and vectored by the asian citrus psyllid (Diaphorina citri) was discovered in Florida City, south of Miami (Gottwald et al., 2007). Again after a few years, HLB disease was found in all citrus producing counties in Florida and made a huge impact on the $9 billion citrus industry in Florida (Pourreza et al., 2014). In Mar. 2010, CBS was diagnosed on fruit in some groves near Immokalee, FL (Schubert et al., 2013). CBS is a fungal disease caused by P. citricarpa (Er et al., 2013). The disease was found in Taiwan, South Africa, and China in 1919, 1920, and 1936, respectively (Kotzé, 1981; Wang et al., 2012). Later in the 1980s, CBS was officially found in coastal humid regions of Australia and caused huge yield losses for several years (Kotzé, 1981).
CBS causes fruit lesions and substantial yield loss in all citrus species. Sweet orange (Citrus sinensis) varieties such as the ‘Valencia’ are extremely susceptible to this disease. CBS causes a wide range of symptoms, but the most distinguishing one is called hard spot (Fig. 1), which is a circular lesion (with 3–10 mm diameter) with gray necrotic fatal tissue at the center embraced by a black margin. Hard spot becomes apparent at the time of fruit coloring just before harvesting (Dewdney et al., 2014). Fruit that have CBS lesions are nonvaluable for the fresh markets. Premature fruit drop is also a consequence of CBS disease in severe conditions. There is a long latent stage in the disease cycle in which the CBS symptoms are not apparent for several months after infection. Symptoms usually appear at the time of fruit ripening (Dewdney et al., 2014).
Images of two citrus black spot lesions (CBS positive) and two CBS-negative spots on peels of ‘Valencia’ sweet orange fruit.
Citation: HortTechnology hortte 26, 3; 10.21273/HORTTECH.26.3.254
To reduce the spread of the disease, CBS must be efficiently controlled in the grove. In addition, manual detection of CBS symptoms at the packaging process is extremely difficult because they may be confused with blemishes caused by other disorders and the process is time consuming. Therefore, a rapid and accurate CBS identification technique can expedite the quality control process and help growers for better disease management. Computer vision–based sensors have been widely used for plant disease identification (Pourreza et al., 2015; Qin et al., 2012; Sankaran et al., 2010). However, using vision sensors for CBS identification has not been thoroughly investigated. Bulanon et al. (2013) analyzed hyperspectral images of CBS symptoms in the range of 480–950 nm (spectral resolution of 2.8 nm) with the objective of determining the potential bands to develop a multispectral imaging sensor. They defined four wavelengths including 781, 713, 629, and 493 nm as the selected bands for a multispectral image acquisition system. They achieved the overall accuracy of 96% using the four selected wavelengths and normalized difference vegetation index band ratio of 781 nm [near-infrared (NIR)] and 713 nm (red) as the input features.
The main goal of this research was to investigate the spectral signatures of CBS hard spot lesions using high spectral resolution data and determine the best wavelength for CBS identification. The specific objectives were to: 1) investigate the progress of the lesion development on fruit over time after harvest, 2) select the important wave bands for designing a customized and image acquisition system to CBS symptoms, and 3) evaluate the classification accuracy using the selected band as the input feature.
Materials and methods
Data collection.
Healthy and CBS symptomatic citrus fruit of ‘Valencia’ sweet orange were collected from a citrus grove near Immokalee, FL, in Apr. 2014. To conduct the spectral measurement, the citrus samples were transferred to the postharvest laboratory in the Indian River Research and Education Center, University of Florida, Fort Pierce. A total of 134 citrus fruit including 104 CBS-positive and 30 CBS-negative samples were selected randomly for spectral measurement. Two or three CBS symptomatic hard spot lesions were selected and marked randomly on each of the CBS-positive samples to create the CBS-positive class. Also, two CBS asymptomatic spots on each of the CBS-positive samples and two or three spots on CBS-negative fruit were selected to create the CBS-negative class.
Spectral reflectance measurement.
A portable spectrometer (USB2000+; Ocean Optics, Dunedin, FL) with spectral resolution range of ≈0.28 to 0.38 nm and an optical resolution of 0.1 nm was used to measure the spectral reflectance of the target spots on the citrus fruit. A fiber optic reflection probe (QR600-7-SR-125F; Ocean Optics) with a core diameter of 600 µm was used to measure the spectral reflectance of the target spots. A reflection probe holder (RPH-1; Ocean Optics) was used to keep the same probe positioning to all the target spots at 45° in all measurements. The light source (LS-1 Tungsten Halogen Light Source; Ocean Optics) of the spectrometer was turned on 45 min before measurement to ensure it reached its stable status. The optical reference standard was collected before each measurement using a certified 99% white reflectance standard (SRS-99-020; Labsphere, North Sutton, NH).
The measurement was repeated six times on 11 Apr., 18 Apr., 2 May, 15 May, 29 May, and 13 June 2014. The CBS-negative samples were added to the dataset from the second repetition (18 Apr.). At the forth repetition of spectral measurement, a few samples began to decay. These decayed samples were removed before the fifth and sixth repetitions of spectral measurement. Color images of the citrus samples and the selected spots were taken as a reference of the sample status at the time of the spectral measurement. The citrus samples were kept at air temperature of 1 °C and humidity of 70% during the experiment period. The spectral range of the spectrometer was between 340 and 1030 nm; however, the measured reflectance below 400 nm was very noisy. Therefore, the analysis was performed within the entire visible and part of NIR bands. In total, 1914 wavelengths between 400 and 1030 nm were available for the analysis process.
Comparison between repetitions.
Two-sample t test (Snedecor and Cochran 1989) was used to determine whether there is any significant difference between the spectral signatures of different repetitions. The averages of spectral reflectance and their first derivatives were compared between every two consecutive repetitions and also between the first and last repetitions for each class. All data analyses were conducted using MATLAB (version R2011a; MathWorks, Natick, MA).
Band selection.
To determine the most important wavelengths in CBS diagnosis, five feature ranking methods including t test, Kullback–Leibler distance, Chernoff bound, receiver operating characteristic, and Wilcoxon tests were employed (Liu and Motoda, 1998; Theodoridis and Koutroumbas, 2009). The results of each method included a vector of coefficients corresponding to the features (wavelengths). These coefficients represent the level of relevance of each wavelength for the classification process. The coefficient ranges for each method varied since different factors were considered for different feature ranking methods. Therefore, the coefficients in each method were normalized by the maximum obtained coefficient that belonged to the top wavelength ranked with the corresponding method. To select the most relevant bands, a combination of the entire feature ranking results was used to appoint the best set of nominated wavelengths, which were voted by all methods. For this purpose, all the wavelengths that had the coefficients greater than 0.99 in all methods were selected.
Classification.
The selected bands were used to train a SVM binary classifier with two classes of CBS positive and CBS negative (Bishop, 2006). Classification was conducted for every repetition as well as the entire dataset. A 10-fold cross validation method was used in the classification process in which the dataset was randomly divided into 10 folds; 9 folds were used for training while the other fold was used for validation. The classification was repeated 10 times until all the samples were included at least once in the validation set.
Results
Dataset preparation.
In total, 3102 spectral reflectances were measured during the six repetitions of the experiment. Two CBS-positive and two CBS-negative spots were shown on the citrus samples (Fig. 1). The dataset included spectral data of 1553 CBS positive (458 advanced stage and 1095 early stage) and 1460 CBS negative (1026 healthy spot on CBS-positive fruit and 434 healthy spot on CBS-negative fruit). Early and advanced stages of CBS lesions were confirmed by several observations conducted by plant pathologists. Early stage of a CBS hard spot lesion is a small and round spot in dark gray color, whereas the advanced stage of lesion shows a tan center surrounded by a brick-red border. The average spectral reflectance of two CBS lesions (advanced and early stages) and two healthy (healthy spot on CBS-positive fruit and healthy spot on CBS-negative fruit) classes were shown (Fig. 2). The variation (sd) within each class and at each wavelength was illustrated (Fig. 3). The CBS-positive classes had less reflectance than healthy classes at the range of 500 to 820 nm, which is more distinctive in the spectral reflectance curve of the advanced stage of the CBS-positive class. However, the CBS-negative spots reflected more at the visible band. In addition, both CBS-negative classes created very similar spectral signatures. It can be concluded that the nonsymptomatic parts on CBS-infected fruit had similar spectral characteristics to the healthy fruit. All classes had similar reflectance at the wavelengths below 500 nm with small standard deviations. The spectral signatures of the four classes at the wavelengths over 930 nm also generated very similar patterns. Since the spectrometer accuracy at the lower and upper bands of the detector range was not as accurate as the middle band, and the four classes generated similar spectral reflectance at the two ends of the spectral range, It can be concluded that the reflectance information acquired from the lower and upper bands of the spectrometer range were not useful for CBS identification.
Average spectral reflectance of citrus black spot (CBS) lesions in two classes (advanced and early stages of hard spot) and healthy spots in two CBS-negative classes (healthy spot on CBS-positive fruit and healthy spot on CBS-negative fruit) on peels of ‘Valencia’ sweet orange fruit within the visible and near-infrared spectral ranges.
Citation: HortTechnology hortte 26, 3; 10.21273/HORTTECH.26.3.254
Average standard deviations of spectral reflectance of samples in two citrus black spot positive (CBS-positive) classes (advanced and early stages of hard spot) and two CBS-negative classes (healthy spot on CBS-positive fruit and healthy spot on CBS-negative fruit) on peels of ‘Valencia’ sweet orange fruit within the visible and near-infrared spectral ranges.
Citation: HortTechnology hortte 26, 3; 10.21273/HORTTECH.26.3.254
The first derivatives of spectral reflectance for each class were shown (Fig. 4). Also the variation within the first derivatives for each class was demonstrated (Fig. 5). The spectral signatures of CBS-positive and CBS-negative classes created different slopes in the 490- to 590- and 630- to 730-nm bands, which are clearly highlighted (Fig. 4). The first derivative graphs for all four classes overlapped between 590 and 630 nm, which suggested that their spectral reflectance at this band changed in a uniform manner. Between 637 and 670 nm, the first derivatives for the healthy classes and the early stage of CBS had negative values; however, advanced stage of CBS generated positive first derivative values at the same band. The first derivatives of early stage of CBS and the two CBS-negative classes also overlapped and picked up to 0.6 within the wave band of 675 to 715 nm; while the first derivatives of the advanced stage of CBS never reached over 0.2 at the same band. The first derivatives for advanced stage of CBS had the smallest standard deviations compared with other classes (Fig. 5) that suggested more within class spectral signature similarity for this class. At 690 nm, the standard deviations of the first derivatives for the healthy classes as well as the early stage of CBS picked up to 0.35 while t remained under 0.14 for the advanced stage of CBS at the same band.
Average first derivatives of spectral reflectance of samples in two citrus black spot positive (CBS-positive) classes (advanced and early stages of hard spot) and two CBS-negative classes (healthy spot on CBS-positive fruit and healthy spot on CBS-negative fruit) on peels of ‘Valencia’ sweet orange fruit within the visible and near-infrared spectral ranges.
Citation: HortTechnology hortte 26, 3; 10.21273/HORTTECH.26.3.254
Average standard deviations of first derivatives of spectral reflectance of samples in two citrus black spot positive (CBS-positive) classes (advanced and early stages of hard spot) and two CBS-negative classes (healthy spot on CBS-positive fruit and healthy spot on CBS-negative fruit) on peels of ‘Valencia’ sweet orange fruit within the visible and near-infrared spectral ranges.
Citation: HortTechnology hortte 26, 3; 10.21273/HORTTECH.26.3.254
Comparison between repetitions.
The probability values for the two-sample t test conducted for the spectral reflectance of every two consecutive repetitions and also between the first and last repetitions were illustrated (Table 1). The CBS-negative samples were added to the dataset at the second repetition so healthy spot on healthy sample class did not have a probability value at the first column. Since there was no probability value less than 0.05, it can be concluded that there was no significant difference between the repetitions.
Two-sample t test probability values for pairwise comparison between the spectral reflectance of citrus black spot (CBS) lesions and healthy spots on the peels ‘Valencia’ sweet orange fruit for every pair of consecutive repetitions as well as the first and last repetitions of spectral measurements on 11 Apr., 18 Apr., 2 May, 15 May, 29 May, and 13 June 2014.
The probability value for two-sample t test analyses conducted for the first derivatives of spectral reflectance of every two consecutive repetitions and also between the first and last repetitions were shown (Table 2). First derivative of a spectral reflectance describes the slopes in the spectral signature. No probability value below 0.05 was achieved for the two-sample t tests. These results confirmed that the spectral signatures of samples in each did not significantly change over the period of 11 Apr. and 13 June 2014. It can be inferred that the spectral reflectance of CBS symptoms did not develop or disappear during the experiment period.
Two-sample t test probability values for pairwise comparison between the first derivatives of the spectral reflectance of citrus black spot (CBS) lesions and healthy spots on the peels of ‘Valencia’ sweet orange fruit for every pair of consecutive repetitions as well as the first and last repetitions of spectral measurements on 11 Apr., 18 Apr., 2 May, 15 May, 29 May, and 13 June 2014.
Band selection.
The normalized coefficients of all wavelengths obtained by the feature ranking methods were illustrated (Fig. 6). Those wavelengths that had coefficients over 0.99 in all ranking methods were selected as the potential wavelengths. As shown in Fig. 6, wavelengths between 587 and 589 nm had coefficients over 0.99 in all methods. Therefore, this band was selected for the classification purpose.
Normalized coefficients of all wavelengths between 400 and 1030 nm that illustrated the level of relevance of each wavelength to classification of spots on the peels of ‘Valencia’ sweet orange fruit in the range of zero to one in which the wavelengths with normalized coefficient of zero had no contribution in the classification process, while the wavelengths with normalized coefficient of one had the maximum contribution in the classification process. The coefficients were acquired by five feature ranking methods [t test, Kullback–Leibler distance, Chernoff bound, receiver operating characteristic (ROC), and Wilcoxon test] and they were normalized by the maximum coefficient. The selected band is pointed by a red arrow.
Citation: HortTechnology hortte 26, 3; 10.21273/HORTTECH.26.3.254
The selected band (587 to 589 nm) represents yellow color in the electromagnetic spectrum. As shown in Fig. 2, the spectral reflectances of CBS-positive and CBS-negative classes were distinctively separated between 587 and 589 nm.
Classification.
The classification results for all repetitions are shown in Table 3. The overall accuracies varied in a very narrow range from 93.3% to 94.6%. It can be concluded that using the selected band as the input feature in the SVM classifier resulted in analogues classification accuracies in all repetitions. These results confirmed that there was no significant difference among the spectral reflectance of different repetitions. False negative rates varied from 6.9% to 9.2% for different repetitions while the false positive rates were between 0.5% and 4.6%. The spectrometer probe has a very narrow core with the diameter of 600 µm. It is possible that the probe was pointed at the area around the hard spot, which was asymptomatic and as a result the spectral reflectance of an asymptomatic spot was measured instead of the hard spot. This measurement error might be one reason for higher false negative rates.
Number of spots on the peels of ‘Valencia’ sweet orange fruit that were classified into either citrus black spot positive (CBS+) or CBS-negative (CBS−) classes along with their corresponding classification accuracies and misclassification error for six repetitions of the spectral measurements on 11 Apr., 18 Apr., 2 May, 15 May, 29 May, and 13 June 2014.
The results of a classification conducted for the entire dataset were shown (Table 4). An overall accuracy of 93.4% was achieved using the spectral data between 587 and 589 nm. These results were similar to the classification accuracies achieved within each repetition. In most of cases, CBS-negative samples were identified with higher accuracies compared with CBS-positive samples. Again the false negative rate was equal to 9.5%, which was higher than the false positive rate (3.6%).
Number of spots on the peels of ‘Valencia’ sweet orange fruit in the entire dataset of the citrus black spot (CBS) lesions and healthy spots (including all six repetitions of the spectral measurements on 11 Apr., 18 Apr., 2 May, 15 May, 29 May, and 13 June 2014), which were classified into either CBS-positive (CBS+) or CBS-negative (CBS−) classes along with their corresponding classification accuracies and misclassification error.
Discussion
Spectral reflectances of CBS lesions in two stages of the disease as well as two types of healthy spots were measured six times over 2 months in 2014. The results showed that the spectral signatures did not significantly change after the fruit were harvested. It can be derived that neither the stage of the disease changed after harvesting nor new lesion appeared on the healthy spots of CBS-infected fruit.
The wave band of 587 to 589 nm was selected as the most relevant band for detecting CBS. At this band, early and advanced stages of CBS reflected only 8.9% and 5.7% of light, respectively, while healthy spots reflected 30.5% of light on CBS infected and 26.7% of light on healthy fruit. Compared with healthy orange peel, black spots had darker color and as a result, they absorb more light. The standard deviation for CBS classes was ≈4.7% at the selected band, whereas it was ≈7.4% for healthy classes. This values confirmed more variation within each of healthy classes at the selected band. One reason might be the higher reflection from the healthy spots compared with the both CBS classes. All four classes had positive first derivatives ranging from 0.035 to 0.13 at the band of 587 to 589 nm that indicated an increasing trend for all spectral reflectance curves. The results also showed that the early and advanced stages of CBS at the band of 637 to 670 nm had opposite first derivative values. Therefore, the spectral information at this band might be useful for detecting the stage of CBS.
The spectral data at the selected band were used as the only input for classifying CBS and healthy spots in this study, which resulted in an acceptable overall accuracy of 93.4% while Bulanon et al. (2013) employed four wavelengths (three in visible band and one in NIR band) to achieve the accuracy of 96% in CBS detection. Although their results showed a higher accuracy, their proposed vision sensor required a multispectral camera, which will be more expensive and more difficult to use. The selected band in this research was within the visible band and a monochrome camera can be used to develop the vision sensor. Therefore, the final product might be less expensive and more affordable for citrus growers.
Conclusions
In this study, the spectral characteristics of CBS symptoms were investigated and compared with the healthy tissue. A spectrometer was employed to measure the spectral reflectance of two CBS-positive and two CBS-negative samples in six repetitions over 2 months. The results showed that there was no significant difference among the spectral signatures of the same spot measured during 2 months of data collection. The wavelengths between 587 and 589 nm were identified as a potential wave band to develop a customized monochrome image acquisition system for in-field CBS diagnosis purpose. A SVM classifier was trained with the spectral data from the selected wave band to classify the samples into two classes of CBS positive and CBS negative. The overall accuracies ranging from 93.3% to 94.6% were achieved for several repetitions of the experiment. Also, an overall accuracy of 93.4% was achieved when all samples in the dataset regardless of their repetitions were used for the classification purpose. Bulanon et al. (2013) obtained an overall accuracy of 96% using the hyperspectral data in four bands, while in this study, only one band was used for classification with acceptable accuracy. A monochrome vision sensor may be developed based on the results of this study for in-field CBS diagnosis.
Units
Literature cited
Bishop, C.M. 2006 Pattern recognition and machine learning. 1st ed. Springer, New York, NY
Bulanon, D.M., Burks, T.F., Kim, D.G. & Ritenour, M.A. 2013 Citrus black spot detection using hyperspectral image analysis Agr. Eng. Intl. CIGR J. 15 171 180
Dewdney, M.M., Schubert, T.S., Estes, M.R. & Peres, N.A. 2014 Florida citrus pest management guide: Citrus black spot. 10 Aug. 2015. <http://edis.ifas.ufl.edu/CG088>
Er, H., Roberts, P., Marois, J. & van Bruggen, A. 2013 Potential distribution of citrus black spot in the United States based on climatic conditions Eur. J. Plant Pathol. 137 635 647
Gottwald, T.R., da Graça, J.V. & Bassanezi, R.B. 2007 Citrus Huanglongbing: The pathogen and its impact Plant Health Prog. doi:10.1094/PHP-2007-0906-01-RV
Gottwald, T.R., Graham, J.H. & Schubert, T.S. 2002 Citrus canker: The pathogen and its impact Plant Health Prog. doi:10.1094/PHP-2002-0812-01-RV
Kotzé, J. 1981 Epidemiology and control of citrus black spot in South Africa Plant Dis. 65 945 950
Liu, H. & Motoda, H. 1998 Feature selection for knowledge discovery and data mining. 1st ed. Springer, Berlin, Germany
Pourreza, A., Lee, W.S., Ehsani, R., Schueller, J.K. & Raveh, E. 2015 An optimum method for real-time in-field detection of Huanglongbing disease using a vision sensor Comput. Electron. Agr. 110 221 232
Pourreza, A., Lee, W.S., Raveh, E., Ehsani, R. & Etxeberria, E. 2014 Citrus Huanglongbing detection using narrow-band imaging and polarized illumination Trans. Amer. Soc. Agr. Biol. Eng. 57 259 272
Qin, J., Burks, T.F., Zhao, X., Niphadkar, N. & Ritenour, M.A. 2012 Development of a two-band spectral imaging system for real-time citrus canker detection J. Food Eng. 108 87 93
Sankaran, S., Mishra, A., Ehsani, R. & Davis, C. 2010 A review of advanced techniques for detecting plant diseases Comput. Electron. Agr. 72 1 13
Schubert, T., Dewdney, M., Peres, N., Palm, M., Jeyaprakash, A., Sutton, B., Mondal, S., Wang, N.-Y., Rascoe, J. & Picton, D. 2013 First report of Guignardia citricarpa associated with citrus black spot on sweet orange (Citrus sinensis) in North America Eur. J. Plant Pathol. 137 635 647
Snedecor, G.W. & Cochran, W.G. 1989 Statistical methods. 8th ed. Iowa State Univ. Press, Ames, IA
Stover, E., Driggers, R., Richardson, M.L., Hall, D.G., Duan, Y. & Lee, R.F. 2014 Incidence and severity of asiatic citrus canker on diverse citrus and citrus-related germplasm in a Florida field planting HortScience 49 4 9
Theodoridis, S. & Koutroumbas, K. 2009 Pattern recognition. 4th ed. Elsevier, Boston, MA
Wang, X., Chen, G., Huang, F., Zhang, J., Hyde, K.D. & Li, H. 2012 Phyllosticta species associated with citrus diseases in China Fungal Divers. 52 209 224