arxiv: v1 [cs.cv] 25 Oct 2017

Transcription

1 Crop Panning using Stochastic Visua Optimization Gunjan Sehga *, Bindu Gupta, Kausha Paneri, Karamjit Singh, Geetika Sharma, Gautam Shroff TCS Research, India arxiv: v1 [cs.cv] 25 Oct 2017 ABSTRACT As the word popuation increases and arabe and decreases, it becomes vita to improve the productivity of the agricutura and avaiabe. Given the weather and soi properties, farmers need to take critica decisions such as which seed variety to pant and in what proportion, in order to maximize productivity. These decisions are irreversibe and any unusua behavior of externa factors, such as weather, can have catastrophic impact on the productivity of crop. A variety which is highy desirabe to a farmer might be unavaiabe or in short suppy, therefore, it is very critica to evauate which variety or varieties are more ikey to be chosen by farmers from a growing region in order to meet demand. In this paper, we present our visua anaytics too, ViSeed, showcased on the data given in Syngenta 2016 crop data chaenge 1. This too heps to predict optima soybean seed variety or mix of varieties in appropriate proportions which is more ikey to be chosen by farmers from a growing region. It aso aows to anayse soutions generated from our approach and heps in the decision making process by providing insightfu visuaizations. Index Terms: K.6.1 [Management of Computing and Information Systems]: Project and Peope Management Life Cyce; K.7.m [The Computing Profession]: Misceaneous Ethics 1 INTRODUCTION With increasing word popuation and decreasing arabe and, optimizing the productivity of and is the need of the hour. To meet the growing food demand [5] farmers need to take critica decisions ike on what(soi), which (variety), and how much(proportion) in order to maximize the yied. However, a seed variety highy desired by a farmer may be unavaiabe or in short suppy. Therefore, it is critica to evauate which variety is more ikey to be chosen by farmers from a growing region in order to meet demand. As the production varies due to differences in weather conditions [7] and soi quaity [3], there cannot be a singe seed variety that wi yied high production across regions. Hence, predicting the appropriate mix of proportions of different seed varieties is desirabe. Whie a standaone soution with predicted seed variety or mix of varieties for a region is very hepfu, but in the rea word, where the number of regions and varieties both can be arge, it is very crucia to have visuaization based patform to anayze a possibe soutions. In this paper, we present a machine earning and optimization based approach to predict seed variety or mix of varieties in appropriate proportions which is more ikey to be chosen by farmers from a growing region. We aso present our visua anaytics too to understand and anayse the soutions generated by our approach. This too heps in the decision making process and aso provides insightfu visuaizations. We use Syngenta Crop Chaenge 2016 dataset which requires computation of an optima combination of upto five soybean varieties *e-mai: sehga.gunjan@tcs.com e-mai:bindu.gupta2@tcs.com e-mai:gautam.shroff@tcs.com 1 for the given region using historica sub-region data and experiment data from a few experiment ocations. Our approach to the chaenge comprises of (a) machine earning and optimization techniques to compute the soution, as we as (b) a geo-spatia visua anaytics too, ViSeed, to understand the given data and anayse the soutions. As the production of soybean varies due to differences in weather conditions and soi quaity and there is no singe variety that wi yied high production across the region, we have experimented with two possibe soutions to the chaenge. The first, goba soution, required by the chaenge and defined as a combination of upto five varieties to be grown over the entire region. The second, a differentiated soution, consisting of individua optima combinations for each sub-region. We aso compute a spatia cohesion score for each subregion which measures the simiarity of the soutions for the sub-region with those of its neighbors. Finay, we show that the differentiated soution performs marginay better and has ower variance than the goba soution. Rest of the paper is organized as foows. In section 2, we present the probem statement aong with out approach to predict the optima set of varieties and in section 3, we present our visua anaytics too ViSeed and showcase it for the Syngenta data chaenge In section 4, we present our resuts of prediction accuracies and predicted soyabean varieties and concude in section 5. 2 METHODOLOGY AND THEORY 2.1 Probem Statement: Let {v 1,v 2,...,v n } be the n soybean varieties and et R be a region with k sub-regions {R 1,R 2,...,R k }. Each of the sub-region R i has different soi and weather conditions associated with it. Our goa is to find which soybean seed variety, or mix of up to five varieties in appropriate proportions, wi best meet the demands of farmers in each sub-region R i and for whoe region R. In order to find such mix of seed varieties, we predict the top five varieties for each sub-region in terms of maximum yied and then find the optima proportion of these five varieties in order to maximize yied and minimize variance in the yied. Our approach to predict the mix of soybean varieties in appropriate proportion for each subregion R i and for whoe region R consists of three steps: 1) Prediction of Weather and Soi attributes, 2) Yied Prediction given the soybean variety, and weather and soi conditions, and 3) Yied Optimization. We aso present our visua anaytic too to understand and anayses the soutions generated by our approach. This too heps in decision making process and aso provide insightfu visuaizations. 2.2 Weather and Soi Prediction For each subregion R i, et {w i 1 (t),wi 2 (t),...,wi N (t)} be the weather condition and {s i 1 (t),si 2 (t),...,si M (t)} be the soi condition attributes at time t. Given these attributes from initia time t 0 to the current time t, we use Deep earning based approach LSTM [6] to predict the vaue of these attributes for time t + 1. For each attribute separatey, say w i N, we prepare a sequence of its vaues from time t 0 to t 1, and use it as an input to train LSTM with the target of predicting vaue of w i N at time t and then we use the trained LSTM to predict the vaue for time t + 1.LSTM based neura networks are competitive with the traditiona methods and are considered a good aternative to forecast

2 The term w norm(var ) is caed variabiity. We ran above optimization for ten threshods of variabiity, i.e., ten vaues of τ from 0 to 1 with the step size of 0.1. For every vaue of τ, we get the optima soution. Therefore, for a subregion R i, we get 10 soutions and out of these 10 soutions, we choose the soution having maximum yied and minimum variabiity and it is caed defaut soution for sub-region R i Figure 1: LSTM architecture used to predict weather and soi attributes genera weather conditions [9]. Figure 1 shows an architecture used for the prediction of weather and soi attributes. 2.3 Yied Prediction Once we predict the weather and soi attributes for the time t + 1, we use these attributes as a feature set to predict the yied in every sub-region R i for each soybean variety v j, where j = 1,2,...,n. We divide the yied vaue into r equay sized bins by taking maximum and minimum from historica data and we treat the prediction probem as a cassification probem, where our goa is to predict the bin vaue of yied. More formay, for each sub-region R i, we compute n probabiity distributions {p i j,1, pi j,2,..., pi j,r } of yied, one for every soybean variety v j, where j = 1,2,...,n, using Random Forest Cassifier (RFC) [2]. RFC is an ensembe earning method that operates by constructing a mutitude of decision trees at training time and outputting the cass that is the mode of the casses (cassification) of the individua trees. As an output, we get the count of each cass which represents the number of trees outputting the cass. Further, we convert these counts into probabiities by diving each count by the sum of a counts. 2.4 Yied Optimization Given n probabiity distributions of the yied y i for sub-region R i, we use an optimization approach to obtain weighted combination of varieties in order to maximize yied and minimize standard variation or variabiity. Steps to obtain combination of varieties in an appropriate proportion are given as foows: 1. Given n probabiity distributions {p i j,1, pi j,2,..., pi j,r } of yied y i for every soybean variety v j, where j = 1,2,...,n, we cacuate expected vaue and variance of each distribution, represented by E j, and Var j respectivey. 2. We choose top k distributions out of n having maximum score cacuated as: score j = norm(e j ) + (1 norm(var j )) (1) where norm(e j ) and norm(var j ) are the normaized vaues between 0 to 1 of E j and Var j respectivey. 3. We use an optimization technique with objective function of maximizing yied using combination of upto five varities out of chosen top k in an appropriate proportion. The objective function and constraints of optimization are given as foows: Constraints: Objective function: max( w E ) (2) w norm(var ) < τ, w >.10, and w = 1 (3) Spatia Cohesion(SC) Score: For every soution obtained from optimization approach, we cacuate SC Score which is cacuated as foows: Let for a sub-region R i, the optimized soution at τ = τ 1 contains five varieties v i 1,vi 2,...,vi 5 in some proportion. Let near(r i ) = {N1 i,ni 2,...,Ni i } be the set of neighboring sub-regions of R i which are having maximum distance of m mies from the centroid of it. For every v i j in the soution of R i, we cacuate variety score as: var s (v i j ) = k= i k=1 wi j,k i (4) where w i j,k is the proportion with which variety vi j exist in the soution of neighboring sub-region Nk i at τ = τ 1. Further, SC score of sub-region R i is cacuated as the average of a variety scores in the soution: SC i = 5 j=1 var s(v i j ) (5) 5 3 VISUAL ANALYTICS USING VISEED We now describe, ViSeed, our visua anaytics too to understand the given data and anayse the soution generated by our anaytics methodoogy.this too differentiates our work from other reated works [1] [8] as it ets the retaier expore varieties performing we in oca as we as goba areas. As agricutura yieds vary widey around the word due to cimate and the mix of crops grown [4],ViSeed ets the farmer expore the quaity of soi and cimatic variations region wise intuitivey to take the panting decisions accordingy. The main screen of ViSeed is divided into two parts. The first part dispays a map of the United States over which various sub-region attributes can be visuaized, Figure 2 A. The second (right hand pane) part, B, contains a tabbed contro pane, to switch between various visuaizations of the soution data. Getting Started A data attribute such as precipitation or soar radiation may be visuaized by seecting it from the attribute menu and a year from the timeine as shown in Figure 2. Further, as described in the previous section, we first compute the top k varieties for each sub-region, based on high expected yied and ow variance and from them, an optima soution with up to five varieties. As a variety may occur in the optima soution of mutipe sub-regions, we compute a distribution of weights for each variety across subregions and the expected vaue of this distribution. The varieties are ranked in decreasing order of expected vaue which is an indicator of prevaence of the variety across sub-regions and dispayed in the right pane when the visuaization too starts up, Figure 2, C. Thus, the user is provided a starting point to begin exporing the possibe soutions. The histogram of weights for each variety across sub-regions, using a coour map, is shown aongside its expected vaue. Seection of a range on the histogram of a variety highights those sub-regions for which the variety has weight or proportion in the seected range. Cicking on a variety name highights those sub-regions on the map for which the variety occurs in the optima soution. Cicking mutipe varieties highights the regions for a, thus aowing the user to visuaize cumuative prevaence of varieties. Common Soution A user may expore various soutions, for the entire region, by seecting up to five varieties from this ist, 1 in

3 Figure 2: ViSeed: Main Data Exporation Screen Common Soution Exporation Figure 2. On pressing the query button, 2, proportions of each of the seected varieties are computed, 3, and the tota yied for the region is predicted, 4. Differentiated Soution Each sub-region has a precomputed defaut soution from among its top k varieties. Cicking on a subregion in the map, Figure 3, 1, brings up the top k varieties for that sub-region, 2, aong with their weights in the optima soution, count of sub-regions in which the variety is in the top k and the predicted yied distribution for the variety. The sub-regions for which a variety is in the top k ist can be seen by cicking on the red count bar. For every soution, we show the Average Yied and Average Standard Deviation and Average offset in % of entire region R. The standard deviation and offset of each sub-region is cacuated as: 5=1 w Var Standard deviation (S.D) = 5 Offset % = ( S.D ) 100 ExpectedYied (6) (7) where Var is the variance of variety v and w is its proportion in the soution. Changing Variabiity Our too aso aows the user to anayse soutions by paying with different variabiity threshods. This can be done by first cicking on the Variance tab. The user can set a variabiity threshod by moving the sider, Figure 4, 1. On pressing the query button, the ist of varieties, with variabiity beow the chosen threshod is dispayed, aong with their histograms of weights across sub-regions and expected vaues as before. A new optima soution is computed for each sub-region and its simiarity with the soutions of neighboring sub-regions is cacuated as a spatia cohesion score. This score is visuaized on the map. The user may aso interact with this ist of varieties and compute a goba soution for the entire region, as described earier. 4 Q UANTITATIVE Figure 3: Top k Varieties for a Sub-Region RESULTS In this section, we present our resuts of LSTM and RFC mode used for weather and yied prediction. We used keras, scikit-earn and cvxpy respectivey to impement LSTM, RFC and optimization. Avaiabe Data: We were provided with the foowing two datasets: 1. Experiment Dataset: It consists of experiments, in 583 sub-regions, between 2009 and 2015 using 174 varieties. It has three weather and three soi condition attributes for every sub-region. Figure 4: Changing Soution Variabiity

4 Attributes Vaidation Set Test Set Temperature 0.69% 0.78% Percipitation 0.73% 0.83% SorRadiation 2.6% 2.8% Tabe 1: N-RMSE of three weather attributes on vaidation and test set using LSTM Figure 5: Common Soution: Areas in which Varieties are optima Cumuative area in which varieties are optima 2. Region Dataset: It consists of 6490 sub-regions with the given three soi and three weather condition attributes from the year 2000 to We predict three attributes of weather conditions, temperature, precipitation, and sor radiation for every sub-region of Region dataset. For an attributes say w i N in sub-region R i, we prepare the sequence of 14 vaues from year 2000 to 2014 as an input to train LSTM with a target of predicting vaue of year We vaidate and test the LSTM mode by dividing Region dataset into training, vaidation, and test data in the ratio of 70:15:15 respectivey. Tabe 1, shows the normaized root mean square error (N-RMSE) for a three weather attributes on vaidation and test set. Here, N-RMSE is defined for an attribute say, w i N as RMSE = k i=1 (act(wi N ) pred(wi N ))2 k (8) RMSE N-RMSE = (max(w i N ) 100 (9) min(wi N )) where act(w i N ) and pred(wi ) are the actua and predicted vaues, max(w i N ) and min(wi ) are maximum and minimum vaues, of attribute w i N for sub-region R i. The vaue of k is 6490 in our case. N-RMSE in Tabe 1 indicating that the prediction of weather attributes using LSTM have ess than 1% error for temperature and precipitation and ess than 3% error for Sor radiation. We use this trained LSTM mode to predict weather attributes for year Note, we did not predict soi condition parameters as they did not change over time in experiment dataset. We use experiment dataset to train RFC mode by dividing it into three parts train, vaid and test dataset in the ratio of 70:15:15 respectivey. Soi and weather condition attributes in each experiment has been used as a feature set in RFC and discretized yied as a target variabe. N-RMSE of yied predicted on vaidation and test set using RFC is 6.01% and 6.25% respectivey. We use the trained RFC mode to predict the yied for 6490 sub-regions in Region dataset with weather and soi attributes for year 2016 as input, predicted using LSTM(as expained above). 4.1 Insights from ViSeed Common Soution In order to compute the common soution, we used ViSeed to check mutipe combinations of the top ten growing varieties based on expected vaue and arrived at the reported soution. The areas in which these varieties are in the optima differentiated soution are shown in figure 5, and the cumuative area for a five is shown in figure 5. Differentiated Soution Anaysing the predicted yied for the differentiated soution, we find two areas with high yied as highighted in figure 6. The spatia cohesion score is aso visuaised in the same figure and observers to be high for the areas with high yied. We vaidate this in figure 6, by visuaizing the sub-regions in which a variety from a high yied, high spatia cohesion score sub-region is grown. We may concude that high yied varieties are ocaized to certain regions, and so they do not occur in the optima common soution. Experiments with Variabiity In figure 7, we show the changes in spatia cohesion and yied for different variabiity threshods. We find that with a ow variabiity threshod of 0.3, there is no optima soution for most of the sub-regions (dark-grey areas in the map). Increasing the threshod, resuts in soutions for most of the subregions aong with an increase in the average yied per sub-region and the spatia cohesion score. However, beyond a certain threshod, the gain in yied and spatia cohesion is very sma. Our submission to the Syngenta chaenge comprised of two parts. We use (a) machine earning and stochastic optimisation to compute soutions and (b) have deveoped a visua anaytics too, ViSeed, to anayse the resuts. In particuar, we predict weather and soi attributes of each sub-region through time-series regression using LSTMs. For each sub-region and seed variety, a Random Forest cassifier is trained on experiment data to predict yied distributions. Next, we compute weights of varieties through stochastic optimization, maximizing expected yied and minimizing variance, for each subregion, foowed by visua anaytics to choose an optima goba soution based on the spread of each variety across ocay optima combinatios.. Our combination of soybean varieties is as foows - V156774: 48.1%, V156806: 15.2%, (iii) V152312: 13.5%, (iv) V114565: 11.8% and (v) V152322: 11.4%. We provide a second soution to the chaenge consisting of individua optima soutions for each sub-region which performs marginay better than the first reported above. Our geo-spatia visua anaytics too ViSeed, is designed to expore the raw data as we as aid in optimization. Our entry was not among the top 5 fina entries seected from 600 registered teams and as the detais of the winning entries have not been made pubic, we cannot compare our approach with theirs. 5 CONCLUSION In this paper, we propose an approach for crop panning based on machine earning modes (RFC and LSTM), stochastic optimization and a visua anaytics patform. We have given 2 different soution

5 Figure 6: Differentiated Soution: High Yied Areas and Spatia Cohesion Vaidation of Spatia Cohesion [8] O. Marko, S. Brdar, M. Panic, P. Lugonja, and V. Crnojevic. Soybean varieties portfoio optimisation based on yied prediction. Computers and Eectronics in Agricuture, 127: , [9] M. A. Zaytar and C. E. Sequence to sequence weather forecasting with ong short-term memory recurrent neura networks. 143:7 11, Figure 7: Differentiated soutions at different Variabiity threshods sets; i) Common soution for entire region, ii) Differentiated soutions at sub-region eve. We use expected yied based on a mode using sub-region wise predictions of weather and soi conditions, standard deviation of expected yied as the criteria to seect seed varieties. We give the spatia cohesion score for each soution which heps to find the simiar soutions in the neigbouring sub-regions. We aso present a geo-spatia visua anaytics too which has the capabiity of exporing raw data and heps the retaier in decision making by aowing exporation of soutions at sub-region as we as goba eve. R EFERENCES [1] O. Adekanmbi and O. O. Ougbara. Mutiobjective optimization of crop-mix panning using generaized differentia evoution agorithm [2] L. Breiman. Random forests. Machine earning, 45(1):5 32, [3] S. Drummond, K. Sudduth, A. Joshi, S. Birre, and N. Kitchen. Statistica and neura methods for site specific yied prediction. [4] J. A. Foey, N. Ramankutty, K. A. Brauman, E. S. Cassidy, J. S. Gerber, M. Johnston, N. D. Mueer, C. OConne, D. K. Ray, P. C. West, et a. Soutions for a cutivated panet. Nature, 478(7369): , [5] H. C. J. Godfray, J. R. Beddington, I. R. Crute, L. Haddad, D. Lawrence, J. F. Muir, J. Pretty, S. Robinson, S. M. Thomas, and C. Toumin. Food security: the chaenge of feeding 9 biion peope. science, 327(5967): , [6] S. Hochreiter and J. Schmidhuber. Long short-term memory. Neura computation, 9(8): , [7] T. Iizumi and N. Ramankutty. How do weather and cimate infuence cropping area and intensity? Goba Food Security, 4:46 50, 2015.