arxiv: v1 [eess.sp] 6 Nov 2018

Transcription

1 REAL-TIME PREDICTION FOR FINE-GRAINED AIR QUALITY MONITORING SYSTEM WITH ASYNCHRONOUS SENSING Zixuan Bai, Zhiwen Hu, Kaigui Bian and Lingyang Song School of Elecronics Engineering and Compuer Science, Peking Universiy, Beijing, China arxiv:809v [eesssp] 6 Nov 08 ABSTRACT Due o he significan air polluion problem, monioring and predicion for air qualiy have become increasingly necessary To provide real-ime fine-grained air qualiy monioring and predicion in urban areas, we have esablished our own Inerne-of-Things-based sensing sysem in Peking Universiy Due o he energy consrain of he sensors, i is preferred ha he sensors wake up alernaively in an asynchronous paern, which leads o a sparse sensing daase In his paper, we propose a novel approach o predic he real-ime fine-grained air qualiy based on asynchronous sensing The sparse daase and he spaial-emporal-meeorological relaions are modeled ino he correlaion graph, in which way he predicion procedures are carefully designed The advanage of he proposed soluion over exising ones is evaluaed over he daase colleced by our air qualiy monioring sysem Index Terms Air qualiy, fine-grained, real-ime INTRODUCTION A recen repor from he World Healh Organizaion shows ha one in eigh of oal global deahs are due o air polluion exposure [] Governmen agencies have defined he air qualiy index (AQI) o evaluae polluion degree where high concenraion of fine paricles is usually he main facor of a high AQI Tradiional AQI observaion saions can only provide a coarse-grained and high-laency monioring [] However, a recen sudy shows ha he disribuion of fine paricles could vary wihin meers [3] To make up for he above deficiency, i is recommended o deploy numerous low-cos iny Inerne-of-Things (IoT) sensing devices o monior fine-grained air qualiy(mainly PM 5 values) for he regions wih complicaed errain [] Therefore, we have designed a wireless sensor nework sysem The massive commercial IoT sensors can monior AQIs unil he baeries are dead In his way, he real-ime fine-grained monioring and predicion are achieved by he massive colleced daa and he echniques like machine learning [5, 6] However, since he oudoor baery-powered sensors have limied energy [7, 8], i is preferred ha he sensors wake up alernaely in an asynchronous way o prolong he lifeime of sensing nework [9] Based on he colleced asynchronous daa, few exising mehods can provide reliable finegrained AQI predicion For insance, Long Shor Term Memory nework (LSTM) [5] can only be implemened wih a synchronous daase raher han an asynchronous one In addiion, Muli-layer Percepion (MLP) [6] and spaial-emporal disance weighing inerpolaion (IDW) [0] do no perform well based on asynchronous AQI daa This is because, MLP is unable o reveal he spaial-emporal-meeorological relaions among he AQIs in differen poins-of-ineres (POIs), and IDW is only an inuiive soluion wihou learning from massive colleced daa and he influence of he weaher condiions In his paper, we propose a novel scheme o conduc he fine-grained and real-ime predicion of AQI based on asynchronous daa colleced by our monioring sysem By designing he correlaion graph (CG), we presen he asynchronous sensing daa and he spaial-emporal-meeorological relaions Based on he CG model, he predicion procedures are carefully designed and an opimizaion problem arises To obain he real-ime fine-grained predicion resuls, we aim o solve he opimizaion problem by an algorihm combining a closed-form derivaion and geneic algorihm The advanage of he proposed soluion over exising ones is evaluaed over he daase colleced by our monioring sysem The main conribuions of our work are lised as follows: ) We presen our air qualiy sysem in Peking Universiy based on massive IoT sensors, where asynchronous sensing daa are modeled ino a spaial-emporal-meeorological graph ) We propose a novel predicion algorihm for real-ime and fine-grained air qualiy based on sparse daase 3) We evaluae he performance gain of our approach over exising mehods based on real measured daa The res of our paper is organized as follows Secion inroduces he CG model Secion 3 specifies he predicion procedures and applies appropriae mehods o obain realime and fine-grained predicion Secion shows he simulaion resuls Finally, conclusions are given in Secion 5 SYSTEM MODEL In his secion, we firs inroduce our air qualiy asynchronous sensing sysem in Secion Then, he correlaion graph is consruced o model he asynchronous sensing daa in Secion The spaial-emporal-meeorological relaions are added ino he CG as weighed edges in Secion 3

2 Asynchronous Sensing Sysem We esablish a wireless sensor nework sysem for finegrained air qualiy monioring For power efficiency, he deployed IoT sensors are programmed o asynchronously monior AQI (mainly PM 5 values) unil he baeries are dead The IoT sensors have been deployed in he campus of Peking Universiy since Feb 08 Each sensor uploads he AQI, he locaion and he ime afer monioring [] In addiion, weaher condiions are colleced from he websie of China Meeorological Adminisraion [] All feaures are preprocessed before being applied Correlaion Graph for Asynchronous Daa Labelled Node Subgraph Subgraph Unlabelled Node POI wihou sensor Fig : An illusraion of he Correlaion Graph No labelled nodes in he fuure Curren ime slo POI wih sensor Weighed Edge There are oally a number of M air qualiy sensors, denoed as {S,, S m,, S M } Each sensor has a fixed 3D spaial coordinae (x m, y m, z m ) For fine-grained consideraion, here are L POIs in concerned areas and we need o know he AQIs of he POIs, where M < L Due o he limied number of he available sensors, he AQIs of he POIs wihou he sensors need o be esimaed Since he sensors monior daa asynchronously, we divide he sysem ino shor equal-lengh ime slos, where each daa can be considered as colleced in a specific ime slo The colleced daa herefore could be very sparse, because only a small proporion of he sensors collec and upload daa a any cerain ime slo A ime, we consruc correlaion graph G o illusrae he sae of he sysem G has muliple subgraphs, denoed as {G } Each subgraph G conains L nodes, where each node implies he colleced value or he esimaed value of a specific POI a ime The node is labeled if he corresponding daa is colleced by he sensor, oherwise, he node is unlabeled The ses of he labeled and unlabeled nodes are given by L and U respecively Each labeled node vn is combined wih a measured value denoed as c n For each G, we only consider limied number of subgraphs, given by {G T h,, G +T f }, where T h is he number of concerned hisorical subgraphs from curren ime and T f is he number of concerned fuure subgraphs from curren ime Therefore, he oal number of he nodes in G is N = (T h + T f + ) L The se of all he nodes is denoed as V = {v,, v n, v N } = L U We define he real-ime fine-grained predicion as F = [F,, F n,, F N ]T, where F n denoes he inferred value for node v n a ime 3 Feaure Relaions in Correlaion Graph Any of wo nodes are conneced by an edge The weigh of he edge depends on he spaial-emporal relaion of he wo nodes, as well as he weaher condiions of he corresponding ime slos The weighed feaure vecor: We firs define he spaialemporal-meeorological feaure vecor of node v n as q n = [ q n,,, q n,k,, q n,k] T, () where K is he number of feaures and qn,k is he k-h feaure of vn The feaure vecor qn conains he spaial coordinaes, he emporal coordinae of vn, and he meeorological condiions, including weaher ypes, wind speeds, wind direcions, emperaure and humidiy a ime slo Due o he fac ha differen elemens in qn may have differen impacs on he relaions beween wo nodes, we inroduce a weigh vecor β = [β,, β k,, β K ] T, where β k (0, ), k {,,, K} and β = K i= β k = K i= β k = Then he weighed feaure vecor fn =[fn,,, fn,k,, f n,k ]T of node vn is expressed as f n = q n β = [ q n,β,, q n,kβ k,, q n,kβ K ] T, () where denoes hadamard produc Similariy of wo nodes: We define he adjused cosine similariy m ij beween v i, v j, which is given by m fi ij = f, f j f, (3) fi f f j f where f denoes he mean values of he weighed feaures The weigh on each edge: For each node, is k-neares neighbors are defined as he nodes ha have he op k highes similariy wih his cerain node If node vj is one of v i s k- neares neighbors or vi is one of v j s k-neares neighbors, we define he weigh of he edge beween vi, v j as wij = ) (α anh (m ij α ) +, () where he parameer α (α > 0) magnifies he differences of similariies and he parameer α (, ) is a cuoff value wij is in (0, ) since i is a monoone funcion and m ij ranges from o If node v i, v j are no one of he k- neares neighbors of each oher, he weigh wij beween hem is se o 0 o reduce he influence by dissimilar nodes and o improve compuing efficiency I is worh sressing ha vi is no a neighbor of iself and we simply se wii = 0, v i V Furher, a real symmeric weigh marix W can hen be given by W = [W ] T = [ ] wij In addiion, he degree N N d n of node vn is given by d n = N i= w in = N i= w ni

3 3 PREDICTION PROCEDURES DESIGN Afer receiving he monioring daa a ime slo, he predicion sysem immediaely execues a round of ieraion in order o obain he real-ime predicion F, by using he hisory predicion F and he measured daa {c n} for he labeled nodes This includes wo procedures, namely he preparaion procedure and he esimaion procedure, as shown in Fig G - 3 G - G - - G - - μ+ μ μ- μ- LSTM 3 Measuremens from Sensors Minimize Loss Funcion G + G G - F - Preparaion Y Esimaion F Procedure Procedure Concerned Subgraphs Unconcerned Subgraphs Node Generae Y for labeled nodes Generae Y in he newes subgraph Generae Y for old unlabeled nodes Generae Fig : An illusraion of he predicion procedure, where, and 3 show he preparaion procedure o obain he pre-esimaion vecor Y, and shows he esimaion procedure o obain he final esimaion resul F 3 Preparaion Procedure Based on G and F for he las ime slo, and he measured values {c n} a he curren ime slo, we firs consruc a pre-esimaion vecor for he curren ime, given by Y = [Y,, Yn,, YN ]T Y only shows he rough values of he nodes in G and needs o be refined in he subsequen esimaion procedure For he labeled nodes: We se Yn = c n for node vn For he unlabeled nodes no in he newly-added subgraph: When i comes o he -h ime slo, G is generaed by removing he oldes subgraph and adding a new subgraph for ime +T f The unlabeled nodes no in he newly-added subgraph have been esimaed in he las-ime predicion Therefore, for he node vn in hese subgraphs, we se Yn he same o he las-ime esimaed value F (Suppose he n-h node n in G is he n -h node in G ) For he unlabeled nodes in he newly-added subgraph: An LSTM [3] nework is used o deermine heir pre-esimaed values Specifically, he mean value µ τ for each monioring ime slo τ is calculaed firs o represen he coarse-grained esimaion, given by µ τ = F τ, τ =,,, +T f, (5) where F τ denoes he average of he las-ime esimaed values for ime slo τ Wih he meeorological feaures and a series of he coarse-grained esimaions as he raining daase, an LSTM nework can be rained in advance and can be immediaely used o predic he coarse-grained esimaion µ +Tf in he newly-added subgraph Finally, we se µ +Tf as he pre-esimaions for all he nodes in G +T f To sum up, he pre-esimaion is given by G c n, vn L, Yn = F n µ +Tf, v n U and vn G +T f, vn G +T f The seps,, and 3 in Fig illusrae he hree kinds of assignmens in (6) respecively 3 Esimaion Procedure Based on he pre-esimaed values in Y, we need o calculae more precise predicion values in F 3 Minimizing he loss funcion Two aspecs are concerned when calculaing F The firs one is smoohness, implying ha wo closely relaed nodes (wih a high weigh edge beween hem) need o have similar values The second one is reliabiliy, indicaing ha he final esimaion and he pre-esimaion should be as same as possible, given by F Y Combining smoohness and reliabiliy, we design he loss funcion wih he help of [], given by: L (F ț β)= v i,v j V w ij ( F di F j i d j ) +λ v i V (6) ( F i Y i ), (7) where λ is he balanced parameer The firs erm on he righ side in (7) is he smoohness erm Insead of using he differences of he funcion values on he wo neighboring nodes direcly, we regularize each funcion value Fi wih he corresponding normalized coefficien / d i The second erm on he righ side in (7) is he reliabiliy erm I is worhy o noe ha β does no need o be updaed frequenly, since he weighs of differen feaures are supposed o be sable in a shor ime Our objecive is o minimize he average of he loss funcions in T, given by arg min β,{f } L (β, F ), T s β =, β k > 0, β k {,, K}, where T represens a se of he hisory monioring ime slos Noe ha he ieraive uilizaion of he esimaed unlabeled nodes for each nex round forms a semi-supervised learning approach The minimizaion problem in (8) can be divided ino wo opimizaion sub-problems Supposing ha β is fixed, he firs sub-problem is given by L (β) = min F L (F, β) (9) Correspondingly, he second sub-problem is given by arg min β L (β), T s β =, β k > 0, β k {,, K} (8) (0) 3 Soluion o sub-problem (9) L (F, β) in (7) is a convex funcion when β is given We differeniae L wih respec o F and se i o 0, given by L F = [ L F, L F,, L FN ] T = 0 T ()

4 Afer derivaion, he final soluion of F is given as F = λ ( I ) + λ + λ (D ) W (D ) Y, () where (D ) = diag(/ d,, / d N ) I is noeworhy ha once β is figured ou, we can direcly obain he real-ime fine-grained predicion according o () 33 Soluion o sub-problem (0) The value of β is obained by he following geneic algorihm based on long-erm weaher condiions and he measured air qualiy daa Each individual P(n) in he generaion se P represens a rial soluion o (0) and we encode i o a series of binary digis P(n) = (s n, s n,, s n K R ) as is genoype, where R denoes he encoding lengh of each elemen in β and K is he number of feaures Therefore, K R denoes he oal lengh of an individual s genoype The geneic algorihm is specified as follows Crossover: For any wo individuals in he old generaion, crossover can be performed wih a fixed probabiliy p c o produce new individuals To be specific, for individuals P(i) and P(j), we randomly choose a posiion p =, 3,, K R and hen he genoypes for he new individuals are denoed as P(i ) =(s i,, s i p, s j p,, s j K R ) and ) = P(j (s j,, sj p, si p,, s i K R ) afer crossover Muaion: Each binary digi in he old generaion afer crossover remains he same in mos of ime and alers o he opposie wih a fixed probabiliy p m Selecion: The finess value for each individual in he old generaion is given by z ( P(n) ) = / ( ) L (β), P(n) P (3) T The new generaion is chosen from he individuals afer crossover and muaion according o heir survival probabiliies where he survival probabiliy for each individual is in proporion o is finess value Evoluion Overview: Crossover and muaion are firs performed o creae new individuals in he old generaion To saisfy he consrain β = for he new individuals, we normalize hem and i is easy o prove ha he finess values won change afer normalizaion The new generaion is hen produced by he selecion procedure wih consraining he size of he new generaion equals o he size of he old one The geneic algorihm is erminaed when a beer individual hasn appeared in he laes E generaions Parameer Seup EVALUATION In asynchronous sensing, he probabiliy of each sensor deecing daa a each ime slo is simply se o /5 o illusrae he mos general case The oher parameers are lised in Table Since I +λ (D ) W (D ) 0, he marix is inverible Table : Parameer Seup Number of nodes in one subgraph L 60 Number of sensors in one subgraph M beween 5 o 30 Similariy parameers α and α 0 and 0 Number of hisory subgraphs T h beween 3 o 8 Number of fuure subgraphs T f beween o 7 Encoding lengh R 0 Parameer k in k-nn 00 Trade-off parameer λ 03 Crossover probabiliy p c 06 Muaion probabiliy p m 005 Terminaion condiions E 500 Lengh of each ime slo 5 minues Simulaion Resuls and Discussions In Fig 3(a), we se M = 30 and compare he performances when he numbers of he hisory/fuure subgraphs change, where he performances are indicaed by average relaive predicion errors The resuls indicae ha he appropriae numbers of he hisory/fuure subgraphs lead o a beer performance For he hisory subgraphs, G may lack hisory informaion when T h is oo small, and G will conain worhless informaion if T h is oo big For he fuure subgraphs, G may have insufficien meeorological condiions in he near fuure when T f is oo small, and G will conain relaively few labeled nodes if T f is oo big (a) Influence of he number of hisory/fuure subgraphs 0 Number of hisorical ime slos T h =3 8 Number of hisorical ime slos T h =5 Average Relaive Error (%) Number of hisorical ime slos T h = Number of fuure ime slos, T f Average Relaive Error (%) (b) Influence of he number of sensors Our proposed mehod MLP IDW Number of Sensors, M Fig 3: The performance of he proposed soluion wih respec o differen seings In Fig 3(b), we compare he performances of differen approaches, including Muli-layer percepion (MLP), Inverse disance weighing inerpolaion [0], and he proposed CG Model (wih T h = 5, T f = 3) A significan performance gain of our soluion can be observed, and he average relaive error can be reduced o 5% when here are enough sensors 5 CONCLUSION In his paper, we modeled he asynchronous air qualiy daa and heir spaial-emporal-meeorological relaions by using he weighed CG A novel real-ime fine-grained predicion mehod was proposed based on he sparse daase Simulaion resuls show ha he size of he CG should no be oo big or oo small The proposed scheme reduces he error o 5% (wih T h = 5, T f = 3, M = 30) while he error of MLP is abou 9% in asynchronous sensing siuaion

5 6 REFERENCES [] World Healh Organizaion e al, 7 Million Premaure Deahs Annually Linked o Air Polluion, World Healh Organizaion, Geneva, Swizerland, Mar 0 [] Beijing memc (jul 08) Beijing Municipal Environmenal Monioring cener [Online] Available: hp://wwwbjmemccomcn/ [3] T N Quang, C He, L Morawska, L D Knibbs, and M Falk, Verical Paricle Concenraion Profiles Around Urban Office Buildings, Amospheric Chemisry and Physics, vol, no, pp , May 0 [] Meeorological condiions provided by China Meeorological Adminisraion [Online] Available: hp://daacmacn [3] F A Gers, J Schmidhuber, and F Cummins, Learning o Forge: Coninual Predicion wih LSTM, 999 [] D Zhou, O Bousque, T N Lal, J Weson, and B Schölkopf, Learning wih Local and Global Consisency, in Proc Advances in neural informaion processing sysems, Vancouver, Briish, Dec 00 [] Y Hu, G Dai, J Fan, Y Wu and H Zhang, ąřblueaer: a fine-grained urban PM5 3D monioring sysem using mobile sensing,ąś in Proc IEEE INFOCOM, San Francisco, CA, Jul 06 [5] C J Huang and P H Kuo, A Deep CNN-LSTM Model for Pariculae Maer (PM5) Forecasing in Smar Ciies, Sensors, vol 8, no 7, pp 0, Jul 08 [6] I G McKendry, Evaluaion of Arificial Neural Neworks for Fine Pariculae Polluion (PM0 and PM5 Forecasing, Journal of he Air & Wase Managemen Associaion, vol 5, no 9, pp 096 0, 00 [7] J Gubbi, R Buyya, S Marusic, and M Palaniswami, Inerne of Things (IoT): A Vision, Archiecural Elemens, and Fuure Direcions, Fuure Generaion Compuer Sysems, vol 9, no 7, pp , Sep 03 [8] G B Fioccola, R Sommese, I Tufano, R Canonico, and G Venre, Polluino: An Efficien Cloud-based Managemen of IoT Devices for Air Qualiy Monioring, in Proc IEEE Research and Technologies for Sociey and Indusry Leveraging a beer omorrow, pp 6, Sep 06 [9] Z Hu, Z Bai, K Bian, T Wang, and L Song, Realime Fine-grained Air Qualiy Sensing Neworks in Smar Ciy: Design, Implemenaion and Opimizaion, arxiv preprin arxiv:80085, Oc 08 [0] L Li, T Losser, C Yorke, and R Pilner, Fas Inverse Disance Weighing-based Spaioemporal Inerpolaion: A Web-based Applicaion of Inerpolaing Daily Fine Pariculae Maer PM5 in he Coniguous US Using Parallel Programming and k-d Tree, Inernaional Journal of Environmenal Research and Public Healh, vol, no 9, pp 90 9, Sep 0 [] Daase colleced by our air qualiy monioring sysem [Online] Available: hps://gihubcom/pkubzx/pku-air