VECTOR QUANTIZATION, GRAPH THEORY, AND IMRT DESIGN

Size: px
Start display at page:

Download "VECTOR QUANTIZATION, GRAPH THEORY, AND IMRT DESIGN"

Transcription

1 VECTOR QUANTIZATION, GRAPH THEORY, AND IMRT DESIGN JOSHUA G. REESE Abstract. Vector quantzaton s an mportant concept n the feld of nformaton theory and codng theory. The p-medan problem s a classc graph theory problem wth natural extensons to operatons research faclty locaton problems. We nvestgate some prevously unrecognzed connectons between these problems, and ultmately show that the problem of desgnng an optmal vector quantzer on a dscrete set X s closely related to solvng the p-medan problem on a graph G = (X, E). We also demonstrate how vector quantzaton and ts connecton to the p-medan problem have mportant applcatons n radotherapy treatment desgn, specfcally n the IMRT beam selecton problem. 1. Introducton Claude E. Shannon lad the groundwork of vector quantzaton (VQ) by assumng the exstence of a dstorton measure that would quantfy the dfference n qualty between an nput and a coded reproducton. He worked on VQ under the guse of source codng subject to a fdelty crteron [3]. The p-medan problem s a classc graph theory problem wth natural extensons n operatons research to problems such as the faclty locaton problem. Ths problem nvolves locatng p facltes on a graph so that the sum of the weghted dstances from the vertces of the graph to ther nearest faclty s mnmzed [1]. We begn by defnng and descrbng these concepts n detal, and then we note some prevously unrecognzed connectons between them. We then apply VQ, the p-medan problem, and the connectons between them to the problem of desgnng a feasble radotherapy treatment desgn. A crtcal radotherapy desgn queston s how to choose a collecton of angles from whch to emt radaton nto the tumor. It s mportant that these angles satsfy clncal restrctons and constrants on the amount of radaton deposted n dfferent areas of the body. We show that vector quantzaton and the p-medan problem are mportant tools for solvng ths problem, and conclude by ntroducng some new avenues of research that our results present. 2. Vector Quantzaton 2.1. Basc Defntons. The materal n ths secton s treated exhaustvely n [3], and nterested readers are drected to ths text. Vector quantzaton s a process for codng contnuous or dscrete vector sgnals subject to a fdelty crteron. It s often used to compress mages or other data. Date: Aprl 27, Key words and phrases. Graph Theory, p-medan, Vector Quantzaton, Radotherapy. Specal thanks to Dr. Allen Holder, Department of Mathematcs, Trnty Unversty. 1

2 2 JOSHUA G. REESE A vector quantzer Q maps vectors from an nput set of vectors X nto a fnte set C (called the codebook) contanng N output ponts (called codevectors or codewords). Thus, Q : X C, where C = {y 1, y 2,..., y N } and y X for each J = {1, 2,..., N}. The vector quantzer separates X nto N dstnct regons called cells, denoted X for J, and defned as X = {x X Q(x) = y }. These cells are dsjont and together nclude all elements of the nput set. Thus we have, X = X and X Xj = for j. So, these ndvdual cells form a partton of X, defned as P Q = {X J }. The basc operaton of a vector quantzer s to partton an nput set of vectors nto partton cells and select a codevector from each cell to serve as a representatve for all of the vectors wthn that cell. Thus, vector quantzers may be separated nto two separate processes, known as the encoder E and decoder D. The encoder s job s to examne each nput vector and to determne whch partton cell t should belong to. Thus, the encoder maps elements from X nto the set J, whch contans ndces of the cells of X. The decoder then chooses a vector from each numbered cell to serve as the codevector for that regon. Thus, the decoder maps elements from J nto the codebook C. We have, E : X J and D : J C. As an example, let X be a fnte set of ponts on a cty map. These ponts could be houses, schools, busnesses, or any other locaton wthn the cty. Consder an encoder that maps chldren s houses nto partton cells, or school dstrcts, each represented by a school dstrct number. These school dstrcts are dsjont subsets of X. The decoder then maps the ndex number of a partcular school dstrct to a locaton wthn that dstrct representng the locaton of the school. Dependng on the desgn of the decoder, the quantzer mght choose a locaton that already has a house, school or busness bult on t, or t could choose an unused locaton Representng VQ Wth Bnary Selector Functons. We represent the operaton of the encoder n terms of selector functons S (x), defned as bnary functons that ndcate whether a vector x s n a gven cell X. Thus, { 1 f x X S (x) = 0 otherwse. Snce the decoder creates a codebook by selectng a codevector from each cell X, t s possble to create a selector functon that descrbes the entre operaton of the quantzer, as follows: { 1 f xj s quantzed as x λ j = 0 otherwse. Notce that the codebook s: C = {x λ = 1}.

3 VECTOR QUANTIZATION, GRAPH THEORY, AND IMRT DESIGN Vector Quantzer Performance. We quantfy the nonnegatve cost of quantzng any nput vector x X wth the codevector Q(x) by measurng dstorton, denoted by d(x, Q(x)). The most common measurement of dstorton between vectors s the Eucldean dstance, d(x, Q(x)) = x Q(x). The methods of quantfyng dstorton are numerous, however, and often depend on the partcular applcaton of VQ. For now we wll smply assume that d(x, Q(x)) s a dstorton metrc meanngful to ts applcaton. We use ths dstorton measure to determne the overall performance of the vector quantzer. Vector quantzaton s nherently a statstcal problem. One of ts orgnal uses was analog to dgtal sgnal converson. For ths reason, vector quantzers were, and stll are, desgned so that even though the nput sgnal s not prevously known, a sutable measure of expected dstorton may be obtaned. In order to work towards ths measure of expected dstorton, we frst state the followng defnton. Defnton 2.1. A functon f X defned on X s called a jont probablty densty functon (pdf) f f X (x) 0, x X, x X f X (x)dx = 1, where the ntegral s taken to be a multple ntegral over the k-dmensonal space. In the school dstrct example, f X corresponds to the set of ponts on a map, f X (x) s the probablty that a locaton x s a house wth school-age chldren. There are many dfferent factors that may determne probablty, dependng on the partcular applcaton of VQ. If we model the quantzer as a random process, ts performance corresponds to ts expected dstorton, whch by defnton s D Q = Ed(x, Q(x)) = d(x, Q(x))f X (x)dx, where f X (x) s a jont probablty densty functon (pdf) of the nput vector space X. Here we are evaluatng a statstcal average of the dstorton measure over the entre nput vector space. Ths measure s called the average dstorton of the vector quantzer. If the nput set of vectors has a dscrete dstrbuton (as opposed to a contnuous dstrbuton), then we have D Q = Ed(x, Q(x)) = f X (x )d(x, Q(x )), where each x s a value n X that has nonzero probablty. In terms of the selector functon descrbed n Secton 2.2, D Q = f X (x j )d(x, x j )λ j, (2.1) j where λ j = 1 f and only f Q(x j ) = x.

4 4 JOSHUA G. REESE 2.4. Optmal Vector Quantzer Desgn. The vector quantzer desgn problem s: Fnd a codebook C specfyng the decoder D and a partton P Q specfyng the encoder E such that the average dstorton D Q s mnmzed. If we fnd such a codebook and partton, then the resultng encoder E and decoder D produce a globally optmal quantzer. We now state three condtons that lead to algorthms for codebook mprovement. These condtons are often called the necessary condtons for optmal vector quantzers. See [3] for more detals and proofs of the followng condtons. (1) Partton Condton. Gven a codebook C, a partton s optmal f and only f t assgns vectors to the codevectors y n a nearest neghbor fashon,.e., Q(x) = y d(x, y ) d(x, y j ) j J. In other words, gven a fxed codebook, t s both necessary and suffcent for optmalty that the partton satsfy the Partton Condton. (2) Codebook Condton. Gven a partton P Q, a codebook s optmal f and only f t mnmzes the dstorton between vectors x X and the codevectors y, averaged over the probablty dstrbuton of x gven that x les n X. Hence, E[d(x, y ) x X ] E[d(x, y) x X ] for all y X. Ths condton s farly ntutve, as t ensures that each codevector mnmzes the expected dstorton over ts respectve partton cell. Ths condton s both necessary and suffcent for producng an optmal codebook, gven a fxed partton. (3) Boundary Condton. Let B = {x d(x, y ) = d(x, y j ) for some j} be the boundary ponts of the gven partton. These ponts are equdstant from two codevectors and hence do not have a unque nearest neghbor. An optmal codebook for a gven source dstrbuton must assgn these ponts to one and only one partton cell. In order to practcally ensure that ths condton holds, an effectve te-breakng scheme must be mplemented when desgnng the encoder. Returnng to the school dstrct example, the frst condton ensures that an optmal partton, or school dstrct plan, s one n whch the houses are closer to that dstrct s school than any other school. Lkewse, the second condton guarantees that an optmal set of school locatons gven a set of school dstrcts s one n whch the schools mnmze dstorton, averaged over the probablty dstrbuton, between the school and each house n a gven dstrct. The thrd condton ensures that no house les wthn two school dstrcts at the same tme Lloyd Algorthm. The Lloyd algorthm s useful for desgnng an effectve quantzer. It s based on the fact that the Partton Condton and Codebook Condton allow us to obtan an optmal codebook gven a fxed partton, and an optmal partton gven a fxed codebook. The algorthm requres an ntal, dscrete set of vectors called the tranng set. If the set we are tryng to quantze s dscrete, then we may smply apply the Lloyd Algorthm to ths set. If t s contnuous, then we select a set of observatons from t and use these as the tranng set for the Lloyd Algorthm. The algorthm begns wth an ntal codebook, and at every teraton

5 VECTOR QUANTIZATION, GRAPH THEORY, AND IMRT DESIGN 5 produces a new codebook that s guaranteed to ether reduce or leave unchanged the overall dstorton D. The algorthm s a three step process, as follows: Lloyd Algorthm (1) Set m = 1. Begn wth an ntal codebook C 1. (2) (The Lloyd Iteraton) Gven the codebook C m, create partton cells by usng the Partton Condton as follows: R = {v d(v, y ) < d(v, y j ), j }. If d(v, y ) = d(v, y j ) for any j, then break the te by assgnng v to the cell R j for whch j s smallest, thus satsfyng the Boundary Condton. Usng the Codebook Condton, we create a new codebook C m+1, whch s optmal for the partton P m = {R 1 N}. (3) Compute D, the average dstorton for C m+1, and f t has decreased less than δ, stop. Otherwse, set m + 1 m and go to step 2. Theorem 2.2 (Gersho and Gray [3]). Each applcaton of the Lloyd Iteraton reduces or leaves unchanged the average dstorton. Proof. From the necessary condtons for optmalty, the Partton Condton mples that the frst part of the Lloyd Iteraton can only mprove or leave unchanged the encoder for the gven decoder. Smlarly, the Codebook Condton mples that the second part can only mprove or leave unchanged the decoder for the gven encoder. Hence, the average dstorton of the vector quantzer cannot ncrease. Theorem 2.3 (Gersho and Gray [3]). For a fnte tranng set, the Lloyd Algorthm always produces a sequence of vector quantzers whose average dstortons converges n a fnte number of teratons. Proof. There are a fnte number of ways to partton the nput set nto N subsets. For each partton, the Codebook Condton yelds a codebook wth a partcular value of average dstorton. The monotone nonncreasng average dstorton mples that the algorthm cannot return n subsequent teratons to a partton yeldng a hgher average dstorton. Hence, the average dstorton of the sequence of vector quantzers produced must converge to a fxed value n a fnte number of steps. 3. Graph Theory and Desgnng Optmal VQ Codebooks 3.1. Introducton. The p-medan problem has long been useful n solvng operatons research problems dealng wth faclty locaton. The problem s to choose a p-element subset of a graph such that the weghted sum of the dstances between the vertces of the graph and ther nearest element n the subset s mnmzed [1] P-Medan Problem. Let G = (X, E) be a complete, weghted and undrected graph, where X s the set of vertces and E s the set of edges. Let d j = [d(x, x j )] be the shortest dstance matrx where the entry n the th row and jth column contans the shortest dstance between vertces x and x j, accordng to some metrc

6 6 JOSHUA G. REESE d. Let w(x ) be the vertex weghts. In the faclty locaton problem, these are the costs of satsfyng the demand at each vertex x. Let ξ j be an allocaton varable such that { 1 f vertex xj s allocated to vertex x ξ j = 0 otherwse. The nteger optmzaton formulaton of the p-medan problem s: mn w(x j )d j ξ j j subject to: ξ j = 1 for j = 1,..., n ξ j ξ ξ = p, j = 1,..., n ξ j {0, 1}. (3.1) The constrant ξ j = 1 for j = 1,..., n ensures that each vertex s allocated to one and only one element n the p-element subset. The second constrant, ξ = p, guarantees that there are p vertces allocated to themselves, whch forces the cardnalty of the p-medan subset to be p. The last two constrants ensure that the allocaton varables are ether 0 or 1. If ξj s an optmal answer to the problem defned by (3.1), then the p-medans are the elements of: X p = {x ξ = 1} Usng the P-Medan Problem to Desgn Optmal VQ Codebooks. The followng theorem shows an mportant connecton between VQ and the p- medan problem n that we may desgn an optmal VQ codebook by solvng a partcular p-medan problem for a fxed p > 0. Theorem 3.1. Let X be a fnte set of vectors. Let f X (x) be a pdf of X, and d(x, x j ) be a metrc on X. An optmal vector quantzer Q : X C, C = p, may be found by solvng the p-medan problem on the graph G = (X, E) wth vertex weghts f X (x), obtanng an optmal soluton X p = C, where C s the optmal codebook for Q. Proof. Let w(x j ) = f X (x j ), j, and let d j = [d(x, x j )]. Then by solvng (3.1), we obtan [ξ j ] such that f X (x j )d(x, x j )ξ j j s mnmzed. The constrant ξ j = 1 for j = 1,..., n corresponds to the Boundary Condton for vector quantzers and ensures that each vertex s allocated to one and only one element n the p-element subset (codebook). The constrant ξ = p ensures that the number of outputs s p,.e. X p = C = p. The last two constrants guarantee that the allocaton varables, whch correspond to the selector functons λ j n VQ, are ether 0 or 1. Then, f λ j = ξ j, we have that the average dstorton of the quantzer gven by (2.1) s mnmzed. We conclude that C = {x λ = 1} = X p = {x ξ = 1} s an optmal codebook for Q.

7 VECTOR QUANTIZATION, GRAPH THEORY, AND IMRT DESIGN Soluton Technques. Karv and Hakm [6] showed that the problem of fndng a p-medan on a graph s NP-hard n p and n, even when the graph s planar, has maxmum vertex degree 3, and all of the edges have length 1 and all vertex weghts are 1. Polynomal algorthms exst, however, for the case when p s fxed. Theorem 3.2. Let n = X. The worst-case complexty of the p-medan problem on G = (X, E) for a fxed p N s O(pn p+1 ). Proof. Before the algorthm begns, a shortest path dstance matrx s created usng Djkestra s algorthm, contanng the shortest weghted dstances between all vertces of the graph. The complexty of ths step s O(n 2 ) [1]. The search then proceeds through every p-element subset of X, requrng ( ) n n p p calculatons. For each p-element subset of X, we must compare every x X to the p elements of the subset, to satsfy the nearest neghbor condton. Ths requres pn calculatons. So, the overall complexty s no greater than O(n 2 + (pn)n p ) = O(pn p+1 ). Gven Theorems 3.1 and 3.2, the followng corollary becomes apparent: Corollary 3.3. The problem of desgnng an optmal quantzer on a dscrete set of data s polynomal. 4. Applcatons n Radotherapy Treatment Desgn 4.1. Introducton. Intensty Modulated Radotherapy Treatment (IMRT) s a method of cancer treatment that drects onzng beams of radaton through the anatomy and nto a tumorous regon. The goals of IMRT are to 1) drect a unform amount of radaton nto the tumor and 2) lmt the amount of radaton that deposts n nearby crtcal and normal healthy tssues. The tumor should receve enough radaton to kll the cancer cells, and the crtcal structures should receve no more than a prevously specfed amount of radaton n order to reduce damage [4]. The radaton deposted per unt mass of tssue s called absorbed dose and s measured n Gray (Gy), whch s equal to one Joule of energy deposted per klogram [5] Theraputc Advantage. Cancer cells are nnately focused on reproducng and lack the effectve capablty to repar themselves. Consequently, cancer cells are klled when ther DNA s damaged, whle healthy cells are able to contnue reproducng after mnor damage by rradaton [2]. The dfference between the radaton tolerance of cancer and normal cells s called the therapeutc advantage. IMRT treatments take advantage of ths therapeutc advantage by delverng the full dose prescrbed to the tumor n smaller daly doses [5]. Ths method of treatment klls the tumor cells, but gves enough tme between doses for the normal tssue to heal. It also allows the dead cancer cells to be carred away by the healthy tssue around the tumor, preventng a collecton of dead tssue where the tumor was located.

8 8 JOSHUA G. REESE 4.3. IMRT Treatment Method. Before the treatment takes place, physcans use a seres of sequental CT scans to obtan a 3D representaton of the tumor and any nearby crtcal structures. Physcans then ndcate on each CT scan the locaton of these structures, and the remanng tssue s labeled as normal tssue. The prescrpton s then specfed by the followng varables [4]: T LB The lower bound for absorbed dose n the tumor. T UB The upper bound for absorbed dose n the tumor. CUB The upper bound for absorbed dose n the crtcal structures. NUB The upper bound for absorbed dose n the normal tssue. Each crtcal structure s assgned a dfferent upper bound that vares wth the structure type and s determned by the susceptblty and severty of damage to that structure. For nstance, a sgnfcant amount of damage to the spnal cord may result n paralyss or loss of crtcal body functons. Therefore, the tolerance assgned to the spnal cord s comparatvely lower than most other structures [5]. After the physcans determne an IMRT plan that meets the constrants of the prescrpton, the patent s lad on a couch and mmoblzed. The devce that emts the radaton s called a lnear accelerator, or LINAC. The LINAC s mounted on a movable arm, called the gantry, that s able to make a complete 360 degree rotaton around the patent. Ths allows physcans to delver varyng radaton doses from any partcular collecton of angles. The gantry rotates around a pont called the socenter, and patents are postoned so that the socenter s located n the mddle of the tumor. LINACs are usually equpped wth a multleaf collmator, a devce wth pneumatc leaves that move back and forth to block portons of the radaton beam. The multleaf collmator allows the beam to be shaped, thereby parttonng each of the 360 angles nto sub-beams, also known as pencl beams [5] Optmal IMRT Plan Desgn. The followng s a bref dscusson of the constructon of an IMRT plan. See [2], [4] and [5] for further detals. There are three separate problems to solve when desgnng an IMRT plan. They are 1) determnng whch angles should be used to focus radaton on the patent, 2) fndng a fluency pattern (a collecton of exposure tmes) correspondng to these angles, and 3) choosng a delvery sequence that effcently admnsters ths treatment [2]. Ths paper nvestgates the frst problem, whch s known as the beam selecton problem. Lnear programs are often used to determne optmal treatments, consstng of fluency values, or radaton exposure tmes, for each angle and sub-beam. Together these values defne the fluency vector x, where x (a,) s the exposure tme for the th sub-beam of angle a, for a A = {π/180 o = 0, 1, 2,..., 359}. The dose matrx A s an approxmaton of how radaton s deposted nto each dose pont n the anatomy. The unts of A are Gy per unt tme. The lnear transformaton x Ax maps the fluency vector nto the anatomy and determnes the amount of radaton deposted at every dose pont n the anatomy [2]. The lnearty s not just an assumpton of the model t s expermentally valdated that the dose s deposted lnearly [5]. We partton A nto full-column sub-matrces A T, A C and A N, contanng the dose ponts correspondng to the tumor, crtcal structures and normal tssue, respectvely. There are several lnear programs n the lterature for producng optmal IMRT plans, and the followng s an example:

9 VECTOR QUANTIZATION, GRAPH THEORY, AND IMRT DESIGN 9 mn{ω l T α + u T Cβ + u T Nγ} subject to: T LB Lα A T x T UB A C x CUB + U C β A N x NUB + U N γ 0 Lα T LB CUB U C β 0 U N γ 0 x, where ω s a weght determnng the mportance of meetng the lower bound on the tumor. The frst three constrants are elastc and are allowed to vary wth α, β and γ, respectvely. These vectors represent how much the model s allowed to volate the radaton constrants on the tumor, crtcal structures and normal tssue, respectvely. The matrces L, U C, and U N defne how elastcty s measured, and each corresponds wth a respectve vector, l, u C and u N that decdes how dscrepances are penalzed. The decson values are x, α, β and γ [4]. Ths model has been mplemented n a prototype treatment package named Radotherapy OptmAl Desgn (RAD). RAD allows users to delneate a tumor, crtcal structures, and normal tssue on a 64 x 64 grd (smlar to how a physcan would ndcate these structures on a CT scan). One can then assgn prescrpton values to these structures and solve for the optmal plan correspondng to that problem nstance [4] IMRT Beam Selecton Problem. Unfortunately, delverng a treatment from all 360 gantry angles s not clncally feasble. Current clncal constrants requre that IMRT treatments consst of 7-9 gantry angles from whch to delver radaton. Ths s prmarly because physcans lmt the treatment tme n order to reduce patent movement, whch may result n treatment error. Thus, the beam selecton problem s how to select p angles so that the subsequent p-angle treatment s effectve. Solvng nteger programs desgned to choose p angles exceeds calculaton capabltes. An alternatve strategy s to begn wth an optmal treatment lke the one descrbed above and strategcally prune angles to form an effectve and clncally feasble treatment. In the next secton we dscuss how an optmal vector quantzer addresses ths problem. 5. Optmal VQ and IMRT Treatment Desgn 5.1. Characterstc Vectors. We defne a k-dmensonal characterstc vector c a for a gven angle a as c a = (g 1 (a), g 2 (a),..., g k (a)), where g : A R, A = {π/180 o = 0, 1, 2,..., 359}. The components g (a) are dfferent statstcs or characterstcs of the angle a as t s used n the optmal 360 degree plan. We measure c a by a norm c a, and ths norm nduces the metrc: d(a, a j )) = c a c aj. Usng the characterstc vectors allows us to measure an angle s effectveness wth respect to a wde varety of user-defned statstcs, ncludng statstcs on what the apparent effect each angle has on the qualty of treatment. Angle locaton s perhaps the most obvous characterstc of a gven angle. Prelmnary efforts at ncorporatng

10 10 JOSHUA G. REESE VQ and IMRT have met wth some success n usng a pure angle dstance metrc [2]. Ths yelds a one-dmensonal characterstc vector, whch contans angle locaton,.e. c a = (πa/180 o ). The method presented here allows us to ncorporate numerous other factors, ncludng how each angle contrbutes to the overall prescrpton and the absorbed dose wthn the anatomy. If we let X be a set of characterstc vectors, then usng VQ on X allows us to 1) group angles accordng to how smlar ther characterstcs are, and 2) to select a codebook of p characterstc vectors to represent X such that the average dstorton of dong so s mnmzed. Therefore, the angles that correspond to these characterstc vectors satsfy the objectve of the beam selecton problem. These angles may or not be truly optmal however, as ther optmalty depends on what statstcal data s present n the characterstc vectors. Hence, ths technque s smply a heurstc to solvng the overall problem Vector Quantzaton and the Beam Selecton Problem. We frst let f(a ) be a pdf that descrbes the statstcal characterstcs of the angles n the optmal 360 angle plan. Ultmately the process presented here s an attempt to solve a determnstc optmzaton problem va a statstcal technque. Ths fact places ths technque squarely n the realm of probablty modellng. The pdf should contan nformaton regardng the lkelhood of usng any gven angle. It s an open queston as to how to create an effectve pdf for ths problem, although there are several theores. One example s to calculate how much absorbed dose each ndvdual angle can delver to the tumor before volatng the constrants on the crtcal structures or normal tssue. Here we are measurng each angle s potental for treatng the tumor, and the assumpton s that the potental for a gven angle translates nto the probablty of that angle beng used. Untl further results are gathered we wll assume that f(a ) s an approprate pdf for ths partcular applcaton. Once we have an approprate pdf, we defne a quantzer Q : X C, where C = p, and C X. If we let w(c a ) = f(a ),, then by Theorem (3.1) we can fnd the optmal codebook C by solvng the p-medan problem on the graph G = (X, E). Furthermore, we have that ths codebook contans the characterstc vectors assocated wth the angles that are solutons to the beam selecton problem. Ths collecton of p angles s a soluton to the beam selecton problem n the sense that there exsts no other collecton of p angles that can be selected wth lower average dstorton (based upon the nformaton n the characterstc vector) of the orgnal 360 angle plan. 6. New Drectons Our results suggest new areas of research, and the followng questons should be nvestgated. What angle statstcs or characterstcs should be ncluded n the characterstc vector? How do we best select these characterstcs to accurately depct angle dfferences accordng to what s actually happenng n the anatomy? What s an approprate probablty densty functon for an optmal treatment consstng of 360 angles?

11 VECTOR QUANTIZATION, GRAPH THEORY, AND IMRT DESIGN 11 How may we reduce the complexty of solvng the p-medan problem, and what are ntellgent heurstcs? Can we use the p-medan problem to make statements about the Lloyd Algorthm? References [1] N. Chrstofdes. Graph Theory: An Algorthmc Approach. Academc Press, [2] M. Ehrgott and A. Holder. Beam selecton n radotherapy desgn. Unpublshed Draft, [3] A. Gersho and R. M. Gray. Vector Quantzaton and Sgnal Compresson. Kluwer Internatonal Seres n Engneerng and Computer Scence. Kluwer Academc Publshers, [4] A. Holder. Radotherapy treatment desgn and lnear programmng. In M. Brandeau, F. Sanfort, and W. Perskalla, edtors, Operatons Research and Health Care: A Handbook of Methods and Applcatons, chapter 29. Kluwer Academc Publshers, [5] A. Holder and B. Salter. A tutoral on radaton oncology and optmzaton. In H. Greenberg, edtor, Tutorals on Emergng Methodologes and Applcatons n Operatons Research, chapter 4. Kluwer Academc Publshers, [6] O. Karv and S. Hakm. An algorthmc approach to network locaton problems. : The p-medans. SIAM Journal on Appled Mathematcs, 37(3): , December Current address: One Trnty Place 1817, San Antono, Texas E-mal address: jreese@trnty.edu

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

NP-Completeness : Proofs

NP-Completeness : Proofs NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

= z 20 z n. (k 20) + 4 z k = 4

= z 20 z n. (k 20) + 4 z k = 4 Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals Smultaneous Optmzaton of Berth Allocaton, Quay Crane Assgnment and Quay Crane Schedulng Problems n Contaner Termnals Necat Aras, Yavuz Türkoğulları, Z. Caner Taşkın, Kuban Altınel Abstract In ths work,

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

Calculation of time complexity (3%)

Calculation of time complexity (3%) Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add

More information

Chapter 8 SCALAR QUANTIZATION

Chapter 8 SCALAR QUANTIZATION Outlne Chapter 8 SCALAR QUANTIZATION Yeuan-Kuen Lee [ CU, CSIE ] 8.1 Overvew 8. Introducton 8.4 Unform Quantzer 8.5 Adaptve Quantzaton 8.6 Nonunform Quantzaton 8.7 Entropy-Coded Quantzaton Ch 8 Scalar

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

DUE: WEDS FEB 21ST 2018

DUE: WEDS FEB 21ST 2018 HOMEWORK # 1: FINITE DIFFERENCES IN ONE DIMENSION DUE: WEDS FEB 21ST 2018 1. Theory Beam bendng s a classcal engneerng analyss. The tradtonal soluton technque makes smplfyng assumptons such as a constant

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

Asymptotic Quantization: A Method for Determining Zador s Constant

Asymptotic Quantization: A Method for Determining Zador s Constant Asymptotc Quantzaton: A Method for Determnng Zador s Constant Joyce Shh Because of the fnte capacty of modern communcaton systems better methods of encodng data are requred. Quantzaton refers to the methods

More information

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 493 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces you have studed thus far n the text are real vector spaces because the scalars

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

Common loop optimizations. Example to improve locality. Why Dependence Analysis. Data Dependence in Loops. Goal is to find best schedule:

Common loop optimizations. Example to improve locality. Why Dependence Analysis. Data Dependence in Loops. Goal is to find best schedule: 15-745 Lecture 6 Data Dependence n Loops Copyrght Seth Goldsten, 2008 Based on sldes from Allen&Kennedy Lecture 6 15-745 2005-8 1 Common loop optmzatons Hostng of loop-nvarant computatons pre-compute before

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Entropy Coding. A complete entropy codec, which is an encoder/decoder. pair, consists of the process of encoding or

Entropy Coding. A complete entropy codec, which is an encoder/decoder. pair, consists of the process of encoding or Sgnal Compresson Sgnal Compresson Entropy Codng Entropy codng s also known as zero-error codng, data compresson or lossless compresson. Entropy codng s wdely used n vrtually all popular nternatonal multmeda

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013 ISSN: 2277-375 Constructon of Trend Free Run Orders for Orthogonal rrays Usng Codes bstract: Sometmes when the expermental runs are carred out n a tme order sequence, the response can depend on the run

More information

Maximizing the number of nonnegative subsets

Maximizing the number of nonnegative subsets Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum

More information

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming EEL 6266 Power System Operaton and Control Chapter 3 Economc Dspatch Usng Dynamc Programmng Pecewse Lnear Cost Functons Common practce many utltes prefer to represent ther generator cost functons as sngle-

More information

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION Advanced Mathematcal Models & Applcatons Vol.3, No.3, 2018, pp.215-222 ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EUATION

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

Module 2. Random Processes. Version 2 ECE IIT, Kharagpur

Module 2. Random Processes. Version 2 ECE IIT, Kharagpur Module Random Processes Lesson 6 Functons of Random Varables After readng ths lesson, ou wll learn about cdf of functon of a random varable. Formula for determnng the pdf of a random varable. Let, X be

More information

HMMT February 2016 February 20, 2016

HMMT February 2016 February 20, 2016 HMMT February 016 February 0, 016 Combnatorcs 1. For postve ntegers n, let S n be the set of ntegers x such that n dstnct lnes, no three concurrent, can dvde a plane nto x regons (for example, S = {3,

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

Lecture 5 Decoding Binary BCH Codes

Lecture 5 Decoding Binary BCH Codes Lecture 5 Decodng Bnary BCH Codes In ths class, we wll ntroduce dfferent methods for decodng BCH codes 51 Decodng the [15, 7, 5] 2 -BCH Code Consder the [15, 7, 5] 2 -code C we ntroduced n the last lecture

More information

Computing Correlated Equilibria in Multi-Player Games

Computing Correlated Equilibria in Multi-Player Games Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) ,

A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) , A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS Dr. Derald E. Wentzen, Wesley College, (302) 736-2574, wentzde@wesley.edu ABSTRACT A lnear programmng model s developed and used to compare

More information

The L(2, 1)-Labeling on -Product of Graphs

The L(2, 1)-Labeling on -Product of Graphs Annals of Pure and Appled Mathematcs Vol 0, No, 05, 9-39 ISSN: 79-087X (P, 79-0888(onlne Publshed on 7 Aprl 05 wwwresearchmathscorg Annals of The L(, -Labelng on -Product of Graphs P Pradhan and Kamesh

More information

Lecture 14 (03/27/18). Channels. Decoding. Preview of the Capacity Theorem.

Lecture 14 (03/27/18). Channels. Decoding. Preview of the Capacity Theorem. Lecture 14 (03/27/18). Channels. Decodng. Prevew of the Capacty Theorem. A. Barg The concept of a communcaton channel n nformaton theory s an abstracton for transmttng dgtal (and analog) nformaton from

More information

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business Amr s Supply Chan Model by S. Ashtab a,, R.J. Caron b E. Selvarajah c a Department of Industral Manufacturng System Engneerng b Department of Mathematcs Statstcs c Odette School of Busness Unversty of

More information

Integrated approach in solving parallel machine scheduling and location (ScheLoc) problem

Integrated approach in solving parallel machine scheduling and location (ScheLoc) problem Internatonal Journal of Industral Engneerng Computatons 7 (2016) 573 584 Contents lsts avalable at GrowngScence Internatonal Journal of Industral Engneerng Computatons homepage: www.growngscence.com/ec

More information

Min Cut, Fast Cut, Polynomial Identities

Min Cut, Fast Cut, Polynomial Identities Randomzed Algorthms, Summer 016 Mn Cut, Fast Cut, Polynomal Identtes Instructor: Thomas Kesselhem and Kurt Mehlhorn 1 Mn Cuts n Graphs Lecture (5 pages) Throughout ths secton, G = (V, E) s a mult-graph.

More information

Exercises. 18 Algorithms

Exercises. 18 Algorithms 18 Algorthms Exercses 0.1. In each of the followng stuatons, ndcate whether f = O(g), or f = Ω(g), or both (n whch case f = Θ(g)). f(n) g(n) (a) n 100 n 200 (b) n 1/2 n 2/3 (c) 100n + log n n + (log n)

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran

More information

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:

More information

Pulse Coded Modulation

Pulse Coded Modulation Pulse Coded Modulaton PCM (Pulse Coded Modulaton) s a voce codng technque defned by the ITU-T G.711 standard and t s used n dgtal telephony to encode the voce sgnal. The frst step n the analog to dgtal

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

Complete subgraphs in multipartite graphs

Complete subgraphs in multipartite graphs Complete subgraphs n multpartte graphs FLORIAN PFENDER Unverstät Rostock, Insttut für Mathematk D-18057 Rostock, Germany Floran.Pfender@un-rostock.de Abstract Turán s Theorem states that every graph G

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

CHAPTER III Neural Networks as Associative Memory

CHAPTER III Neural Networks as Associative Memory CHAPTER III Neural Networs as Assocatve Memory Introducton One of the prmary functons of the bran s assocatve memory. We assocate the faces wth names, letters wth sounds, or we can recognze the people

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

Lecture 4: November 17, Part 1 Single Buffer Management

Lecture 4: November 17, Part 1 Single Buffer Management Lecturer: Ad Rosén Algorthms for the anagement of Networs Fall 2003-2004 Lecture 4: November 7, 2003 Scrbe: Guy Grebla Part Sngle Buffer anagement In the prevous lecture we taled about the Combned Input

More information

find (x): given element x, return the canonical element of the set containing x;

find (x): given element x, return the canonical element of the set containing x; COS 43 Sprng, 009 Dsjont Set Unon Problem: Mantan a collecton of dsjont sets. Two operatons: fnd the set contanng a gven element; unte two sets nto one (destructvely). Approach: Canoncal element method:

More information

A new construction of 3-separable matrices via an improved decoding of Macula s construction

A new construction of 3-separable matrices via an improved decoding of Macula s construction Dscrete Optmzaton 5 008 700 704 Contents lsts avalable at ScenceDrect Dscrete Optmzaton journal homepage: wwwelsevercom/locate/dsopt A new constructon of 3-separable matrces va an mproved decodng of Macula

More information

Edge Isoperimetric Inequalities

Edge Isoperimetric Inequalities November 7, 2005 Ross M. Rchardson Edge Isopermetrc Inequaltes 1 Four Questons Recall that n the last lecture we looked at the problem of sopermetrc nequaltes n the hypercube, Q n. Our noton of boundary

More information

Support Vector Machines. Vibhav Gogate The University of Texas at dallas

Support Vector Machines. Vibhav Gogate The University of Texas at dallas Support Vector Machnes Vbhav Gogate he Unversty of exas at dallas What We have Learned So Far? 1. Decson rees. Naïve Bayes 3. Lnear Regresson 4. Logstc Regresson 5. Perceptron 6. Neural networks 7. K-Nearest

More information

Report on Image warping

Report on Image warping Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

Annexes. EC.1. Cycle-base move illustration. EC.2. Problem Instances

Annexes. EC.1. Cycle-base move illustration. EC.2. Problem Instances ec Annexes Ths Annex frst llustrates a cycle-based move n the dynamc-block generaton tabu search. It then dsplays the characterstcs of the nstance sets, followed by detaled results of the parametercalbraton

More information

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016 U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and

More information

Pattern Classification

Pattern Classification Pattern Classfcaton All materals n these sldes ere taken from Pattern Classfcaton (nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wley & Sons, 000 th the permsson of the authors and the publsher

More information

Negative Binomial Regression

Negative Binomial Regression STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem Appled Mathematcal Scences Vol 5 0 no 65 3 33 Interactve B-Level Mult-Objectve Integer Non-lnear Programmng Problem O E Emam Department of Informaton Systems aculty of Computer Scence and nformaton Helwan

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

Split alignment. Martin C. Frith April 13, 2012

Split alignment. Martin C. Frith April 13, 2012 Splt algnment Martn C. Frth Aprl 13, 2012 1 Introducton Ths document s about algnng a query sequence to a genome, allowng dfferent parts of the query to match dfferent parts of the genome. Here are some

More information

Thin-Walled Structures Group

Thin-Walled Structures Group Thn-Walled Structures Group JOHNS HOPKINS UNIVERSITY RESEARCH REPORT Towards optmzaton of CFS beam-column ndustry sectons TWG-RR02-12 Y. Shfferaw July 2012 1 Ths report was prepared ndependently, but was

More information

Finding Dense Subgraphs in G(n, 1/2)

Finding Dense Subgraphs in G(n, 1/2) Fndng Dense Subgraphs n Gn, 1/ Atsh Das Sarma 1, Amt Deshpande, and Rav Kannan 1 Georga Insttute of Technology,atsh@cc.gatech.edu Mcrosoft Research-Bangalore,amtdesh,annan@mcrosoft.com Abstract. Fndng

More information

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens THE CHINESE REMAINDER THEOREM KEITH CONRAD We should thank the Chnese for ther wonderful remander theorem. Glenn Stevens 1. Introducton The Chnese remander theorem says we can unquely solve any par of

More information

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition Sngle-Faclty Schedulng over Long Tme Horzons by Logc-based Benders Decomposton Elvn Coban and J. N. Hooker Tepper School of Busness, Carnege Mellon Unversty ecoban@andrew.cmu.edu, john@hooker.tepper.cmu.edu

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

The Expectation-Maximization Algorithm

The Expectation-Maximization Algorithm The Expectaton-Maxmaton Algorthm Charles Elan elan@cs.ucsd.edu November 16, 2007 Ths chapter explans the EM algorthm at multple levels of generalty. Secton 1 gves the standard hgh-level verson of the algorthm.

More information

Solution Thermodynamics

Solution Thermodynamics Soluton hermodynamcs usng Wagner Notaton by Stanley. Howard Department of aterals and etallurgcal Engneerng South Dakota School of nes and echnology Rapd Cty, SD 57701 January 7, 001 Soluton hermodynamcs

More information

Random Walks on Digraphs

Random Walks on Digraphs Random Walks on Dgraphs J. J. P. Veerman October 23, 27 Introducton Let V = {, n} be a vertex set and S a non-negatve row-stochastc matrx (.e. rows sum to ). V and S defne a dgraph G = G(V, S) and a drected

More information

Lecture 10: May 6, 2013

Lecture 10: May 6, 2013 TTIC/CMSC 31150 Mathematcal Toolkt Sprng 013 Madhur Tulsan Lecture 10: May 6, 013 Scrbe: Wenje Luo In today s lecture, we manly talked about random walk on graphs and ntroduce the concept of graph expander,

More information

Convexity preserving interpolation by splines of arbitrary degree

Convexity preserving interpolation by splines of arbitrary degree Computer Scence Journal of Moldova, vol.18, no.1(52), 2010 Convexty preservng nterpolaton by splnes of arbtrary degree Igor Verlan Abstract In the present paper an algorthm of C 2 nterpolaton of dscrete

More information

Regularized Discriminant Analysis for Face Recognition

Regularized Discriminant Analysis for Face Recognition 1 Regularzed Dscrmnant Analyss for Face Recognton Itz Pma, Mayer Aladem Department of Electrcal and Computer Engneerng, Ben-Guron Unversty of the Negev P.O.Box 653, Beer-Sheva, 845, Israel. Abstract Ths

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL

More information

Introduction to information theory and data compression

Introduction to information theory and data compression Introducton to nformaton theory and data compresson Adel Magra, Emma Gouné, Irène Woo March 8, 207 Ths s the augmented transcrpt of a lecture gven by Luc Devroye on March 9th 207 for a Data Structures

More information