Grundlagen der Bioinformatik, SS 08, D. Huson, May 2,

Similar documents
In-Depth Assessment of Local Sequence Alignment

BLAST. Varieties of BLAST

Heuristic Alignment and Searching

Bioinformatics (GLOBEX, Summer 2015) Pairwise sequence alignment

Sequence Database Search Techniques I: Blast and PatternHunter tools

BLAST Database Searching. BME 110: CompBio Tools Todd Lowe April 8, 2010

BLAST: Basic Local Alignment Search Tool

Algorithms in Bioinformatics FOUR Pairwise Sequence Alignment. Pairwise Sequence Alignment. Convention: DNA Sequences 5. Sequence Alignment

Bioinformatics and BLAST

Basic Local Alignment Search Tool

Single alignment: Substitution Matrix. 16 march 2017

Introduction to Bioinformatics

Alignment principles and homology searching using (PSI-)BLAST. Jaap Heringa Centre for Integrative Bioinformatics VU (IBIVU)

Algorithms in Bioinformatics

EECS730: Introduction to Bioinformatics

Tiffany Samaroo MB&B 452a December 8, Take Home Final. Topic 1

Tools and Algorithms in Bioinformatics

Tools and Algorithms in Bioinformatics

L3: Blast: Keyword match basics

Computational Biology

Chapter 7: Rapid alignment methods: FASTA and BLAST

Bioinformatics for Biologists

Alignment & BLAST. By: Hadi Mozafari KUMS

THEORY. Based on sequence Length According to the length of sequence being compared it is of following two types

An Introduction to Sequence Similarity ( Homology ) Searching

Sequence Alignment Techniques and Their Uses

BLAST: Target frequencies and information content Dannie Durand

SEQUENCE alignment is an underlying application in the

CSE : Computational Issues in Molecular Biology. Lecture 6. Spring 2004

3. SEQUENCE ANALYSIS BIOINFORMATICS COURSE MTAT

Algorithms in Bioinformatics I, ZBIT, Uni Tübingen, Daniel Huson, WS 2003/4 1

Homology Modeling. Roberto Lins EPFL - summer semester 2005

bioinformatics 1 -- lecture 7

20 Grundlagen der Bioinformatik, SS 08, D. Huson, May 27, Global and local alignment of two sequences using dynamic programming

Sequence Alignments. Dynamic programming approaches, scoring, and significance. Lucy Skrabanek ICB, WMC January 31, 2013

Sequence Alignment: A General Overview. COMP Fall 2010 Luay Nakhleh, Rice University

CISC 889 Bioinformatics (Spring 2004) Sequence pairwise alignment (I)

MPIPairwiseStatSig: Parallel Pairwise Statistical Significance Estimation of Local Sequence Alignment

Searching Sear ( Sub- (Sub )Strings Ulf Leser

CSE182-L7. Protein Sequence Analysis Patterns (regular expressions) Profiles HMM Gene Finding CSE182

Exercise 5. Sequence Profiles & BLAST

Sequence Comparison. mouse human

Fundamentals of database searching

Sequence analysis and Genomics

Sara C. Madeira. Universidade da Beira Interior. (Thanks to Ana Teresa Freitas, IST for useful resources on this subject)

1.5 Sequence alignment

Introduction to protein alignments

A profile-based protein sequence alignment algorithm for a domain clustering database

Collected Works of Charles Dickens

Grundlagen der Bioinformatik Summer semester Lecturer: Prof. Daniel Huson

Lecture 2, 5/12/2001: Local alignment the Smith-Waterman algorithm. Alignment scoring schemes and theory: substitution matrices and gap models

8 Grundlagen der Bioinformatik, SS 09, D. Huson, April 28, 2009

Chapter 5. Proteomics and the analysis of protein sequence Ⅱ

Reducing storage requirements for biological sequence comparison

Sequence Analysis '17 -- lecture 7

Sequence alignment methods. Pairwise alignment. The universe of biological sequence analysis

8 Grundlagen der Bioinformatik, SoSe 11, D. Huson, April 18, 2011

Pairwise alignment. 2.1 Introduction GSAQVKGHGKKVADALTNAVAHVDDMPNALSALSD----LHAHKL

Derived Distribution Points Heuristic for Fast Pairwise Statistical Significance Estimation

MATHEMATICAL MODELS - Vol. III - Mathematical Modeling and the Human Genome - Hilary S. Booth MATHEMATICAL MODELING AND THE HUMAN GENOME

RELATIONSHIPS BETWEEN GENES/PROTEINS HOMOLOGUES

BIOINFORMATICS 1 INTRODUCTION TO SEQUENCE ANALYSIS EVOLUTIONARY BASIS OF SEQUENCE ANALYSES EVOLUTIONARY BASIS OF SEQUENCE ANALYSES

Introduction to Sequence Alignment. Manpreet S. Katari

Pairwise Alignment. Guan-Shieng Huang. Dept. of CSIE, NCNU. Pairwise Alignment p.1/55

Introduction to sequence alignment. Local alignment the Smith-Waterman algorithm

Biologically significant sequence alignments using Boltzmann probabilities

Genome Annotation. Qi Sun Bioinformatics Facility Cornell University

Pairwise sequence alignment

Effective Cluster-Based Seed Design for Cross-Species Sequence Comparisons

Local Alignment Statistics

Pairwise & Multiple sequence alignments

Giri Narasimhan. CAP 5510: Introduction to Bioinformatics. ECS 254; Phone: x3748

SUPPLEMENTARY INFORMATION

BMC Bioinformatics. Open Access. Abstract

SEPA: Approximate Non-Subjective Empirical p-value Estimation for Nucleotide Sequence Alignment

Sequence-specific sequence comparison using pairwise statistical significance

Malik Hammoutène - SSC. Sequence Analysis

Protein function prediction based on sequence analysis

EECS730: Introduction to Bioinformatics

Module: Sequence Alignment Theory and Applications Session: Introduction to Searching and Sequence Alignment

Statistical Machine Learning Methods for Bioinformatics II. Hidden Markov Model for Biological Sequences

Optimization of a New Score Function for the Detection of Remote Homologs

Search sequence databases 2 10/25/2016

Variable-length Intervals in Homology Search

Sequence Database Search. 北京大学生物信息学中心高歌 Ge Gao, Ph.D. Center for Bioinformatics, Peking University

Week 10: Homology Modelling (II) - HHpred

BLAT The BLAST-Like Alignment Tool

08/21/2017 BLAST. Multiple Sequence Alignments: Clustal Omega

B I O I N F O R M A T I C S

InDel 3-5. InDel 8-9. InDel 3-5. InDel 8-9. InDel InDel 8-9

Whole Genome Alignments and Synteny Maps

Lecture 2: Pairwise Alignment. CG Ron Shamir

Bioinformatics Workshop - NM-AIST

Statistical Machine Learning Methods for Biomedical Informatics II. Hidden Markov Model for Biological Sequences

Making sense of score statistics for sequence alignments

Optimal spaced seeds for faster approximate string matching

Optimal spaced seeds for faster approximate string matching

CONCEPT OF SEQUENCE COMPARISON. Natapol Pornputtapong 18 January 2018

Large-Scale Genomic Surveys

Building 3D models of proteins

Transcription:

Grundlagen der Bioinformatik, SS 08, D. Huson, May 2, 2008 39 5 Blast This lecture is based on the following, which are all recommended reading: R. Merkl, S. Waack: Bioinformatik Interaktiv. Chapter 11.4-11.7 S.F. Altschul, W. Gish, W. Miller, E.W. Myers and D.J. Lipman. Basic local alignment search tool, J. Molecular Biology, 215:403-410 (1990). http://www.ncbi.nlm.nih.gov/blast/tutorial/altschul-1.html I. Eidhammer, I. Jonassen, W.R. Taylor, Protein Bioinformatics, pg. 34 64, 2004. 5.1 Introduction Pairwise alignment is used to detect homologies between different protein or DNA sequences, usually as global or local alignments. Solving this by dynamic programming takes quadratic time, that is, time proportional to the product of the lengths of the two sequences being compared. This is too slow for searching current databases. Hence, in practice heuristics are used that run much faster, at the expense of possibly missing some significant hits. Such heuristics are usually based on a seed-and-extend approach in which first small exact matches are found, which are then extended to obtain long inexact ones. 5.2 Overview BLAST, the Basic Local Alignment Search Tool (Altschul et al., 1990), is perhaps the most widely used bioinformatics tool ever written. It is an alignment heuristic that determines local alignments between a query and a database. It uses an approximation of the Smith-Waterman algorithm. One important aspect of BLAST is that it provides statistics to distinguish random from real similarities. BLAST consists of two components: a search algorithm and computation of the statistical significance of solutions. BLAST starts with the localization of substrings (so-called segment pairs or hits) in two sequences that have a certain similarity score. The hits are the starting point for deriving HSPs, locally optimal pairs that contain the hit. Extending to the left or right of an HSP would lead to a lower score. BLAST searches for alignments local alignments between a query and a database.

40 Grundlagen der Bioinformatik, SS 08, D. Huson (this part by K. Nieselt) May 2, 2008 BLAST consists of two components: 1. A heuristic for finding local alignments, and 2. a computation of the statistical significance of solutions to distinguish random from real similarities. The heuristic for finding local alignments operates as follows: 1. First search for pairs substrings (so-called segment pairs or hits) in two sequences that have a certain similarity score. 2. The hits are considered seeds. 3. Hits are extended to HSPs - High-Scoring Segment Pairs until the score of the extended hit drops by a certain amount. 5.3 BLAST terminology Definition 5.3.1 Let q be the query and d the database over an alphabet Σ. A segment is a substring s of q or d. Let S Σ be a scoring matrix. A segment-pair (s, t) (or hit) consists of two segments, one in q and one d, of the same length. The score σ(s, t) of the segment pair is the alignment score for (s, t) given S Σ. Example: V A L L A R P A M M A R σ(s, t) (using BLOSUM62) = 15 Definition 5.3.2 A locally maximal segment pair (LMSP) is any segment pair (s, t) whose score cannot be improved by shortening or extending the segment pair. A maximum segment pair (MSP) is any segment pair (s, t) of maximal alignment score σ(s, t). Given a cutoff score S, a segment pair (s, t) is called a high-scoring segment pair (HSP), if it is locally maximal and σ(s, t) S. Finally, a word is simply a short substring of fixed length w, and a word pair is a pair of short substrings of fixed length w. Given the cut-off score S, the goal of BLAST is to compute all HSPs. 5.4 Preprocessing Given three parameters, i.e. a word size w, a word similarity threshold T and a minimum cut-off score S, the gaol is to find a segment pair with a score of at least S that contains at least one word pair of length w with score at least T. BLAST operates as follows: Preprocessing: Of the query sequence q first all words of length w are generated. Then a list of all w-mers of length w over the alphabet Σ that have similarity > T to some word in the query sequence q is generated. Example: For the query sequence RQCSAGW the list of words of length w = 2 with a score T > 8 using the BLOSUM62 matrix are:

Grundlagen der Bioinformatik, SS 08, D. Huson (this part by K. Nieselt) May 2, 2008 41 word 2 mer with score > 8 RQ RQ QC QC, RC, EC, NC, DC, KC, MC, SC CS CS,CA,CN,CD,CQ,CE,CG,CK,CT SA - AG AG GW GW,AW,RW,NW,DW,QW,EW,HW,KW,PW,SW,TW,WW 5.4.1 Search The search algorithm consists then of three steps: 1. Localization of the hits: The database sequence d is scanned for all hits t of w-mers s in the list, and the position of the hit is saved. 2. Detection of hits: First all pairs of hits are searched that have a distance of at most A (think of them lying on the same diagonal in the matrix of the SW-algorithm). 3. Extension to HSPs: Each such seed (s, t) is extended in both directions until its score σ(s, t) cannot be enlarged (LMSP). Then all best extensions are reported that have score S, these are the HSPs. Originally the extension did not include gaps, the modern BLAST2 algorithm allows insertion of gaps. In practice, w = 3 and A = 40 for proteins, and w = 12 for DNA sequences. 5.5 The BLAST family There are a number of different variants of the BLAST program: BLASTN: compares a DNA query sequence to a DNA sequence database; q DNA s DNA BLASTP: compares a protein query sequence to a protein sequence database; q protein s protein TBLASTN: compares a protein query sequence to a DNA sequence database (6 frames translation); q protein s t1(dna), q protein s t2(dna), q protein s t3(dna), q protein s t c 1 (DNA), q protein s t c 2 (DNA), q protein s t c 3 (DNA) BLASTX: compares a DNA query sequence (6 frames translation) to a protein sequence database; q t1(dna) s protein, q t2(dna) s protein, q t3(dna) s protein, q t c 1 (DNA) s protein, q t c 2 (DNA) s protein, q t c 3 (DNA) s protein TBLASTX: compares a DNA query sequence (6 frames translation) to a DNA sequence database (6 frames translation); q t1(dna) s t1(dna),..., q t c 3 (DNA) s t c 3 (DNA) 5.6 Statistical analysis When a local alignment has been computed, next one needs to assess its statistical significance. This is done by the general approach of hypothesis testing.

42 Grundlagen der Bioinformatik, SS 08, D. Huson (this part by K. Nieselt) May 2, 2008 5.6.1 Poisson distribution The Karlin and Altschul theory for local alignments (without gaps) is based on Poisson and extreme value distributions. The details of that theory are beyond the scope of this lecture, but basics are sketched in the following. Definition 5.6.1 The Poisson distribution with parameter v is given by P(X = x) = vx x! e v (5.1) Note that v is the expected value as well as the variance. probability that a variable X will have a value at least x is From the equation we follow that the x 1 P(X x) = 1 i=0 v i i! e v (5.2) 5.6.2 Statistical significance of an HSP Given an HSP (s, t) with score σ(s, t). How significant is this match (i.e., local alignment)? To analyze how high a score is likely to arise by chance, a model of random sequences over the alphabet Σ is needed. Given the scoring matrix S(a, b), the expected score for aligning a random pair of amino acid is required to be negative: E = p a p b S(a, b) < 0 a,b Σ Were this not the case, long alignments would tend to have high score independently of whether the segments aligned were related, and the statistical theory would break down. 5.6.3 Statistical significance Assume that the length m and n of the query and database respectively are sufficiently large. The number of random HSPs (s, t) with σ(s, t) S can be described by a Poisson distribution with parameter v = Kmne λs. The number of HSPs with score S that we expect to see due to chance is then the parameter v, also called the E-value: E(S) = Kmne λs The parameters K and λ depend on the background probabilities of the symbols and on the employed scoring matrix. λ is the unique value for y that satisfies the equation p a p b e S(a,b)y = 1 a,b Σ K and λ are scaling-factors for the search space and for the scoring scheme, respectively. Hence, the probability of finding exactly x HSPs with a score S is given by P(X = x) = e E Ex x!,

Grundlagen der Bioinformatik, SS 08, D. Huson (this part by K. Nieselt) May 2, 2008 43 where E is the E-value for S. The probability of finding at least one HSP by chance is P(S) = 1 P(X = 0) = 1 e E. Thus we see that the probability distribution of the scores follows an extreme value distribution. BLAST reports E-values rather than P -values as it is easier to interpret the difference between E-values than to interpret the difference between P -values. 5.6.4 BLAST as a web service http://www.ncbi.nlm.nih.gov/blast/

44 Grundlagen der Bioinformatik, SS 08, D. Huson (this part by K. Nieselt) May 2, 2008 5.6.5 BLAST run example 5.6.6 BLAST run example

Grundlagen der Bioinformatik, SS 08, D. Huson (this part by K. Nieselt) May 2, 2008 45 5.6.7 BLAST run output 5.6.8 BLAST run output

46 Grundlagen der Bioinformatik, SS 08, D. Huson (this part by K. Nieselt) May 2, 2008 5.7 Remarks Another well-known heuristic for pairwise local alignments is FASTA (and its variants), developed by Lipman and Pearson 1 1 D.J. Lipman and W.R. Pearson, Rapid and Sensitive Protein Similarity Searches. Science 227, 1435-1441 (1985).