Deriving confidence intervals for mutation rates across a wide range of evolutionary distances using FracMinHash

  1. David Koslicki1,3,4
  1. 1Department of Computer Science and Engineering, The Pennsylvania State University, State College, Pennsylvania 16801, USA;
  2. 2Department of Population Health and Reproduction, University of California, Davis, California 95616, USA;
  3. 3Department of Biology, The Pennsylvania State University, State College, Pennsylvania 16801, USA;
  4. 4Huck Institutes of the Life Sciences, The Pennsylvania State University, State College, Pennsylvania 16801, USA
  • Corresponding author: dmk333{at}psu.edu
  • Abstract

    Sketching methods offer computational biologists scalable techniques to analyze data sets that continue to grow in size. MinHash is one such technique to estimate set similarity that has enjoyed recent broad application. However, traditional MinHash has previously been shown to perform poorly when applied to sets of very dissimilar sizes. FracMinHash was recently introduced as a modification of MinHash to compensate for this lack of performance when set sizes differ. This approach has been successfully applied to metagenomic taxonomic profiling in the widely used tool sourmash gather. Although experimental evidence has been encouraging, FracMinHash has not yet been analyzed from a theoretical perspective. In this paper, we perform such an analysis to derive various statistics of FracMinHash, and prove that although FracMinHash is not unbiased (in the sense that its expected value is not equal to the quantity it attempts to estimate), this bias is easily corrected for both the containment and Jaccard index versions. Next, we show how FracMinHash can be used to compute point estimates as well as confidence intervals for evolutionary mutation distance between a pair of sequences by assuming a simple mutation model. We also investigate edge cases in which these analyses may fail to effectively warn the users of FracMinHash indicating the likelihood of such cases. Our analyses show that FracMinHash estimates the containment of a genome in a large metagenome more accurately and more precisely compared with traditional MinHash, and the point estimates and confidence intervals perform significantly better in estimating mutation distances.

    Footnotes

    • [Supplemental material is available for this article.]

    • Article published online before print. Article, supplemental material, and publication date are at https://www.genome.org/cgi/doi/10.1101/gr.277651.123.

    • Freely available online through the Genome Research Open Access option.

    • Received January 4, 2023.
    • Accepted June 6, 2023.

    This article, published in Genome Research, is available under a Creative Commons License (Attribution-NonCommercial 4.0 International), as described at http://creativecommons.org/licenses/by-nc/4.0/.

    Articles citing this article

    | Table of Contents
    OPEN ACCESS ARTICLE

    Preprint Server