Full opinion text
OPINION BECKER, Circuit Judge. TABLE OF CONTENTS I. Introduction 219 II. Facts and Procedural History. 220 A. The Offense and Mitchell’s First Trial and Appeal. 220 B. Latent Fingerprint Identification and the Daubert Hearing. 220 1. The Field of Latent Fingerprint Identification . 220 2. The Daubert Hearing. 222 a. The Government’s Experts . 222 b. Mitchell's Experts. 226 e. Mitchell’s Exhibits. 228 d. The Government’s Rebuttal Witness. 229 3. The District Court’s Daubert and Judicial Notice Rulings ... 229 C. Mitchell’s Second Trial . 230 1. The Government’s Case. 230 2. Mitchell’s Case and Cross-Examination of the Government’s Experts. 231 D. Withholding of the NIJ Solicitation and Mitchell’s Post-Trial Motion 232 E. This Appeal. 232 III. Admissibility of the Government’s Expert Testimony. 233 A. Standard of Review. 233 B. Standard for Admissibility under Rule 702 . 234 C. Application of Daubert Factors to Government’s Expert Testimony 235 1. Testability.•. 235 2. Peer Review. 238 3. Error Rate. 239 4. Maintenance of Standards. 241 5. General Acceptance. 241 6. Relationship to Established Reliable Techniques. 241 7. Degree to Which the Expert Testifying Is Qualified. 242 8. Non-Judicial Uses. 242 Application to the Record of Core Daubert Principles. 244 Conclusion on the Admissibility of the Government’s Evidence 246 IV. Admissibility of Mitchell s Expert Testimony.246 A. Introduction.246 B. Velasquez.247 C. The Parties’ Interpretations of the District Court’s Rulings.247 D. Discussion.250 V. The District Court’s Declaration of Judicial Notice rH LO OJ A. Appropriateness of Judicial Notice. tH LO 03 B. Harmless Error Analysis . Cm LO OJ VI. Withholding of the NIJ Solicitation. .254 A. Standard of Review and Applicable Law ^ LO 03 B. Discussion. ZD lO 03 VII. Admission of Alleged Prior Consistent Statements ..257 VIÍI. Conclusion.259 APPENDIX: Colloquies with the District Court Regarding Admissibility of Mitchell’s Proposed Experts..'.259 I. Introduction This appeal by Byron Mitchell from a judgment in a criminal case raises important questions concerning the admissibility of latent fingerprint identification evidence under Fed.R.Evid. 702. We adjudicate on the basis of a voluminous' record developed at a Daubert hearing, see Daubert v. Merrell Dow Pharmaceuticals, Inc., 509 U.S. 579, 113 S.Ct. 2786, 125 L.Ed.2d 469 (1993), and explore in considerable detail the application of the various Daubert factors to the prosecution’s expert testimony. We conclude that the testimony passes Daubert muster, and that there are “good grounds,” id. at 590, 113 S.Ct. 2786, for its admission. In a related matter, we must decide whether the District Court properly took judicial notice that “human friction ridges are unique and permanent throughout the area of the friction ridge skin, including small friction ridge areas, and that .... human friction ridge skin. arrangements are unique and permanent.” App. 1472a. We conclude that the District Court erred in taking judicial notice, but that the error was harmless. We also consider Mitchell’s contention that the District Court erroneously excluded from trial significant portions of his proffered expert testimony on the unreliability of latent fingerprint identification. Portions of the colloquies between the Court and counsel are less than pellucid, but we are satisfied that what the Court really did was te mperate on a three-tier theory of what expert testimony was admissible: allowing (1) specific criticisms and (2) general reliability criticisms, but excluding (3) testimony about whether latent fingerprint identification is a “science.” Within-that framework, the exclusion of evidence that latent fingerprint identification is a science was proper under Kumho Tire Co. v. Carmichael, 526 U.S. 137, 119 S.Ct. 1167, 143 L.Ed.2d 238 (1999). The final fingerprint-related issue concerns the putative withholding by the government of a Department of Justice solicitation for research proposals directed at validating the reliability of latent fingerprint identification. . This solicitation, Mitchell contends, was not only improperly and intentionally withheld by the government in violation of its obligations under Brady v. Maryland, 373 U.S. 83, 83 S.Ct. 1194, 10 L.Ed.2d 215 (1963), but would have been powerful evidence, not only substantively but alsó to impeach the government’s expert witnesses who testified that latent fingerprint identification was a well-established discipline with a strong and well-verified foundation. The District Court concluded that the solicitation was not material under the “reasonable probability of a different outcome” standard of Brady and its progeny. We agree. The .remaining issue on appeal is whether plain error was committed by the admission of testimony that a key government witness gave a statement to the FBI and testified at a prior proceeding. Mitchell characterizes the admission of this evidence as improper under the hearsay rules, Fed.R.Evid. 801, 802. We conclude that testimony about the existence of a statement is not itself a “statement”; that the testimony was not “offered ... to prove the truth of the matter asserted,” Fed.R.Evid. 801(c), and thus not inadmissible under Fed.R.Evid. 802; and that, at all events, the plain error standard is not met. We will therefore affirm the judgment. II. Facts and Procedural History A. The Offense and Mitchell’s First Trial and Appeal This case began in 1991 when two men with handguns robbed an armored car employee of approximately $20,000 as he entered a check cashing agency at 29th Street and Girard Avenue in North Philadelphia. The robbers then got into a beige car driven by a third person, engaging in gunfire with the armored car employees as they fled. The beige car, which had been stolen about an hour beforehand, was abandoned by the robbers roughly a mile from the agency. The government sought to prove at trial that the robbers were William Robinson (a/k/a “Bookie”) and Terrence Stewart (a/k/a “T”), and that the getaway driver was Mitchell. According to the government, the robbery had a fourth participant, Kim Chester, who knew of the plans, helped case the robbery site, and assisted the others in spending the proceeds of the robbery. Chester testified for the prosecution at Mitchell’s trial as an uncharged accomplice. Both Robinson and Stewart died before trial, and thus Mitchell was the sole defendant. Mitchell was charged with conspiracy to commit and commission of Hobbs Act robbery, 18 U.S.C. § 1951, and use of and carrying a firearm during a crime of violence, 18 U.S.C. § 924(c). In the first trial, at which Mitchell was convicted of all counts, the government introduced into evidence an anonymous note that had been left in the front seat of the abandoned beige car, apparently written by someone who observed the robbers exiting the beige car and getting into a different car. The note read, “Light green ZPJ-254. They changed cars; this is the other car.” On appeal, we held the note to be inadmissible hearsay not subject to any exception in Fed.R.Evid. 803. United States v. Mitchell, 145 F.3d 572 (3d Cir.1998). In view of the limited other evidence connecting Mitchell to the robbery-Chester’s testimony was questionable, no robbery proceeds were ever linked to Mitchell, and the fingerprints recovered from the beige getaway car were identified as Mitchell’s but in poor condition-we concluded that admission of the anonymous note was not harmless error. Id. at 579-80. Accordingly, we vacated Mitchell’s conviction and remanded for a new trial. Id. B. Latent Fingerprint Identification and the Daubert Hearing Prior to the retrial, the District Court conducted a lengthy Daubert hearing on the admissibility under Fed.R.Evid. 702 of the .government’s expert testimony (and Mitchell’s counter-experts) on the identification of fingerprints found on the gear shift lever and driver’s side door of the beige getaway car. This hearing was to adjudicate a major attack mounted by Mitchell on the government’s fingerprint evidence.' As with any expert testimony, some background in the field and an introduction to the jargon is helpful, and so we discuss the field of latent fingerprint identification in general before turning to the particulars of the Daubert hearing. 1. The Field of Latent Fingerprint Identification Criminals generally do not leave behind full fingerprints on clean, flat surfaces. Rather, they leave fragments that are often distorted or marred by artifacts, terms we explain in the margin. These “latent” prints-from the Latin lateo, “to lie hidden,” because they are often not visible to the naked eye until dusted or otherwise revealed-are the typical grist for the fingerprint identification expert’s mill. Testimony at the Daubert hearing suggested that the typical latent print is a fraction-perhaps l/5th-of the size of a full fingerprint. App. 435a-436a. A “full” fingerprint is familiar to anyone who has been fingerprinted for identification or law enforcement reasons: It is the print made by rolling the full surface of the fingertip onto a fingerprint card or electronic fingerprint capture device. (These prints are, for obvious reasons, also referred to as “rolled prints” or “full-rolled prints.”) A full set of full-rolled fingerprints on a card-as would be taken during a police booking, for example-is known as a “ten-print card.” Ten-print cards usually also have space at the bottom of the card for “flat impressions” or “plain impressions,” where all four fingers of the hand are pressed at once onto the card without rolling. Rolled prints and latent prints alike are subject to artifacts and distortions, though the problems with latent prints are more acute because they are smaller, and left more carelessly .than full-rolled prints, and are left on surfaces that many other fingers have also touched. Appellant Br. at 10-11. See Andre Moenssens et al., Scientific Evidence in Civil and Criminal Cases, § 8.08 at 514 (4th ed. 1995) (“Many latent impressions developed at crime scenes are badly blurred or smudged, or consist of partially superimposed impressions of different fingers.”). Fingerprints are left by the depositing of oil upon contact between a surface and the friction ridges of fingers. The field uses the broader term “friction ridge” to designate skin surfaces with ridges evolutionarily adapted to produce increased friction (as compared to smooth skin) for gripping. Thus toeprint or handprint analysis is much the same as fingerprint analysis. The structure of friction ridges is described in the record before us at three levels of increasing detail, designated as Level 1, Level 2 and Level 3. Level 1 detail is visible with the naked eye; it is the familiar pattern of loops, arches, and whorls. Level 2 detail involves “ridge characteristics”-the patterns of islands, dots, and forks formed by the ridges as they begin and end and join and divide. The points where ridges terminate or bifurcate are often referred to as “Galton points,” whose eponym, Sir Francis Galton, first developed a taxonomy for these points. The typical human fingerprint has somewhere between 75 and 175 such ridge characteristics. Level 3 detail focuses on microscopic variations in the ridges themselves, such as the slight meanders of the ridges (the “ridge path”) and the locations of sweat pores. This is the level of detail most likely to be obscured by distortions. The FBI-the agency that made the primary identification in this ease-uses an identification method known as ACE-V, an acronym for “analysis, comparison, evaluation, and verification.” The basic steps taken by an examiner under this protocol are first to winnow the field of candidate matching prints by using Level 1 detail to classify the latent print. Next, the examiner will analyze the latent print to identify Level 2 detail (i.e., Galton points and their spatial relationship to one another), along with any Level 3 detail that can be gleaned from the print. The examiner then compares this to the Level 2 and Level 3 detail of a candidate full-rolled print (sometimes taken from a database of fingerprints, sometimes taken from a suspect in custody), and evaluates whether there is sufficient similarity to declare a match. In the final step, the match is independently verified by another examiner, though there is some dispute about how truly independent this verification is. The standards used by the FBI at the evaluation stage of the ACE-V protocol are somewhat less concrete than the numerical descriptions found in television police dramas that extol “twenty-point matches” and the like. An %-point match refers to a match between an unknown latent print and a known full print in which the examiner has identified n corresponding Galton points in the correct geometry relative to one another. A number of jurisdictions both outside the United States and within seem to rely on a system where a minimum number of corresponding points must be found before a match may be declared, irrespective of Level 3 detail. See, e.g., 2 Paul C. Giannelli & Edward Imwinkelried, Scientific Evidence § 16-7(A), at 768 (3d ed. 1999) (“In France, the required number [of points for a match] used most often is 24 while the number is 30 in Argentina and Brazil”). Such jurisdictions are said to use a “point system.” On the other hand, Canada does not have a minimum point threshold for identification, and the United Kingdom recently eliminated a minimum point threshold. See United States v. Llera Plaza, 188 F.Supp.2d 549, 569-70 (E.D.Pa.2002) (quoting Lord Lester of Herne Hill’s colloquy with Lord Rooker). The alternative approach-which gained favor with the FBI in the late 1940s, App. 378a-is to use a combination of quantity and quality: If ridge characteristics are abundant, then the quality of Level 3 detail is unimportant; but a paucity of Galton points can be compensated for by high-quality Level 3 detail. While this has the advantage of allowing an examiner to find a match in situations where an examiner using a strict point-based standard would not find one, this flexibility comes at the price of substituting a degree of subjectivity for an objective numerical standard. . 2. The Daubert Hearing The District Court held a five-day hearing pursuant to Daubert v. Merrell Dow Pharmaceuticals, Inc., 509 U.S. 579, 113 S.Ct. 2786, 125 L.Ed.2d 469 (1993), to rule on the admissibility of the government’s and Mitchell’s proposed expert testimony. The record of this marathon hearing alone comprises nearly one thousand pages of testimony and a similarly voluminous array of exhibits. The government called six witnesses (plus one rebuttal witness), and Mitchell, four. The District Court found all the offered expert witnesses to be qualified in their respective fields, and neither party raises a challenge to the qualifications, as such, of the witnesses. Rather, both sides’ issues lie with the content of the testimony accepted by the District Court. We briefly describe the areas of testimony of each of the witnesses, starting with the government’s witnesses. a. The Government’s Experts Steven Meagher, an FBI special agent, testified at the hearing about Level 1, Level 2, and Level 3 detail (as described above), and other aspects of fingerprint identification. With regard to the FBI’s practices, technology, and operations, he testified about the ACE-V protocol; that the FBI does not rely on a minimum “points” standard for matching fingerprints (and why it does not); and about the Automated Fingerprint Identification System (“AFIS”) computer system (which automates some preliminary aspects of fingerprint matching). Meagher also described a survey (which we discuss, infra) of state fingerprint identification agencies that he prepared and circulated for the purpose of demonstrating that the fingerprint match in this case was, by wide consensus, correct. He also described an experiment (which we also discuss, infra) designed and run in cooperation with the contractor for the FBI’s AFIS computer system, Lockheed Martin, that would search a portion of the AFIS database for identical fingerprints. Donald Zeisig, of Lockheed Martin, and Bruce Budowle, a statistician and population geneticist with the FBI, were also involved in this experiment, and both testified at the Daubert hearing. Zeisig also testified in greater detail about the technical background of the AFIS computer system.. The government offered two witnesses focusing principally on the biological aspects of fingerprints. Dr. William Babler, of Marquette University, testified about the prenatal development of friction ridges, opining that unique arrangements of friction ridges develop in the womb within a matter of months after conception. He also testified to the medical community’s accepted understanding of the anatomical and cellular bases for the permanence of friction ridge arrangements. Ed German, of the United States Army Criminal Investigation Laboratory, testified to the lack of similarity found between corresponding fingerprints of identical twins, a conclusion established by his own research on identical twins and confirmed by other studies of identical twins. The government also offered David Ash-baugh, of the Royal Canadian Mounted Police, who testified broadly about the de-velopmeht, comparison, and identification of friction ridge skin and impressions. Like the other government witnesses who were examined on the matter {viz., Agent German,. Agent Meagher, and Dr. Bu-dówle) he responded that it was his opinion that friction ridge arrangements were unique (the “uniqueness proposition”) and permanent (the “permanence proposition”), and that positive identifications can be made from fingerprints containing sufficient quantity and quality of ridge detail. Dr. Babler also opined that friction ridge arrangements are unique and'permanent. These propositions were the foundation of the government’s argument that latent fingerprint identification evidence satisfies Daubert. The government conducted two experiments in anticipation of the Daubert hearing: (1) a survey of state fingerprint identification agencies asking them, inter alia, if they could match the latent prints in this case to Mitchell’s ten-print card; and (2) a search for identical fingerprints using data in the AFIS computer system. The specifics of these experiments bear on their relevance as expert evidence, and so we describe them in some detail. For purposes of this case, Meagher created a survey packet that was sent out to the principal law' enforcement agency of each of the fifty states, plus the District of Columbia, Canada’s Royal Canadian Mounted Police, and the United Kingdom’s Scotland Yard. The survey contained three parts: Part A involved, questions about whether the agency currently accepts fingerprints as a means to individualize (i.e., make an identification), and about whether the agency regards fingerprints as unique and permanent. All fifty-three recipients responded in the affirmative to both queries. . Joint Supp.App. • at 56. Part C inquired whether the agencies had ever found two individuals to have the same fingerprint; the response was, unanimously, no. Part C also revealed that, in the aggregate, the ten-print records of nearly 70 million individuals-or about 700 million fingerprints-have been examined during the course of the agencies’ operations. Part B of the survey was designed as a demonstration of the ACE-V identification protocol, and it used the latent fingerprints at issue in this case. Part B offered each agency photographs of the two latent prints and of Mitchell’s ten-print card. Agencies were asked first to attempt to identify the ten-print card using their own computerized fingerprint database. It is common practice (for efficiency’s sake) to “filter” the database in making an identification, by considering only the subset of records (by race, sex, date of birth, etc.) that are likely to result in a match. Meagher requested that agencies not filter their database for this test, to ensure that the prints were compared against the maximum possible number of print records. Of the forty-seven agencies that responded, the only match that was found was in Pennsylvania, where Mitchell’s ten-print record was already on file. In the second segment of Part B, agencies were asked to attempt to match the latent prints to their existing records. The only “hits” were made by the two agencies (Mississippi and South Dakota) that inputted the ten-print card supplied by Meagher into their system prior to running the search (and thus raised the likelihood of a match). Pennsylvania was unable to run this search because of equipment troubles, but represented that it undoubtedly would have made a match if its system were fully operative. The third segment of Part B asked agencies to perform manual comparisons of the latent prints to the ten-print card provided to them. This survey was single-blind, i.e., while Meagher knew that the latent prints had been identified as Mitchell’s, knew that the ten-print card was Mitchell’s, and believed the latents could be matched to the ten-print card, none of the survey recipients Was told any of this. Roughly two thirds of the agencies responded to this portion. Over three quarters of the responding agencies matched both prints consistently with the FBI’s identification. Of those that did not match both prints, half matched only one print consistent with the FBI’s identification, and half matched neither print. In followup- communications, the FBI either convinced these non-identifying agencies that a match did exist and they so acknowledged (though it took the strong suggestion of annotated blown-up photographs of the prints), or otherwise established reasons for the non-identification (e.g., the examiner deemed the quality of the supplied photographs to be too poor to make an identification, and would have preferred an original; or the comparison was performed by an inexperienced examiner, and on review, a senior examiner was able to find a match). A critical summary point is that no agency ever registered a “false” positive (i.e., a positive match that contradicted the FBI’s result): In the first segment of Part B, no agency matched Mitchell’s ten-print card to someone else’s ten-print card; in the second segment, no agency matched the latent prints to anyone other than Mitchell; and in the third segment, no agency matched a latent print to any finger other than the one to which the FBI had matched the latent print. The second experiment conducted by the government’s experts was known as the “50/50” experiment. This was an empirical examination by computer of a subset of the FBI’s fingerprint records to search for pairs of very similar fingerprints taken from different sources. Finding such a pair would undermine the uniqueness proposition, see supra page 223, that the government’s other experts testified was well-established. The experiment data set was a set of fifty thousand prints (out of about 340 million in the FBI’s AFIS computer system). Bather than select these fifty thousand prints at random, the experimenters (Agent- Meagher, Mr. Zeisig, and Dr. Budowle) took them from the subset of prints that'were from white males and exhibited a left-sloped whorl pattern at Level 1' detail. The experimenters also ensured that multiple prints from the same person were included in the set of fifty thousand. . The effect of these, restrictions was to bias, from the outset, the prints toward being more similar (and hence more likely to contain a matching pair). In the first part of the test, a computer program-using the same algorithms as the FBI’s AFIS computer system uses to match prints-attempted to match each of the fifty thousand prints against the full set of fifty thousand prints (hence the moniker “50/50”). Thus, a total of 50,000 x 50,000, or 2.5 billion, comparisons were performed. For each print, the best match was, by an enormous margin, itself. Based on statistical extrapolation from these results, the experimenters put the chances of a single full-rolled print matching another full-rolled print from anyone in the world other than the person who deposited the print at approximately one in ten to the eighty-sixth power (i.e., 1 chance in 1 followed by 86 zeroes), a very low probability indeed. Apparently recognizing that analysis of full-rolled prints was not particularly germane to the question of the identification of latent partial prints, the government’s witnesses conducted a second experiment. From each of the fifty thousand prints, they had the computer create a simulated latent print (referred to as a “pseudolatent print” ’ or simply a “pseudolatent”), as might be recovered from a crime scene, by taking only about a fifth of the full-rolled print. They then ran a similar fifty thousand-by-fifty thousand comparison to see how strongly the pseudolatent prints matched full prints from which they had not been derived. With one exception which we identify in the margin, each pseudolatent was a strong match with the full print from which it had been derived, by a wide margin over any other full print. -Statistical computations based on this experiment put the probability of a latent partial print matching the full print of anyone in the world other than the person who deposited the print at approximately one in ten to the sixteenth power (i.e., 1 in 10,000,000,000,000,000), also a very low probability. b. Mitchell’s Experts Mitchell’s first witness at the Daubert hearing was Marilyn Peterman, an investigator with the Defender Association of Philadelphia who took statements from those fingerprint examiners at state agencies who had failed to match the latent prints to Mitchell’s ten-print card in completing Part B of the FBI’s survey. She described which agencies adhered to a point system, how many points they required to make an identification, and noted that the agencies that did not find a match generally reported that they had found an insufficient number of points of similarity between the latent print and the ten-print card. Ms. Peterman also reported on the varying levels of experience and accreditation of the examiners who performed the comparisons for the agencies. The first of Mitchelbs three major experts was Dr. David Stoney, the director of the .McCrone Research Institute in Chicago, a not-for-profit organization engaged in teaching and research in the forensic sciences. Dr. Stoney was, in Mitchell’s counsel’s words at the Daubert hearing, offered as -an--'expert “with respect to whether a fingerprint examiner’s conclusion that a latent fingerprint came from a particular individual is a scientific determination.” App. 763a. The nucleus of Dr. Stoney’s opinion is summarized in a portion of his testimony at the hearing: The determination that a fingerprint examiner ... makes when comparing a latent fingerprint with a known fingerprint, specifically the determination that there is sufficient basis for an absolute identification, is not a scientific determination .... It is a subjective determination without objective standards to it. Now, by “subjective” I mean that it is one that is dependent on the individual’s expertise, training, and the consensus of their agreement of other individuals in the field. By “not scientific” I mean that there is not an objective standard that has been tested; nor is there a subjective process that has been objectively tested. It is the essential feature of a scientific process that there be something to test, that when that something is tested, the test is capable of showing it to be false. App. 765a. Dr. Stoney opined that the evaluation phase of the ACE-V protocol requires the examiner to make a binary determination: Either two prints match sufficiently to make an absolute identification, or they do not. This Dr. Stoney contrasted to certain other forensic disciplines in which intermediate determinations are expressed in probabilistic terms. Dr. Stoney further objected to any characterization of fingerprint identification as having a “zero error rate,” explaining that “something with -a, zero error rate cannot be a science.... [I]f we start out saying fundamentally something can’t be shown to be wrong, then it means that we can’t test it. If we can’t test it, ... there’s no way to show that it is wrong.” App. 781a. Dr. Stoney also criticized the 50/50 experiment. He noted first the undisputed proposition that two impressions of the same friction ridges will , not be identical-artifacts and distortions will invariably appear. In that experiment, see supra page 225 and note 4, a fingerprint was compared against itself and 49,999 other fingerprints taken from the FBI’s database. Hence, Dr. Stoney explained, the. simulated task modeled by the 50/50 experiment was that of matching Print 1 and (the identical) Print 1 of Finger A. In his submission, the task in real-world fingerprint identification is one of matching Print 1 and Print 2 of Finger A. Thus, Stoney reasoned, the 50/50 experiment as executed assessed how much better a match is found between Print 1 and (the identical) Print 1 of Finger A than between Print 1 of Finger A and Print 1-of Finger B. A more meaningful version of the 50/50 experiment, Dr. Stoney explained, would have asked how much better a match is found between Print 1 and Print 2 of Finger A than between Print 1 of Finger A and Print 1 of Finger B. Dr. Stoney further criticized the method used to create the pseudolatent prints in the second part of the experiment. Dr. Stoney explained that it was established in the literature that simple masking, and even computer-generated blurring, of full prints cannot adequately simulate real latent partial prints. Dr. Stoney’s ultimate conclusion was that these experimental defects rendered the probabilities derived by the government experts meaningless. The defense’s second principal expert was James Starrs, a professor in the Department of Forensic Sciences and the law school at George Washington University. Prof. Starrs has had a long career at the intersection of law and forensic science; indeed, an article by Prof. Starrs was cited by the Supreme Court in Daubert. See Daubert, 509 U.S. at 591, 118 S.Ct. 2786 (citing James E. Starrs, Frye v. United States Restructured and Revitalized: A Proposal to Amend Federal Evidence Rule 702, 26 Jurimetrics J. 249, 258 (1986)). Prof. Starrs was offered as an “exert [sic] in forensic science qualified to provide an opinion as to whether latent fingerprint examination meets the criteria of science.” App. 813a-814a. Like Dr. Stoney, Prof. Starrs testified that it was his opinion that “[the current practice of] fingerprint comparison and analysis is not predicated on a sound and adequate scientific basis for purposes of making an individualization to one person from a fragmentary print to the exclusion of all other persons in the world.” App. 828a. To support his conclusion, Prof. Starrs highlighted five aspects of fingerprint examination that in his opinion were inconsistent with a scientific discipline: (1) claims to “absolute certainty”; (2) “the failure to carry out controlled empirical-data-searehing experimentation”; (3) a failure to engage in error-rate analysis; (4) the lack of uniformity, objectivity, systematization, and standards; (5) “a failure to show a due regard to a vigorous and uncompromising skepticism.” App. 828a-829a. In elaborating on each of these points, Prof. Starrs gave illustrations. For example, he briefly described a case of false identification; he described some of the subtle and non-systematized aspects of analyzing Galton points, see supra page 221-22, and he criticized some aspects of the training of new fingerprint examiners. Prof. Starrs also explained that he viewed the government’s testimony and experiments involving full-rolled prints as irrelevant to the question of latent partial print identification. However, under cross-examination Prof. Starrs was agnostic on whether the propositions he challenged as unproven might, in the end, be scientifically supportable. Mitchell’s final expert at the Daubert hearing was Simon Cole, a post-doctoral fellow at Rutgers University, with expertise in “science and technology studies with particular expertise regarding the fingerprint profession.” App. 939a. Dr. Cole had no experience in latent print examination. From his research, Dr. Cole identified four explanations for the widespread acceptance of fingerprint identification evidence: First, from the earliest days of the discipline, fingerprint examiners have developed an “occupational norm of unanimity,” i.e., examiners would not publicly disagree with one another about an identification. Second, in terms of the way in which the fingerprint examination community handled the instances of known misidentification, such cases would, Dr. Cole explained, be blamed on practitioner incompetence or misconduct. Third was a simple lack of judicial scrutiny-a sort of snowball effect of string citations to cases and treatises approving fingerprint identification evidence. Fourth was a lack of an organized counter-expert group, a notable difference, Dr. Cole explained, between fingerprint identification and, say, psychiatric diagnosis. Dr. Cole also opined that fingerprint identification was not scientific because, inter alia, the fingerprint identification community had not engaged in studies that attempt to falsify the discipline’s premises; did not engage in anonymous, critical (as opposed to positive) peer review; and did not recognize error rates. c. Mitchell’s Exhibits As part of the Daubert hearing, Mitchell also introduced several hundred pages of documentary exhibits, principally journal articles and other excerpts from the corpus of literature criticizing the practice and theory of latent fingerprint identification, authored by his experts and by others. Also introduced were the results of some fingerprint proficiency tests, which suggested that examiners were prone to both false negatives (i.e., declaring a noni-dentification where an identification should have been made) and false positives (i.e., making an incorrect identification). App. 3014a, 3063a. Finally, the defense introduced a survey of jurors that found that 93% agreed with the statement “fingerprint identification is a science” and 85% agreed with the statement “fingerprints are the most reliable means of identifying a person.” App. 3047a-3048a. d. The Government’s Rebuttal Witness To respond to defense testimony regarding the “occupational norm of unanimity” among fingerprint examiners, the government offered Pat Wertheim, a fingerprint examiner, as a rebuttal witness. Wer-theim testified that he and David Grieve (who was present but did not testify) were involved as defense experts in a case of false identification in the United Kingdom. Based on their examination of the evidence in that case-which was both independent of the U.K. authorities and independent of each other-they testified, in opposition to the prosecution’s expert, that the latent print in that case could not be matched to the defendant. The purpose of this testimony was to counter Dr. Cole’s contentions about the occupational norm of unanimity within the discipline. 3. The District Court’s Daubert and Judicial Notice Rulings Two months after the Daubert hearing concluded, the District Court ruled from the bench on the admissibility of expert testimony at trial. In relevant part, the Court stated: The matter presently pending before the Court is in reference to the defense motion to exclude the government’s fingerprint identification evidence, and based on the Daubert hearing and also Kumho, this Court denies the defendant’s motion. And pursuant thereto, this court is not going to make a determination as to the particular area of scientific knowledge and technical or specialized knowledge. Further, pursuant to this Court’s ruling, this Court finds that the government’s fingerprint evidence is highly probative and substantially outweighs any danger of unfair prejudice to defendant. •!* We find that the government’s expert witness-at this juncture it appears it’s Duane Johnson [sic Wilbur Johnson?], an FBI latent fingerprint examiner who testified first in the previous trial, and those other latent experts that testified in the Daubert hearing-are capable of testifying in these proceedings, and in that regard, I am not going to limit the defense from calling latent fingerprint experts to testify as to the ability not to identify or make an identification from the fingerprints, and I am also going to allow the defense to call any latent fingerprint expert who indicates that fingerprints are not reliable sources of information. Only for that limited purpose and I am going to exclude evidence as to whether or not [latent fingerprint identification is] scientific, technical, or whatever. It has no relevance before the jury here. The question is whether or not an identification can be made by examination of fingerprints-latent fingerprints. App. 1029a-1031a (repunctuated for clarity). As we understand the ruling, the District Court held that the government’s expert witnesses and Mitchell’s expert witnesses could testify, but with the caveat that the latter could not testify to the question whether latent fingerprint identification is a “science.” This ruling forms at least the baseline of two of Mitchell’s issues on appeal: the admission of government experts, and the restriction of his own experts. The Court again discussed the admissibility of the defense’s expert witnesses in a colloquy with counsel immediately before jury voir dire, an exchange that we will discuss in greater detail, infra Part IV. Immediately following its ruling on the admissibility of expert testimony, the District Court addressed what would become another ground of Mitchell’s appeal. Again -from the bench, the Court ruled: This Court will take judicial notice that human friction ridges are unique and permanent throughout the area of the friction ridge skin, including small friction ridge areas, and further that human friction skin arrangements are unique and permanent, and if called upon, we will instruct the jury as so.. App. 1031a (repunctuated for clarity). The Court so instructed the jury. On appeal, Mitchell asserts that it was error for the District Court to take judicial notice of these matters. C. Mitchell’s Second Trial 1. The Government’s Case The case against Mitchell rested on eleven lay witnesses and two experts. The government’s star witness was Bookie’s girlfriend, Kim Chester. Ms. Chester testified that she was present when Bookie and T were planning the robbery, and that she helped Bookie watch the comings and goings of the armored car in the weeks before the robbery. Ms. Chester said that she and T first met Mitchell and his wife at Mitchell’s house, where she heard Mitchell and T discussing plans for the robbery. Mitchell’s wife, Anita, invoked her spousal privilege and did not testify. Eileen Lambert, T’s girlfriend at the time, testified that she also witnessed meetings between T and Mitchell. . Ms. Chester testified that the night before the robbery, Mitchell, Bookie, and T discussed the need to obtain a stolen car to use in the robbery. She explained that the next morning-September 12th-Bookie, T, and Mitchell drove her to work. She described how Mitchell and Bookie were arguing about what car to use in the robbery-the car they were in was Mitchell’s wife’s car, and he did not want to use it in the robbery. Ms. Chester testified that they dropped her off at her work, and that when she next spoke to Bookie, he indicated that they had gone through with the planned robbery. At that time, he had a substantial amount of cash, some of which he used to purchase a car and redeem several pieces of jewelry from a pawn shop. Alma Shaw testified about her ear being stolen the morning of September 12th. Emanuel Glover and Vernon Muse, the armored car guards, and Kim Kover-Ja-cobs, the check cashing agency manager, testified about the robbery itself. Messrs. Glover and Muse, both identified Ms. Shaw’s car as the getaway ear; also, a fragment of the getaway car’s license plate was noted by a bystander, Regan Wiggins, and this fragment was consistent with Ms. Shaw’s car’s license plate. Laura Barnett, a Philadelphia police officer, testified that she recovered Ms. Shaw’s car shortly after the robbery. It was found (with a bullet hole through the trunk) a few blocks from the check cashing agency. FBI Special Agent Donald Halfpenny testified that Ms. Shaw’s car had been secured by the Philadelphia police at the time he took control of it. Wilbur Johnson, an FBI fingerprint examiner whom the Court qualified as an expert, testified that in Ms. Shaw’s car he found, photographed, and preserved two latent fingerprints-one from the gearshift knob on the steering column, and one from the driver’s side door handle-that he later identified as matching Mitchell’s ten-print card as the right and left thumbs, respectively. Mitchell was arrested the afternoon of September 12th. Special Agent Kevin Mimm and Special Agent Daniel Murphy, both of the FBI, testified to the circumstances of the arrest. They explained how they had been conducting surveillance operations in Philadelphia as a result of a number of armored car robberies; Agent Murphy was in charge of these operations. Agent Mimm testified that while he was engaged in covert surveillance of Mitchell and tailing Mitchell’s ear, Mitchell began to flee; Mimm described how he chased Mitchell at high speed for several blocks, and was ultimately able to stop him. Mitchell was arrested, and $1400 in five and ten dollar bills was recovered from him. This currency was never identified, however, as having been part of the armored car delivery. Agent Meagher returned to testify at trial about many of the matters brought out by the government at the Daubert hearing. He discussed the embryology of friction ridge skin, the fingerprints of identical twins, and the biological basis for the permanence of fingerprints. He described how latent prints are left and how they are processed by examiners, and the various conclusions that examiners can draw from a comparison of prints. During Meagher’s testimony, the government invoked .the Court’s promise to take judicial notice of the uniqueness of small areas of friction ridge skin. The government also read a stipulation detailing some of the results of the survey that Meagher testified about at the Daubert hearing, and the prosecutor examined Meagher regarding the agencies that did not make a positive identification of the latent prints. Meagher then demonstrated to the jury in some detail his use of the ACE-V technique in matching the latent prints to Mitchell’s ten-print card. He stated definitively that the fingerprints from the beige car matched Mitchell’s ten-print card. Agent Johnson also stated definitively that he had matched the latent prints from the beige car to Mitchell’s ten-print card, though he did not give an in-depth demonstration to the jury as Agent Meagher did. 2. Mitchell’s Case and Cross-Examination of the Government’s Experts The entirety of Mitchell’s case was the testimony of individuals at state agencies who examined or supervised the examination of the latent prints sent by Agent Meagher in the survey. Specifically, Mitchell called thirteen latent fingerprint experts from nine states, all of whom were initially unable to identify one or both of the latent prints as belonging to Mitchell. Mitchell also cross-examined the government’s experts, Agents Johnson and Meagher. Cross-examination of Johnson concentrated on questions about his presentation to the jury of the fingerprints he matched-Johnson’s demonstrative exhibits identified only nine points of Level 2 similarity between the latent prints from the car and Mitchell’s ten-print card, despite Johnson’s and Meagher’s claims of a greater number of similarities. Through cross-examining Agent Johnson, Mitchell also probed the existence and maintenance of minimum-point standards and other quality-control measures at the FBI in particular, and in the discipline more generally. Cross-examination of Agent Meagher ranged into more general considerations, most notably the limited studies performed specifically to establish an error rate for fingerprint identification, and the limited means for detecting errors in particular examinations. Meagher was also cross-examined on his highly suggestive followup communications to those state agencies that did not match Mitchell’s prints in the survey. D. Withholding of the NIJ Solicitation and Mitchell’s Post-Trial Motion On February 7, 2000, the jury returned a verdict of guilty on all counts. Mitchell’s May 15, 2000 motion for a new trial pursuant to Fed.R.Crim.P. 33 was founded on the discovery of a research proposal solicitation released by the National Institute of Justice (an arm of the United States Department of Justice) entitled Forensic Friction Ridge (Fingerprint) Examination Validation Studies (the “solicitation”). The solicitation sought proposals for research studies on “validation of the basis for friction ridge individualization and standardization of comparison criteria.” App. 3078a. Creation of the solicitation had been underway before Mitchell’s trial, but the solicitation was not released until March 2000-after Mitchell’s trial had concluded. The District Court held a four-day hearing to take testimony and receive exhibits on the creation and import of the solicitation. At that hearing, Mitchell established that Agent Meagher (as well as some of the government’s other witnesses at the Daubert hearing) had been involved in drafting the solicitation. Prof. Starrs testified that he regarded the solicitation as “a bolt out of the blue” that suggested to him “that the sponsors of the solicitation ... admitted ... [to] serious shortcomings in fingerprinting as it has been done up to this time.” App. 2325a. Moreover, Mitchell suggested that even the government regarded the solicitation as material. His most damaging evidence came from Dr. Richard Rau of the NIJ, who coordinated the drafting of the solicitation. Rau testified to conversations at a September 1999 meeting among himself, Donald Kerr (the Assistant Director of the FBI in charge of the FBI crime laboratory), David Boyd (the Deputy Director of the NIJ), and others. Rau claimed that at that meeting Kerr and Boyd agreed to withhold release of the solicitation until the end of Mitchell’s trial. In response to Dr. Rau’s testimony, the government called Kerr, Boyd, and the other individuals at the meeting to testify that Dr. Rau’s account of the delay in releasing the solicitation was incorrect and that the delay was caused by budgetary issues. The District Court denied Mitchell’s motion, reasoning that the solicitation was not material for two independently sufficient reasons: First, the solicitation would not have been admissible at trial because attacks on the reliability of latent fingerprint identification were not permitted at trial based on the Court’s Daubert ruling; and second, the solicitation was “not meant to set forth the state of the current research” and so its “claimed impeachment value ... either during the trial or for Daubert purposes is questionable at best.” App. 12a-13a. On appeal, the government disclaims the first ground, but defends the District Court’s ruling on the second ground, as well as on alternative grounds not reached by the District Court. E. This Appeal The District Court had jurisdiction over this ease under 18 U.S.C. § 3231. Mitchell filed a timely appeal from the final judgment of conviction and sentence, and we have jurisdiction under 28 U.S.C. § 1291. On appeal, Mitchell asserts that the District Court committed five errors. First, he challenges the District Court’s ruling following the Davhert hearing that admitted the prosecution’s expert testimony on fingerprint identification. Second, Mitchell claims that the District Court erred in precluding his experts from testifying at trial that fingerprint identification is not a science, and is otherwise unreliable. Third, Mitchell finds error in the District Court’s decision to take judicial notice of the uniqueness of small areas of friction ridge skin. Fourth, Mitchell contends that the government’s withholding of the NIJ solicitation, which could have been used as impeachment evidence, merited a new trial under Fed.R.Crim.P. 33, or that this nondisclosure violated the government’s obligation under Brady v. Maryland, 373 U.S. 83, 83 S.Ct. 1194, 10 L.Ed.2d 215 (1963). Fifth, Mitchell asserts that the District Court improperly admitted hearsay in the testimony of the government’s principal lay witness, Ms. Chester. We will address each of these contentions in turn. III. Admissibility of the Government’s Expert Testimony A. Standard of Review The parties disagree about the standard of review we should apply in evaluating the District Court’s decision to admit the government’s expert testimony. It is well-settled that, as a general matter, we review a district court’s decision to admit expert testimony for abuse of discretion. See In re TMI Litig., 193 F.3d 613, 666 (3d Cir.1999). We exercise plenary review, however, over a district court’s legal interpretation of Fed.R.Evid. 702, under which the evidence in question was admitted. See id. On this much the parties agree. Disagreement arises about the standard of review where, as here, the District Court made no findings of fact to support its admission of the testimony; indeed, after the lengthy Daubert hearing, the District Court elected not to make findings of fact or conclusions of law (written or oral), and simply ruled from the bench. This absence of factual findings, Mitchell contends, requires plenary review. We reject the rule that Mitchell urges for four reasons. First, Mitchell has provided no precedent for such a heightened standard of review over a field historically committed to the sound discretion of district courts. Second, the exception that Mitchell proposes would swallow the rule that district courts’ evidentiary rulings are generally reviewed only for abuse of discretion. The vast majority of eviden-tiary rulings are made on-the-fly and without written findings of fact, yet this Court routinely affords deference to such judgments. Third, Mitchell’s argument misconceives the rationale for using a deferential standard of review. Deferential review is employed not because the court being reviewed labored to produce a long opinion-there are lengthy but incorrect opinions just as there are brief but sagacious ones. Rather, deferential review is used when the matter under review was decided by someone who is thought to have a better vantage point than we on the Court of Appeals to assess the matter. See Ruggero J. Aldisert, The Judicial Process 728-29 (2d ed.1996) (quoting Maurice Rosenberg, Judicial Discretion of the Trial Court, Viewed from Above, 22 Syracuse L.Rev. 635, 663 (1971) (“[P]roba-bly the most pointed and helpful [reason] for bestowing discretion on the trial judge is [that] .... he sees more and senses more [than the Court of Appeals].”)). This case is a good example: The District Court assessed extensive live testimony, while we work from a cold record. Fourth, the Supreme Court has in other contexts rejected heightened appellate review of district court rulings on expert testimony. See Gen. Elec. Co. v. Joiner, 522 U.S. 136, 118 S.Ct. 512, 139 L.Ed.2d 508 (1997). Thus we reject Mitchell’s proposed standard of review, and adhere to the usual precepts of abuse-of-discretion review over the District Court’s decision to admit the government’s expert testimony. B. Standard for Admissibility under Rule 702 The pathmarking Supreme Court cases interpreting Fed.R.Evid. 702 are Daubert v. Merrell Dow Pharmaceuticals, Inc., 509 U.S. 579, 113 S.Ct. 2786, 125 L.Ed.2d 469 (1993), and Kumho Tire Co. v. Carmichael, 526 U.S. 137, 119 S.Ct. 1167, 143 L.Ed.2d 238 (1999). The version of Rule 702 in effect at the time of the Daubert hearing and the trial provided: If scientific, technical, or other specialized knowledge will assist the trier of fact to understand the evidence or to determine a fact in issue, a witness qualified as an expert by knowledge, skill, experience, training, or education, may testify thereto in the form of an opinion or otherwise. Daubert identified the twin concerns of “reliability” (also described as “good grounds”) and “helpfulness” (also described as “fit” or “relevance”) as the “requirements embodied in Rule 702.” Daubert, 509 U.S. at 589-92, 113 S.Ct. 2786. Daubert was “limited to the scientific context because that [wa]s the nature of the expertise offered [t]here,” id. at 590 n. 8, 113 S.Ct. 2786, but Kumho Tire extended Daubert’s “general principles” to all of “the expert matters described in Rule 702.” Kumho Tire, 526 U.S. at 149, 119 S.Ct. 1167. Thus “technical knowledge,” under which heading the discipline of latent fingerprint examination and identification seems to fall, is generally subject to the same considerations as “scientific” expertise. The “general principles” adverted to in Kumho Tire comprised not only the fundamental concerns of reliability and helpfulness, but also a method for assessing reliability. The Daubert Court articulated “general observations” to this end by offering a nonexclusive list of five factors that a district court might consider in deciding whether to admit evidence under Rule 702. The Advisory Committee summarized these factors: The specific factors explicated by the Daubert Court are (1) whether the expert’s technique or theory can be or has been tested-that is, whether the expert’s theory can be challenged in some objective sense, or whether it is instead simply a subjective, conclusory approach that cannot reasonably be assessed for reliability; (2) whether the technique or theory has been subject to peer review and publication; (3) the known or potential rate of error of the technique or theory when applied; (4) the existence and maintenance of standards and controls; and (5) whether the technique or theory has been generally accepted in the scientific community. Fed.R.Evid. 702 advisory committee’s note. Citing Kumho Tire, the Advisory Committee noted that “[ojther factors may also be relevant,” id., and indeed, courts have augmented this list. In Paoli II we drew on Daubert and our earlier decision in United States v. Downing, 753 F.2d 1224 (3d Cir.1985), to lay out an expanded list of factors: (1) whether a method consists of a testable hypothesis; (2) whether the method has been subject to peer review; (3) the known or potential rate of error; (4) the existence and maintenance of standards controlling the technique’s operation; (5) whether the method is generally accepted; (6) the relationship of the technique to methods which have been established to be reliable; (7) the qualifications of the expert witness testifying based on the methodology; and (8) the non-judicial uses to which the method has been put. Paoli II, 35 F.3d at 742 n. 8. These factors address only reliability, and not “helpfulness” or “fit.” But the fit inquiry in the case of fingerprint identification is not a significant factor, because identity evidence is the archetypal relevant evidence in criminal cases. Thus, the analysis that follows only addresses the reliability prong of Daubert. C. Application of Daubert Factors to Government’s Expert Testimony 1. Testability We first consider whether the premises on which fingerprint identification relies are testable-or, better yet, actually tested. “Testability” has also been described as “falsifiability.” See, e.g., Daubert, 509 U.S. at 593, 113 S.Ct. 2786 (citing Karl R. Popper, Conjectures and Refutations: The Growth of Scientific Knowledge 37 (5th ed.1989)). A proposition is “falsifiable” if it is “capable of being proved false; defeasible.” Webster’s Third New International Dictionary 820 (unabridged ed.1966). Proving a statement false typically requires demonstrating a counterexample empirically-for instance, the hypothesis “all crows are black” is falsifiable (because an albino crow could be found tomorrow), but a clairvoyant’s statement that he receives messages from dead relatives is not (because there is no way for the departed to deny this). In this case, the relevant premises were posed as explicit questions to many of the government experts: (1) Are human friction ridge arrangements unique and permanent? and (2) Can a positive identification be made from fingerprints containing sufficient quantity and quality of detail? The government’s experts responded in the affirmative. We must consider not whether we agree'as a factual matter with their responses, see Paoli II, 35 F.3d at 744, but rather whether these hypotheses are testable (or tested). We conclude that they are. Consider the first premise (which is really two hypotheses in one)-that human friction ridge arrangements are unique and permanent. The uniqueness proposition is testable because it would immediately be shown false upon the production of identical friction ridge arrangements taken from different fingers (either from different fingers on the same person, or from two different people). The uniqueness proposition has also been tested in several ways: First, the full-print matching portion of the FBI’s 50/50 experiment tested it and found no true matches. Second, studies on identical twins (testified about by Agent German) showed unique fingerprints. While this is a small sample, there are independent and solid genetic grounds for believing that if identical friction ridge arrangements are to be found, they are most likely to be found in identical twins. Third, in the course of routine fingerprint examination, there are certainly opportunities to encounter identical fingerprints; as several witnesses testified, such a discovery would be very notable and word would spread quickly throughout the fingerprint examiner community. Yet no reports of non-unique friction ridge arrangements were introduced, and, indeed, the FBI survey sent to state agencies revealed that none had ever encountered two different persons with the same fingerprint. Joint Supp.App. at 55. The permanence component of the first hypothesis is also easily testable-simply take fingerprints from an individual at one time and compare them to the prints taken at another time. The Daubert hearing did not provide much evidence of actual testing of this hypothesis, however. We turn next to the testability of the second hypothesis-that positive identification can be made from fingerprints containing sufficient quantity and quality of detail. Much of the debate in this case is masked by the word “sufficient.” For example, a sufficiency standard of “100 points of matching Level 2 detail in an undistorted fingerprint lifted from a clean, smooth surface” would surely attract less objection than a sufficiency standard of “four points of matching Level 2 detail and passable quality.” The actual standard employed by any given FBI examiner falls somewhere between these extremes, yet the FBI’s reliance on an unspecified, subjective, sliding-scale mix of “quantity and quality of detail” makes meaningful testing elusive, for it is difficult to design an experiment to test a hypothesis with unspecified parameters. Two things rescue fingerprint identification from this apparent failure of testability: First, the examiner can testify to how much detail (quantitative and qualitative) was necessary for the particular identification at issue; and second, any testing directed toward fal