Methodology
How Firsthand Tech Ranks and Reviews Products
Firsthand Tech's methodology in brief
Firsthand Tech scores every product on five published, fixed-weight criteria: Performance (30%), Value (25%), Reliability & Security (20%), Ease of Use (15%), and Support (10%). Crucially, Firsthand does NOT operate a hardware or audio lab: we do not run independent benchmarks and we do not conduct hands-on performance, audio, or battery testing. Every rating is built from analysis of primary documentation — manufacturer-published specification sheets, official pricing pages, official security and audit documentation (SOC 2, ISO 27001, FedRAMP), FCC filings, and publicly documented third-party audits and certifications. Because specs and prices change, every number is cited to a primary source with an "as of" date; where a figure cannot be verified we describe it qualitatively or omit it rather than guess. Manufacturer-rated figures are reported as manufacturer-rated, never as measured results, and we never present a subjective quality judgment as if it came from testing we did not do. Firsthand Tech is reader-supported and may earn affiliate commissions, but that compensation never changes a score or a ranking. Every review lists at least one genuine con and is editorially fact-checked against its cited sources before publication.
Technology reviews are only as trustworthy as the evidence behind them, so we are explicit about ours. Firsthand Tech does not operate a hardware lab: we do not run independent benchmarks, and we do not conduct hands-on audio, battery, or performance testing. Instead, every rating is built from analysis of primary documentation — manufacturer-published specification sheets, official pricing pages, official security and audit documentation, FCC filings, and publicly documented third-party audits and certifications. Because specs and prices change, every number in our reviews is cited to a primary source with an 'as of' date, and where we cannot verify a figure we describe it qualitatively or omit it rather than guess. We never present a subjective judgment as if it came from testing we did not do.
The five scoring criteria
| Criterion | Weight | What we evaluate |
|---|---|---|
| Performance | 30% | Assessed from manufacturer-published specifications and documented capabilities — processors and silicon, battery ratings, noise-cancellation and connectivity claims, storage and throughput figures — not from independent lab benchmarks. We report manufacturer-rated figures as manufacturer-rated, cite them to the official spec sheet with an as-of date, and never present a subjective quality judgment as a test result. |
| Value | 25% | Official price versus what comparable products deliver for the money, always cited to the manufacturer's or company's official pricing page with an as-of date. Free tiers, subscription costs, bundled features, and recurring fees are weighed against alternatives that provide the same benefit; opaque or fast-rising pricing lowers the score. |
| Reliability & Security | 20% | For software: documented security posture — encryption, zero-knowledge architecture, and independent third-party audits or certifications (SOC 2, ISO 27001, FedRAMP) read from official documentation. For hardware: build and durability signals such as manufacturer water/dust (IP) ratings and warranty terms. We credit only what is documented, never assumed. |
| Ease of Use | 15% | Setup friction, platform and cross-device availability, and how much of the advertised experience works without a specific phone or ecosystem — all drawn from official documentation and platform/availability listings. Ecosystem lock-in that gates advertised features to one vendor's devices lowers the score. |
| Support & Warranty | 10% | Published warranty length, documented return and refund policies, the breadth of official support channels, and update/security-patch commitments where the company states them. Clear, generous, and well-documented support scores highest. |
We analyze documentation — we do not run a lab
This is the most important thing to understand about our tech ratings: Firsthand does not conduct independent lab testing. We do not benchmark processors, we do not measure noise cancellation or audio quality, and we do not run our own battery-drain tests. Any site that claims a "best sound we heard" verdict is describing a hands-on test; we are not, and we will not present a rating as if we did one.
Instead, Performance and the other criteria are assessed from primary documentation: manufacturer specification sheets, official pricing pages, published security and audit reports, FCC equipment filings, and standards-body publications. When a manufacturer rates a battery at "up to 8 hours," we report it as a manufacturer-rated figure and cite the official source with an "as of" date — we do not restate it as a measured result. Where a claim cannot be verified from a primary source, we describe it qualitatively or leave it out. We never invent a specification, a benchmark, or a test result.
Independence: how compensation never touches the scores
- We review products we don't earn from. Category rankings include products with no affiliate relationship. If the best product in a category pays us nothing, it still ranks where the rubric puts it.
- Rankings are never sold. No company can pay for a position, a score, or a favorable sentence. There are no "sponsored" slots inside our rankings.
- Affiliate commissions never change scores. Scoring is completed against the rubric before monetization is considered. Read our full affiliate disclosure.
- Every review lists at least one genuine con. If we recommend a product, we also tell you where it falls short — ecosystem lock-in, a subscription cost, a shorter battery rating, or a missing feature.
- Every review is editorially fact-checked. Our editorial team checks each figure against its cited primary source before a page is published. Firsthand does not run a lab; this is documentation analysis and editorial fact-checking, not a hands-on test. See our editorial policy.
- Pages carry as-of dates. Specs and prices change. Each ranking and review shows when it was last updated and dates every figure that can change, and we re-check pages when a spec, price, or model changes.
What a score means
Each criterion is scored 0–10 against the rubric above, multiplied by its weight, and summed into a final score out of 10. Products in the same category are scored against the same rubric, so scores are directly comparable within a ranking. A high score is not a guarantee of quality — it means the product looked strong, on its documented specifications and official pricing, on performance, value, reliability and security, ease of use, and support relative to its competitors. This content is informational only and is not professional advice; verify current specifications and pricing on the manufacturer's official page before purchasing.