How Soundmali Tests Wireless Earbuds & Headphones
How We Test Audio Products
Every wireless earbud and headphone recommendation at Soundmali is evaluated against a structured testing protocol developed in collaboration with professional sound engineers. No brand pays for placement or higher ratings. Our methodology is published here so you can judge our recommendations accordingly.
Our 7-Category Evaluation Framework
1. ANC Performance
ANC is evaluated in three environments: (a) open-plan office with calibrated 72dB ambient noise, (b) simulated subway/train environment at 85dB broadband noise, (c) high-frequency street noise at 80dB. We measure perceived noise reduction subjectively and cross-reference with published lab data from RTings.com where available. ANC effectiveness is reported as an estimated dB reduction range, not a single number, to account for frequency-dependent variation.
2. Sound Quality
Sound quality is evaluated using a consistent test playlist across five genres: orchestral (frequency extension), electronic (bass definition), acoustic guitar (midrange clarity), vocal (vocal presence and sibilance), and jazz (soundstage). We assess: sub-bass extension below 80Hz, mid-bass punch versus bleed, midrange clarity, treble detail without harshness, and stereo width. Default EQ is used for all comparisons unless specified.
3. Battery Life
Battery life is measured at 70% volume with ANC enabled, using continuous music playback. This represents typical usage conditions rather than manufacturer-favorable test conditions (which often use lower volumes without ANC). Results are recorded in 30-minute intervals until the unit shuts down. We also test the 10-minute quick-charge claim by measuring playback duration after exactly 10 minutes of charging from 0%.
4. Call Quality
Call quality is assessed in two conditions: (a) quiet indoor environment, (b) 75dB ambient noise environment (coffee shop equivalent). We evaluate microphone clarity, wind noise rejection, and background noise suppression. Test calls are recorded and assessed by a third evaluator who was not present during the call, reducing subjective bias. Results are rated on a 5-point scale per condition.
5. Fit & Comfort
Fit is evaluated across three activity types: seated office use (2h continuous), commute simulation (walking, stairs, bus), and gym activity (light cardio, bodyweight exercises). We test all included ear tip sizes and report which size was used. Comfort ratings are based on a 2-hour continuous wear session. For gym use, we specifically test fit stability during jumping exercises.
6. Ecosystem Integration
We test primary phone compatibility (the manufacturer's intended ecosystem) and secondary compatibility (cross-platform use). For AirPods: tested on iPhone 16 Pro and Samsung Galaxy S25. For Samsung earbuds: tested on Galaxy S25 and iPhone 16 Pro. Features available only on the primary platform are clearly labeled. Codec support is verified against the manufacturer's published spec, not manufacturer claims.
7. Value Assessment
Value is assessed relative to the product's direct competitors at launch pricing. We consider: performance per dollar versus alternatives in the same price tier, feature set completeness, build quality longevity, and firmware support history. A product can score highly on individual metrics but receive a lower value rating if equivalently-performing alternatives exist at a lower price point.
Our Rating Scale
| Score | Meaning | Example |
|---|---|---|
| 9.5–10 | Class-leading, no meaningful weakness | Sony WF-1000XM6 ANC |
| 8.5–9.4 | Excellent, minor weaknesses only | AirPods Pro 2 overall |
| 7.5–8.4 | Good, notable trade-offs versus competition | Budget earbuds with basic ANC |
| Below 7.5 | Below expectations for price tier | Not carried at Soundmali |
What We Do Not Do
- Accept payment from brands for reviews, placement, or ratings
- Test products in artificially favorable conditions to match manufacturer claims
- Publish reviews without disclosing how the product was obtained
- Award scores based on brand prestige rather than measured performance
- Carry products that do not meet our minimum quality standards regardless of margin
Data Sources We Use
- RTings.com — objective frequency response measurements, ANC measurements
- Head-Fi community — long-term ownership reports, firmware change observations
- Manufacturer specification sheets — FCC filings, published technical data
- Soundmali internal evaluation — subjective listening, comfort, and ecosystem tests
We also publish a dedicated fragrance testing methodology — covering our 7-day longevity protocol, projection measurement, and authenticity verification process.