Our process begins with wearing all of the jackets in the field, having the same kind of adventures that you will be having (badass ones!), all while evaluating each model, noticing what works and what doesn't. Often we will wear two or more contenders on the same adventure to compare them, and we love to lend out our test products for others to try. Their feedback helps confirm ours. In all cases, we strive to produce a comparison review.
This means that there is no standard against which we test all these jackets, the jackets themselves are the standard. All scores and opinions discovered through our testing are expressed to you in comparison to the other competing products in the review. However, to make the best comparisons that we can, we often expand upon our field testing to conduct side-by-side controlled tests, which are described below.
Most of our testing for this metric was conducted on adventures in the field, but to get the best idea of exactly which jackets are the warmest, we wore each of them outside, with nothing underneath but a t-shirt, on a frigid, breezy 15-degree morning in the shade. Since these jackets are ideal as stand alone garments to around 32F, testing them in much colder conditions helped us understand which jackets we felt warm in, while others allowed the cold to creep in.
To accurately compare weight, we measured each jacket on our independent scale immediately upon taking it out of the package. In instances where stuff sacks were included in the purchase, we included them in the overall weight of a jacket.
To test these jackets for water resistance, we waited until the end of our testing period, so we could get a better idea of which products had a more durable DWR coating. We then tested them head-to-head by spraying them with a misting spray bottle, all over, to get an idea of how well the DWR coating performs in a drizzle or light rain. Next, we soaked them all thoroughly in the shower, to test the efficacy, or not, of treated hydrophobic down. However, this test did not yield usable results, and so for this metric, we graded based on the performance of the DWR and gave bonuses to those jackets that had special features and hydrophobic down.
To assess for fit, we had numerous people wear each jacket and give their opinions and feedback. We also wore them side-by-side, noticing the differences in fit for each. In particular, we paid special attention to the length of sleeves and hemlines, and whether any constrictions were felt in the shoulders, upper back, and chest, especially when moving the arms to the sides and overhead. We tested each jacket with layers on beneath it, as well as under a shell jacket.
To test for compressibility, we stuffed each jacket into its provided stuff sack or pocket and then compared the size of each. In instances where a jacket did not come with a method for compressing it, we simply rolled it up into its hood. Jackets that packed down the smallest received the highest scores, while jackets that did not have a method of compression or packed down large received lower scores.
Most of our testing of features took place in the field. We first identified what features each jacket possessed and then set about testing each of them. Jackets with highly functional features scored better than jackets with features that didn't work as well.