We buy each model, do any assembly necessary, and start a weeks-long testing period for each bike. Each bike gets at least 90 miles of riding, and the bikes we like get significantly more. We use them as our commuter bikes for real-world testing and perform a series of tests to tease out their differences. Our six metrics represent the chief areas of performance we look at to assess and score each product. Below, we discuss how we assess each metric.
Ride
What we try to capture in our ride quality metric is how enjoyable the bike is to ride. To evaluate this, we gather data by spending time riding each model around town as a daily commuter bike and conducting some specific tests. We assessed different factors, including comfort, handling, and stability, and included the bike included features. To test the handling, we ride each bike through a test course of cones and evaluate each bike's turning radius and steering feel. We compare the bike's stability when it's unladen and when it's loaded to its maximum carrying capacity. To evaluate the brakes, we measure how quickly the bike decelerates and how smoothly the brakes operate. Generally, hydraulic brakes are smoother and more powerful than their cable-actuated counterparts. The additional stopping needs of cargo bikes will often require larger brake rotors or calipers with additional pistons to support longer brake pads.
We look at the height adjustment range of each bike and measure the bike's top tube heights to score how easy it is to mount and dismount the bike. We note the width of the handlebars, the comfort of the grips and saddle, and the seated body position. We measure each bike and check its geometry against the manufacturers' charts. We measure the angles of the frame and chart them for comparison. We use each feature and ensure it functions properly before endorsing it. All these assessments culminate in the score for this metric.
Range
To test this metric, we fully charge each bike and use the same low-traffic course with the same rider to ensure weight difference does not come into play. We weigh our test rider prior to the start and add weight to a backpack to achieve an even starting point for each test. We ride the test course non-stop until the motor dies completely. The ride data is collected and stored using the Strava mobile app, which records distance traveled, average speed, time, and elevation gain. We only use the throttle during the test to remove the variability of the rider's pedaling effort. However, there is no throttle if the bike is a Class 1 e-bike. In this case, we pedal at a consistent, moderate effort until the battery power ceases. To test the Class 1 bikes, we use Garmin's power meter pedals and 805 head unit so we can constantly monitor the amount of pedal input and strive for an even 100 watts, which is enough to trigger the cadence or torque sensor.
Power
Our power metric combines acceleration, top speed, and uphill power output. To measure acceleration, we time how long it takes for the bike to go from a complete stop to its top speed, while using the throttle on flat, open pavement. To confirm top speeds, we max out the bike and use the Strava mobile app in conjunction with the onboard speedometer on the display. For testing uphill power output, we use the same hill near the GearLab headquarters and observe maximum uphill speed and how much it slows down in the steepest section. These measurements are performed using the same size and weight test rider without carrying any extra cargo. If our test rider weighs less at the time of testing, we add weight to a backpack or fanny pack. To quantify the results of our experiential testing we also put our electric bikes on a dynamometer to measure the amount of torque and power delivered to the wheel. These figures are significantly less than the numbers published by manufacturers, but our testing numbers account for drivetrain efficiency loss and give us real comparative data. The power and torque figures that we publish are “at the wheel” measurement and capture the actual performance of the bike as a whole.
While assessing the pedal assistance modes, we look at the number of modes, how well they work, and how much speed increases from one mode to the next. We check their acceleration, noting jumpy starts that might throw the rider off balance or a power band that feels unnatural. This is more common on bikes with cadence sensors than torque sensors. We note how much of a pedal cycle is needed before the assistance kicks in and how much effort it takes from the rider to reach the top pedal-assist speed.
Cargo Carrying
For this metric, we check the manufacturer's claimed weight capacity, looking at the total weight and the weight the racks can support. We then measure the size of the cargo rack. We pack boxes and weigh down each bike with its maximum capacity to see how it affects the handling and stability of the bike. In order to load to capacity, it often involves packing significant weight into a backpack to give the bike a maximum weight rider and maximum cargo weight. Finally, we research what additional add-on items the manufacturer offers to maximize carrying capabilities, paying special attention to kid seats and other convenient cargo accessories.
Interface
This metric assesses the quality of the onboard power controls and the display screen. We manipulate the controls while riding to see if they negatively affect our riding ability. We check for intuitive buttons and controls that do not have a big learning curve and do not distract the rider. We toggle through all the display settings and ensure that the data on the screen is readable at a glance. We use the remote with gloves to see how easily it can be used in cold weather. If an app integrates with the bike and displays, we download and test it. We also ensure that removable batteries come off the bike easily for off-bike charging and can be locked into place on the bike for security. We weigh all the batteries, looking for differences in power densities for different battery chemistries, and note when a bike without a battery may be light enough to fit on a bike rack.
Assembly
We assemble any bike that doesn't come pre-assembled ourselves. In the case of these cargo bikes, they all arrived at our warehouse in bike boxes, with the exception of the Bunch Cargo bike that arrived in a crate like a circus animal. We unbox the bike and see if it can be done as a single-person job and whether the included tools are sufficient for the job. We watch tutorial videos and read and follow instructions until the job is complete. We time the entire process and compare how challenging it is to assemble each bike. We list the challenges and rate the difficulty with each bike. Some of the bikes we have tested have come impressively close to being fully assembled right out of the box. Users who are unsure of their mechanical aptitude are encouraged to watch the assembly videos and decide if utilizing a bicycle shop is the right idea.
