Failure of quasi-isometric rigidity for infinite-ended groups

We prove that an infinite-ended group whose one-ended factors have finite-index subgroups and are in a family of groups with a nonzero multiplicative invariant is not quasi-isometrically rigid. Combining this result with work of the first author proves that a residually-finite multi-ended hyperbolic group is quasi-isometrically rigid if and only if it is virtually free. The proof adapts an argument of Whyte for commensurability of free products of closed hyperbolic surface groups.