The market for higher-end coffee just can’t catch a break.