
Sellers are taking to the Etsy forums to express their concerns about a new top seller program called Etsy Star Seller. With the new program, Etsy will determine whether a seller qualifies as a "Star Seller" based on their response rate to buyers' first message; shipping with tracking within stated handling processing time (digital orders excluded); and 5-star ratings.
Sellers must also meet certain minimum criteria, including having at least 10 orders and $300 in sales within the 3-month review period.
Etsy will award sellers who qualify with a Star Seller badge to set them apart from other sellers.
One seller (chainofbeauty), an analyst who had researched and evaluated many programs for 25 years, called the new program "poorly designed" and said he would like Etsy to reconsider its decision to launch it.
The analyst, also an award-winning jewelry maker, wrote, "It is clear to me that in designing this system, Etsy did not employ statisticians or research scientists."
He then proceeded to explain flaws he said showed how the program does not determine whether or not a seller has good customer service.
For example, he said not all delivery methods generate a tracking number, and not all products are worth tracking. "So, while this is a good indicator that any particular product will be delivered, you cannot use the absence of a tracking number to indicate that the product will not be shipped or shipped on time."
Another problem he pointed to was how Etsy measured sellers' responsiveness to buyers:
"Replying to buyers' messages about a product will demonstrate the seller's responsiveness to buyers. It's a good metric. However, for this metric to be used, you would have to separate messages that merit a response from those that do not. If you cannot do that, then you cannot use this metric. By applying it to all messages without differentiating messages needing a response from those that don't, the measure is not valid."
One of his concerns was echoed by other sellers when he wrote, "I expect that this system will eventually affect search ranking and be a search filter. Yet, to judge sellers based on invalid an unreliable processes, and then to hurt their sales potential based on the results, is both unconscionable and unethical."
Etsy provided sellers with an opportunity to ask questions about the new program on
this thread on the discussion boards, which generated 3,956 replies. Etsy will answer "as many questions as possible" on Friday, August 6th by 5pm ET.
Etsy also explained the metrics used in its program on the
Seller Handbook. Let us know if you think the Star Seller program accurately measures the quality of a seller's customer service.