 The spices don't blend right. The nutmeg and the cinnamon and the ginger don't work right without sugar. It blends the flavors. Your sugar source is your coloring for the cake. Beyond just the sweetness, the flavoring of it is reliant on that sugar-containing substance. And how do you get that flavor without the sugar?