Preheat oven to 400 degrees.
Pour hazelnuts onto a rimmed cookie sheet. Pour almonds onto a separate rimmed baking sheet. Roast nuts for 10 to 15 minutes, giving them an occasional stir, until they are brown and toasted and your kitchen smells buttery.
Remove from oven and let cool. Pour hazelnuts onto a large towel, wrap the towel around the nuts and rub briskly to remove the hazelnut skins. It’s a pain but it must be done. You don’t have to get them perfectly skinned. Pour the hazelnuts into a large bowl, take the towel outside or over to your compost pile and shake it free of all the bits of hazelnut skin.
Reduce oven temperature to 300 degrees.
Using 1 tablespoon of the vegan butter, generously the insides and bottoms of 2 8-inch cake pans. Line cake pan bottoms with rounds of parchment paper. Grease the parchment with vegan butter.
Add almonds to the hazelnuts, along with the chopped figs and apricots, diced citron grated lemon and orange zest. Give everything a stir to combine.
In a small bowl, sift together unbleached flour, cocoa and all the spices — cinnamon, nutmeg, ginger, clove and pepper. Pour into the bowl of fruit and nuts, stirring well, so fruit and nuts are well-coated with flour, cocoa and spices.
In a medium saucepan, heat the remaining 2 tablespoons of vegan butter over medium-high heat. Pour in the evaporated cane sugar . Lightly oil the measuring cup and measure out the vegan honey or brown rice syrup (it will pour out easier this way — you will thank me). Pour that in with the butter and sugar, stirring well with a wooden spoon.
Stir until sugar dissolves and mixture looks caramelly. Bring to a boil and continue stirring, another 7 to 10 minutes, or until the sauce reaches hardball stage (250 degrees on a candy thermometer).
Pour sauce over the fruit and nuts and, using a wooden spoon, stir like your life depends on it. The mixture will start to seize up. Keep going until everything coalesces into a very thick batter. Upper arm strength is good to have here. Maybe that’s another reason they call it panforte.
Spoon batter into the two prepared cake pans, using the spoon to smooth everything evenly.
Bake for 50 minutes or up to 1 hour. You’ll know panforte is ready when your ktichen smells like nutella heaven and the tops of the cakes are dry and just starting to firm up. Remove from oven and let cool completely — at least an hour.
Run a sharp knife around each cake and invert onto a plate or another sheet of parchment. Peel away any parchment that stuck to the bottom.
Dust with powdered sugar or more cocoa.