Combine pudding mix and sweetener in a large bowl. Gradually add fat-free milk and evaporated milk, stirring with a whisk until smooth. Stir in marshmallows, chocolate, and 1/4 cup peanuts.
Sprinkle 3 tablespoons peanuts evenly among 12 plastic holders.
Pour pudding mixture into holders, and add sticks. Freeze 3 hours or until firm.