In a medium mixing bowl, cream the softened cream cheese with a wooden mixing spoon or electric mixer so there are no lumps.
Add the brown sugar and vanilla and stir well until there is no graininess left from the brown sugar.
Chop nuts in a food processor until finely ground. Keep 1 Tablespoon separate and add the rest of the nuts into the cream cheese mixture. Stir until evenly mixed.
Pour dip into a serving bowl and top with the leftover Tablespoon of walnuts or pecans.
Cover and chill for one hour so flavors have a chance to come together.
Notes
Make 2-3 hours ahead.If you are in a hurry, you can quickly soften the cream cheese using the microwave 20 seconds at a time at 30% power until you achieve a spreadable consistency.