Preheat the oven to 350°F (175°C) and line a 12-cup muffin tin with paper cupcake liners.
In a mixing bowl whisk together the flour, oats, baking powder, baking soda, salt, and cinnamon until well combined.
In a separate large bowl beat the softened butter, brown sugar, and granulated sugar with a mixer on medium speed until light and fluffy, about 2–3 minutes.
Add the eggs to the butter mixture one at a time, beating well after each addition, then mix in the vanilla extract.
In a small bowl stir together the milk and sour cream until smooth.
Add one-third of the dry ingredients to the butter mixture and mix on low just until combined.
Add half of the milk mixture and mix on low until incorporated, then repeat with another third of the dry ingredients, the remaining milk mixture, and finally the last third of dry ingredients, mixing only until just combined each time.
Divide the batter evenly among the 12 liners, filling each about two-thirds full.
Bake the cupcakes for 16–18 minutes or until the tops spring back lightly when touched and a toothpick inserted in the center comes out clean.
Transfer the muffin tin to a wire rack and let the cupcakes cool in the pan for 5 minutes.
Carefully remove the cupcakes from the tin and place them directly on the wire rack to cool completely, about 30–40 minutes.
While the cupcakes cool, prepare the filling by beating the softened butter with a mixer until creamy, about 1 minute.
Add the marshmallow creme to the butter and beat on medium speed until smooth and fully combined.
Gradually add the powdered sugar to the filling mixture on low speed, then increase to medium and beat until light and fluffy.
Mix in the vanilla and heavy cream and beat for another 30 seconds until the filling is soft but pipeable; set aside.
For the frosting, beat the softened butter until creamy, then gradually add the powdered sugar on low speed.
Add the vanilla and 2 tablespoons of heavy cream, then beat on medium-high speed for 1–2 minutes until light and fluffy, adding an extra tablespoon of cream if needed to reach a spreadable consistency.
Once the cupcakes are completely cool, use a small knife or the wide end of a piping tip to cut a small cone from the center of each cupcake, reserving the tops.
Spoon or pipe about 1–2 teaspoons of the cream filling into each hollowed cupcake, then replace the reserved cake tops, trimming if necessary so they sit flush.
Transfer the frosting to a piping bag fitted with a round or star tip and pipe a generous swirl on top of each cupcake, or spread with an offset spatula.
Sprinkle the tops with finely crushed oatmeal cookies, if using, and let the cupcakes rest for at least 10 minutes before serving to allow the filling and frosting to set slightly.