Grease a 9x5x3 inch loaf pan.
Preheat oven to 325 degrees.
Heat milk with lavender almost to a boil, then steep until cool, allowing the lavender to infuse into the milk.
In the meantime combine flour, baking powder and salt together in small bowl.
In another bowl cream butter & sugar until smooth, then add eggs, one at a time, beating until light and fluffy.
Add flour mixture alternately with lavender milk, in three parts. Mix until batter is just blended, do not overbeat.
Pour into prepared pan and bake for 50 minutes, or until toothpick inserted in center comes out clean. Let cool in pan 5 minutes, then remove to a wire rack to cool.
Once the bread has cooled completely, drizzle with a simple sugar glaze or sprinkle with confectioners' sugar. Garnish with sprigs of fresh lavender.