Preheat oven to 400°F. Spray a 9x5-inch loaf pan thoroughly with cooking spray, especially the corners.
In a mixer bowl, beat softened butter and granulated sugar on medium speed for 2 minutes. The mixture will look dry and crumbly - this is normal.
Add eggs one at a time, beating well after each addition until the mixture becomes smooth and fluffy.
Mix in sour cream, vanilla extract, lemon extract, lemon zest, and lemon juice. Beat until creamy and smooth.
In a separate bowl, whisk together flour, baking powder, baking soda, and salt until evenly distributed.
Add dry ingredients to wet ingredients. Mix on low speed just until no dry flour remains. Do not overmix.
Pour batter into prepared loaf pan. Place in oven immediately, then reduce temperature to 350°F.
Bake for 45 minutes, or until a toothpick inserted in the center comes out clean or with just a few moist crumbs. Tent with foil if top browns too quickly.
Let loaf cool in pan for 10 minutes. Run a knife around edges, then flip onto a wire rack to cool completely.
While loaf cools, whisk together powdered sugar, milk, lemon juice, lemon extract, and salt for the glaze. Adjust consistency with more milk or sugar as needed.
Once loaf is completely cool, pour glaze over the top, letting it drip down the sides naturally. Let set for 20-30 minutes before slicing.