Can a Swords bard benefit from Blade Flourish’s speed increase again if they take the Attack action again?

The Swords Bard’s 3rd level feature, Blade Flourish, states:

[…] Whenever you take the Attack action on your turn, your walking speed increases by 10 feet until the end of the turn […]

So if a Bard took the Attack action multiple times (through something like haste or Action Surge) would they gain the speed increase multiple times as well?