Can I use Holy Water for an “additional weapon attack”?

With my 3rd level Gloomstalker, can I make a regular attack and then use Holy Water for my Dread Ambusher additional attack?

The crux of the issue is the description of Holy Water and Improvised Weapons, where it’s unclear if the Holy Water can count as a weapon.