How can I get a medium-size goat for my gnome?

I am looking to get a goat as a permanent mount. Nothing fancy, I want to ride her, use it as mule, and be able to do basic tricks with her. I don’t plan to use it in combat. If it matters, I am looking for a female to drink her milk and bake cheese. I am fine with a look-alike animal that we can adapt to be flavorful.

Warcraft goat

My character is a gnome buffer bard. I will buff as far as I can from the battle. I am fine with investing one feat if needed, but I don’t want to dip.

What are my options?