Do you ever “download” a language?

When one “downloads” a language (say, downloading the python file, or doing apt-get ruby or something), is it always the compiler/interpreter you are downloading?

In other words, does a “language” ever exist outside of its syntax and behavioral descriptions?

Perhaps standard libraries can be written in the language itself — but other than that, would it be correct to say that we ever only “download” implementations of the language?