Connect to a SFTP server using just the public key?

Client wants to send them files using SFTP and they just shared the username and their public key.

My understanding is that they will either need to share the username and password OR a username and a private key – is that right?