Does password strength matter when using a YubiKey? [duplicate]

This question already has an answer here:

  • Is it safe to use a weak password as long as I have two-factor authentication? 11 answers

I’m considering buying a YubiKey. I already use a password manager which can generate strong passwords, but I wonder if there’s even a point with the YubiKey. I guess it just makes one extra step…but if you can’t log in without my YubiKey then does it matter? I’m not really worried about someone stealing the YubiKey IRL.

Am I missing something?