Do I have to keep track of what I’ve heard as a Kenku?

Kenku can only speak using their mimicry trait but that means you have to have heard someone speak a phrase or word in order to speak it. Do I need to write down and keep track of all the phrases that I’ve heard so that I can communicate? Or can I only remember and mimic phrases I’ve heard recently?