Get user meta for only the keys with the prefix my_theme

There is a list of meta keys with the prefix my_theme, these are updated by the user. My problem is how to get_user_meta for only the keys with my_theme prefix. Tried a wildcard, didn’t work.

get_user_meta( $  user_id, 'my_theme%', true  );