I think that would be a great situation to be in.
You have created a cool thing a lot of people use, by being good at something. You’ve done something.
Also, people have no idea who you are. Nobody is digging through your trash, harassing the people you love, taking pictures of you wherever you go including on your bad hair days, etc. You’re just some guy.
Also, what do you mean, OP, by “do you have perfect recall or an average human byte”? Are you thinking of information in terms of bits and that people can only keep a limited amount of things in working memory at a time?