Anyone who is added as a contact by the person sharing the story can view it.
Only those who have mutual contact with the user sharing the story and are allowed by the settings can view Telegram stories. Sometimes, it might also depend on whether the user has set the story to be visible to specific groups or all contacts.