When you create, you descend into your own world. There will be those who will try pulling you out of it, who will get angry, who will impose on you their frustrations and wishes, because they can't do the same. They will shame you for abandoning the mundane, they will try to make you feel guilty.
DON'T LET THEM.
Your fight is bigger than theirs. You are making something beautiful while they squander their time on berating you. Ignore it and keep creating.
This is the hardest lesson I had to learn as an artist.