This was the story that got me hooked on Lovecraft long ago.
The effect is something like the old sense of "sublime". He often describes things as "blasphemous", but they are as likely to blaspheme against geometry as against God.
If you don't want to download it, you can also read it online: inkitt.com/stories/10600