I can only tell you that I had to restore a client's backup for the first time about 2 weeks ago, and like you I was quite skeptic it'll work on the first go, but hey - I was so proud and glad it worked with one click, and the client was so happy I could restore his site so quickly...
So I don't know exactly where your problem is (did you enable backup for the site you were trying to restore?), but my experience was totally different.