Thanks to support, I finally had my email working.
I have enable cloudflare for my hostname domain.
I realised that it took me a long time to receive an email from gmail (i only tested with gmail) - 6 min to be exact and another one min for the gmail recipient to get my replied mail.
Is there some setting that is causing this issue?