i found a solution...i have to enable the httpd-ssl.conf to get it working.
But when I enable that, I get some error on non-existing SSL cert. I just pointed it to correct path and all is working now!! Yeah...
Seriously, this is supposed to be centos web panel. This kind of thing need to be automated. There should be an option in apache or virtualhost somewhere to enable/disable SSL.