Messages

31

Backup / Re: Custom Backup

« on: November 18, 2020, 01:27:50 AM »

BTW, for large backup sets, zstd is probably the way to go, rather than bz2. It's fairly new on the scene however, so application support is limited.

Looks really good, but yea maybe wait a while until its more established

Pigz (as used by WHM/cPanel) might also help and is more established. This opens a real can of worms though, as can be seen if you search for a performance comparison of these.
I like to stick to the basics where possible and well established methods. KISS philosophy, again.

Having seen the stats of Pigz it looks great, was there a reason you opted for bz2 aside from old habits?

32

Backup / Re: Custom Backup

« on: November 18, 2020, 01:17:45 AM »

That's a small screenshot!

Eek, yea without manual constraints it took my desktop resolution and ran with it 

30 minutes to do 5GB ain't too bad but that's with restricting I/O & CPU throughput.

Agreed, I'm just a WordPress Developer (SCSS/PHP) hosting a bunch of clients sites. If this scales up in the near future I would strongly consider upgrading the current EC2 rig, it's currently 2x vCPU's and 4GB RAM.

Remember to exclude superfluous directories (not folders, please) such as cache and the other listed ones - limit it to the necessary only.

I meant to ask you about this! Could we add those as a wildcard within the variables above this script, with additional ones in the users config file (that you've already set)? For example:
#exclude these folders in all user directories:
/backupcwp/
/tmp/
/cache/
/cwp_stats/

Would be great, especially for anyone with a whole bunch of user accounts

Some Wordpress (and others) plugins allow lusers to backup from within their applications. It's pointless doing a backup of a backup: not the same as taking copies of a backup remotely.

Already on it, strongly advised all users that we didn't get a 500GB external drive for nothing but some still ignore it.. 

(You may have gathered this subject area was one of my corporate consultancy roles.)

Could have guessed, yea

33

Backup / Re: Custom Backup

« on: November 18, 2020, 12:25:05 AM »

If its of interest to you, the result of your most recent snippet:

Works really well and although its very CPU heavy this isn't a clash with ClamAV/Varnish as those are mostly just hogging RAM

Actually, I think I'll do a spot of reconfiguring, to more closely mimic a WHM/cPanel backup, so yes backups grouped by date. This will help with my multiple backups to remote locations - the key reason to have backups consolidated (larger block size).

Amazing, really excited!

I'll consider a parameter, to allow keeping the backups split.

Yes, and if you segment the tasks imagine transferring one segment (say Mail.zip) to the backups location while the next task (say MySQL.zip) could be already preparing.. ooooo the possibilities! 

34

E-Mail / Re: Mail Usage Space Wrong?

« on: November 18, 2020, 12:06:56 AM »

see if you have the graph metrics installed, i saw this upwards of 250MB in size on each account and they'd only been online for a couple of days!

CWP Settings > Edit settings > final checkbox "GoAccess Stats"

You will have to delete these manually from the users folder in /home/username/cwp_stats/gaccess 👍

35

E-Mail / Re: I have moved vmail folder in another disk now cant receive emails.

« on: November 18, 2020, 12:00:37 AM »

btw these are my dev folders, I have creat home2 only for the mails to be stored there.

Code: [Select]

/dev/sda1        79G   57G   19G  75% /home
/dev/sdb1        50G   19G   29G  40% /home2

Don't forget to set up disc quota on the new disc or the mail won't be inside the users allocated storage quota 👍

36

Backup / Re: Custom Backup

« on: November 17, 2020, 07:48:51 PM »

Latest version.

Thank you! Testing now

One thing that would be SUPER cool is putting that days backups into its own folder, 20201118 for example.
I do understand that if a backup goes on past midnight it would go to a new folder but the idea is still super cool and useful (I plan on keeping 14+ days retention), would it be possible to add folders? 

or even go further and split the backup?
backups/date/username/mail.zip
backups/date/username/public_html.zip
backups/date/username/databases.zip

37

E-Mail / AutoSSL for mail only

« on: November 17, 2020, 07:22:04 PM »

Hey folks!

I'm using Cloudflare, therefore the A record for the domain and its subdomains have a SSL origin certificate from the server > Cloudflare, I do not wish to use AutoSSL for this as it will fail renewal (AutoSSL checks the IP address for the domain when issuing, this resolves at Cloudflare).

The mail.domain.com is sent via Cloudflare but not proxied/cached and just uses them for DNS.
I wish to use AutoSSL for every mail.domain.com record on every domain I have thats set up with Cloudflare, yet CWP seems to require the main domain on the certificate.

Is there a workaround for this?
Please do not suggest removing Cloudflare or temporarily disabling the DNS proxy on the main record for renewal each time, I'm looking for an automated solution that needs no interference!

It sounds like a 'must have' for CWP, I've used CWP for months now (i love it!) but the above is definitely holding CWP back.

Suggestions welcome

38

DNS / Re: named cache query denied?

« on: November 16, 2020, 07:50:33 PM »

if anyone is interested, adding:

Code: [Select]

   allow-query-cache { localnets; };to the /etc/named.conf made the error disappear, yay 

39

DNS / named cache query denied?

« on: November 16, 2020, 06:27:50 PM »

hey folks!

Using nginx+varnish+apache, seeing the following message a lot:

Code: [Select]

Nov 16 18:15:28 host named[25392]: client @0x7f378803c150 127.0.0.1#47439 (.): query (cache) './NS/IN' denied
Nov 16 18:15:28 host named[25392]: client @0x7f3788041dd0 127.0.0.1#34384 (.): query (cache) './NS/IN' denied
I'm assuming there's an entry missing in /etc/named.conf but I may be wrong, could anyone please point me in the right direction?
Any help is greatly appreciated! 

40

Backup / Re: Custom Backup

« on: November 16, 2020, 04:04:50 PM »

I currently use this to supplement the CWP (new) backup function.

Wonderful script, thank you!
Testing atm from CLI, looks great so far. Could really use a limiter on the bzip process. Although its only using one vCPU during the zip process it does bounce up to 100% which would be nice to avoid for a live server 

Oh and just FYI chaps, if you're adding this then write it in VI/VIM/nano from CLI and not from the 'file manager', it messes with encoding.

41

Suggestions / Re: Redirections for Users

« on: November 16, 2020, 12:07:42 PM »

it's weird that we can't set redirects when using nginx+apache together, can someone look at a way of adding this?
Even add it as a separate module and switch modules depending on the installation type 

42

CentOS-WebPanel GUI / Re: How to Increase Username Length?

« on: November 16, 2020, 11:47:39 AM »

The solution here would be to have the ability to rename user accounts (and their databases to the new name) during account migration/import.

If you're reading this CWP chaps, please consider! 

43

PHP / Re: Install ImageMagick or GD ?

« on: October 14, 2020, 10:30:55 PM »

also having issues when running the script:

Code: [Select]

checking if debug is enabled... no
checking if zts is enabled... no
checking for gawk... gawk
checking whether to enable the imagick extension... yes, shared
checking whether to enable the imagick GraphicsMagick backend... no
checking ImageMagick MagickWand API configuration program... found in /usr/bin/MagickWand-config
checking if ImageMagick version is at least 6.2.4... found version 6.9.10 Q16
checking for MagickWand.h header file... configure: error: Cannot locate header file MagickWand.h
make: *** No rule to make target `clean'.  Stop.
make: *** No targets specified and no makefile found.  Stop.
make: *** No rule to make target `install'.  Stop.

PHP Warning:  PHP Startup: Unable to load dynamic library 'imagick.so' (tried: /usr/local/lib/php/extensions/no-debug-non-zts-20190902/imagick.so (/usr/local/lib/php/extensions/no-debug-non-zts-20190902/imagick.so: cannot open shared object file: No such file or directory), /usr/local/lib/php/extensions/no-debug-non-zts-20190902/imagick.so.so (/usr/local/lib/php/extensions/no-debug-non-zts-20190902/imagick.so.so: cannot open shared object file: No such file or directory)) in Unknown on line 0
Imagick NOT Installed !
[root@host ~]#

44

CentOS-WebPanel GUI / Re: How to Increase Username Length?

« on: September 06, 2020, 05:08:34 AM »

For anyone finding this on a google search, DO NOT DO IT.

There is a reason behind the character limit.
For example, if you had:
- domainname1.com
- domainname2.com

Say you create one account 'domainna' (following the 8char rule) but for the other 'domainname2' (following the unlimited character username hack).
Then you log into 'domainna', you will see all databases from the account 'domainname2' as well as your own, because the databases in 'domainname2' start with 'domainna'.

My not be an expected issue for many, but I just had a client with full access to delete other users databases.. which they did, as they didn't recognise them!

For the average user this is not an issue but just because you CAN do something, doesn't always mean you should
Hope it helps!

45

Suggestions / Export DNS records

« on: August 01, 2020, 06:54:28 PM »

although it would likely need a couple of small tweaks after importing to cloudflare, a nice export option on the DNS zone page would be nice (within user account > dns zone > selected domain).

Would save doing every domain manually, which I'm doing at the moment for about 30 domains..