1 Topic by maxdonato

  • maxdonato
  • Member
  • Offline
  • Registered: 2015-08-11
  • Posts: 31

Topic: Performance tuning

Hello,
   i tryed to follow this informations
http://www.iredmail.org/docs/concurrent.processing.html
http://www.iredmail.org/docs/performance.tuning.html
and now i have a message troughtput of nearly 4,5 msgs/sec
I also read something on the amavisdwebite about perfomance tuning, but not shure i understand well...sorry.

anoyone has experience on sending quite large (50k recipients) mailing list?
is this normail behaviour ? any idea on better performance?
the server has Intel XEON CPU E5-2620 v3 and 16gb of ram(only 3.5 used) an ssd storage


kind regards


==== Required information ====
- iRedMail version (check /etc/iredmail-release): 0.9.2
- Linux/BSD distribution name and version: centos 7
- Store mail accounts in which backend (LDAP/MySQL/PGSQL):  mysql
- Web server (Apache or Nginx): apache
- Manage mail accounts with iRedAdmin-Pro? no
- Related log if you're reporting an issue:
====

----

Spider Email Archiver: On-Premises, lightweight email archiving software developed by iRedMail team. Supports Amazon S3 compatible storage and custom branding.

2 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 30,785

Re: Performance tuning

To send large volume emails, you may want to disable SPAM/VIRUS checking for outgoing emails, this will save too much system resource. Reference:
http://www.iredmail.org/docs/disable.sp … mails.html

If you just send large volume emails from few accounts, you can easily disable spam/virus checking for just those accounts with iRedAdmin-Pro, so that iRedMail still scans emails sent by other users. screenshot attached:

http://www.iredmail.org/images/iredadmin/user_profile_spampolicy.png

3 Reply by maxdonato

  • maxdonato
  • Member
  • Offline
  • Registered: 2015-08-11
  • Posts: 31

Re: Performance tuning

Hi ZhangHuangbin,
thak you for your reply, already sent the coffy. i like this policy a lot. i will try to use this with my customers. smile

i don't have enough spare money now( hope for the future to buy the pro version) and here http://www.iredmail.org/docs/disable.sp … mails.html i can't find how to disable spam rules only for a single user.
Can you help me in this?

4 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 30,785

Re: Performance tuning

maxdonato wrote:

i can't find how to disable spam rules only for a single user.
Can you help me in this?

Honestly, this is a little complex with SQL command line tool, you can check our (short)  document below, the most important part is the linked articles at the bottom:
http://www.iredmail.org/docs/amavisd.pe … ookup.html

5 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 30,785

Re: Performance tuning

maxdonato wrote:

i can't find how to disable spam rules only for a single user.
Can you help me in this?

Honestly, this is a little complex with SQL command line tool, you can check our (short)  document below, the most important part is the linked articles at the bottom:
http://www.iredmail.org/docs/amavisd.pe … ookup.html

6 Reply by maxdonato

  • maxdonato
  • Member
  • Offline
  • Registered: 2015-08-11
  • Posts: 31

Re: Performance tuning

Hi ,
i'm unalbe to understand .
i found this :
http://www.iredmail.org/forum/topic4681 … nders.html
now i can continue to receive emails.
but still outgoing mail are at the end of the queue.
Any advice on low priority senders or similar?

ZhangHuangbin wrote:
maxdonato wrote:

i can't find how to disable spam rules only for a single user.
Can you help me in this?

Honestly, this is a little complex with SQL command line tool, you can check our (short)  document below, the most important part is the linked articles at the bottom:
http://www.iredmail.org/docs/amavisd.pe … ookup.html

7 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 30,785

Re: Performance tuning

maxdonato wrote:

but still outgoing mail are at the end of the queue.

Please check Postfix log file first.

maxdonato wrote:

Any advice on low priority senders or similar?

What does "low priority" mean?

8 Reply by maxdonato

  • maxdonato
  • Member
  • Offline
  • Registered: 2015-08-11
  • Posts: 31

Re: Performance tuning

Thank you for your prompt answer.
first of all sorry for my english.

i will try to explain in a different way.

despite the hardware, i'm not able to send more than 4 - 5 emails per sec.
not a problem at all unless i have to send my mailing list that has 50k recipients.
during mailing list delivery of messages for regular users is blocked inbound and outbound.
the DNS is on the mail server itself.
i tryed this
http://www.iredmail.org/forum/topic4681 … nders.html
and now regulard users are able to receive emails coming from outside.
but still not able to send until the end of the mailing list (today even slover)

so i'm looking for a solution to lower the  priority of the mailing list , or speeding up the delivery of the mailing.

9 Reply by maxdonato

  • maxdonato
  • Member
  • Offline
  • Registered: 2015-08-11
  • Posts: 31

Re: Performance tuning

also tryed to update iradapd using the script
http://www.iredmail.org/docs/upgrade.iredapd.html
and now
[root@mail tools]# python wblist_admin.py --list --whitelist
* Establishing SQL connection.
* List all inbound whitelist for account: @.
(1146, "Table 'amavisd.outbound_wblist' doesn't exist")

maybe something wrong with the update procedure.

10 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 30,785

Re: Performance tuning

maxdonato wrote:

(1146, "Table 'amavisd.outbound_wblist' doesn't exist")

This new SQL table was introduced in iRedMail-0.9.3. Please follow this step to add it:
http://www.iredmail.org/docs/upgrade.ir … database_1

11 Reply by maxdonato

  • maxdonato
  • Member
  • Offline
  • Registered: 2015-08-11
  • Posts: 31

Re: Performance tuning

now i can insert the sender into the whitelist.
checked using the --list comand.
but when i receive the mail it seems scanned by amavids, maybe i missed something.
i checked the docs about upgrading from 0.9.2 to 0.9.5 and it seems a very long process.
do you think is better to start a brand new install on a new disk  and then backup everything ?
or trying to solve the current install?

12 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 30,785

Re: Performance tuning

maxdonato wrote:

but when i receive the mail it seems scanned by amavids, maybe i missed something.

Please follow our tutorial below to make Amavisd logging verbose info in its log file:
http://www.iredmail.org/docs/no.x-spam.headers.html (in this case, we just need "$log_templ = $log_verbose_templ;")

Then check the spam test results in log file. e.g.

Tests: [ALL_TRUSTED=-1,INVALID_DATE=0.432, MISSING_MID=0.14]

After you whitelisted that sender, you will see 'WHITELISTED' in above 'Tests: []' result. That means Amavisd doesn't call SpamAssassin to scan it at all.

13 Reply by maxdonato

  • maxdonato
  • Member
  • Offline
  • Registered: 2015-08-11
  • Posts: 31

Re: Performance tuning

Thank you for your prompt answer.
after some further investigation i found that every inbound message is scanned.
but not every outbound message so i tryed some different cases.
i have postscree enabled.
i send a message from my "navigation ip" it is not scanned by amavisd, and this is not intended.
it is scanned if it comes from the "web site ip", that is alse the sender of the mailing list(the sender mailing@domain.it is whitelisted in iredapd)
in postcreen_access.cidr there are both of this ip listed
in postfix main.cf only the "website ip" in mynetworks

do you have any further suggestion?

14 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 30,785

Re: Performance tuning

*) What's "navigation ip"?
*) Why do you add website ip in Postfix "mynetworks"? Just configure the web applications on your website to send email with SMTP authentication.

15 Reply by maxdonato

  • maxdonato
  • Member
  • Offline
  • Registered: 2015-08-11
  • Posts: 31

Re: Performance tuning

i have a net of three firewalls each wich his own public IP
one is for mail server (for reverse dns reolution)
one is for web server
one is for normal navigation (because in the past i had problems with self installed bots sending email so i don't want th mailserver on the same ip of regular navigation)
i added to mynetworks the web server ip because while i was sendeing the mailing list the sender was blacklisted.

16 Reply by maxdonato

  • maxdonato
  • Member
  • Offline
  • Registered: 2015-08-11
  • Posts: 31

Re: Performance tuning

removed from mynetworks, but i will get a feedback from my system only at the next mailing list.

17 Reply by maxdonato

  • maxdonato
  • Member
  • Offline
  • Registered: 2015-08-11
  • Posts: 31

Re: Performance tuning

ZhangHuangbin wrote:

*) What's "navigation ip"?
*) Why do you add website ip in Postfix "mynetworks"? Just configure the web applications on your website to send email with SMTP authentication.

i tryed but i have many differente services running in that ip.
one is the web server
the other one is a mssql server that need to send some emails to marketing people and it works only if the ip is added into mynetworks.
ms sql server only identifies with pc name not fqdn
this is the error i can find in the logs:
5.5.2 <sql2008r2>: Helo command rejected: need fully-qualified hostname"