Performance Issues

You need additional help with phplogcon, then write into this forum.

Performance Issues

Postby rosco » Thu Feb 19, 2009 10:04 am

Hi there,

Has anyone got any tips or tricks to improve the performance of phplogcon. I had just upgraded to the latest version (2.5.9) based on another topic regarding performance yet it hasn't improved at all. On average, the initial page is taking about 20 seconds to open with a preconfigured display limit of 25.

The mySQL server is running fine as it hosts several other databases which are responding perfectly as is the Apache webserver. The server is running MySQL 5.0.51a, Apache 2.2.7 and PHP 5.2.4-2. The database is only about 81Mb in size with around 450000 records in the SystemEvents table. I've also tried on several different machines using IE, Firefox and Opera browsers with no difference.

When I'm loading the page, I notice that mySQL or the httpd processes on the server do not increase anymore than normal. Other websites on the same server running PHP are responding quickly and if I run the related SQL queries from the command line, they respond like lightning.

Any ideas?

Thanks in advance

Rosco
rosco
Avarage
 
Posts: 15
Joined: Mon Aug 15, 2005 2:14 pm

phpLogCon professional services

  • Custom phpLogCon configuration?
  • Maintenance Contract?
  • Installation support?

Re: Performance Issues

Postby alorbach » Thu Feb 19, 2009 11:09 am

Hi Rosco,

actually Version 2.5.24 is the latest Version, and contains some major database performance enhancments.
You can get the latest Version from here, I would suggest to give this one a try:
Download available here: http://www.phplogcon.org/downloads

Upgrading is simply, just copy the new files over your existing ones, login into the Admin Center if database updates are needed (If you use the User System).

best regards,
Andre Lorbach
User avatar
alorbach
Site Admin
 
Posts: 1129
Joined: Thu Feb 13, 2003 11:55 am

Re: Performance Issues

Postby rgerhards » Thu Feb 19, 2009 11:15 am

I, too, would be most interested in feedback on that version. If there is still a performance bottleneck, we should try to find out where it stems from...
User avatar
rgerhards
Site Admin
 
Posts: 2647
Joined: Thu Feb 13, 2003 11:57 am

Re: Performance Issues

Postby rosco » Thu Feb 19, 2009 11:29 am

Thanks for the quick reply

I previously was at 2.5.24 and was experiencing the problem as well with that. That is why I took the decision to go to the latest devel version that was there. I also suspected some DB corruption in the database to which I dropped the DB and restored from last nights export. No change I'm afraid.

Cheers

Rosco
rosco
Avarage
 
Posts: 15
Joined: Mon Aug 15, 2005 2:14 pm

Re: Performance Issues

Postby alorbach » Thu Feb 19, 2009 11:33 am

You should use 2.5.24 in any case, because of the database performance improvements.
Regarding your performance problem, does it only happen when you login or on each page you load?
What is the page generation time you see in the footer?
Do you have "Row Counting" feature enabled in your datasource?

regards,
Andre
User avatar
alorbach
Site Admin
 
Posts: 1129
Joined: Thu Feb 13, 2003 11:55 am

Re: Performance Issues

Postby rosco » Thu Feb 19, 2009 11:53 am

Ok. I've restored back to 2.5.24 and made sure that Row Counting was disabled.

In the footer I get the following:

Page rendered in: 1.9843 seconds | DB queries: 2 | GZIP enabled: yes | Script Timeout: 30 seconds

Maybe it's now a good time to mention that the UNIX server is a virtual server how ever it has been assigned 2Gb of memory and has 2 x Quad Core 2.6Ghz Opterons behind it. I dont see how this would affect things though given that the other SQL databases and webpages are running ok.

The config behind this is:

$CFG['Sources']['Source1']['ID'] = 'Source1';
$CFG['Sources']['Source1']['Name'] = 'My Syslog Source';
$CFG['Sources']['Source1']['ViewID'] = 'SYSLOG';
$CFG['Sources']['Source1']['SourceType'] = SOURCE_DB;
$CFG['Sources']['Source1']['DBTableType'] = 'monitorware';
$CFG['Sources']['Source1']['DBType'] = DB_MYSQL;
$CFG['Sources']['Source1']['DBServer'] = 'localhost';
$CFG['Sources']['Source1']['DBName'] = 'Syslog';
$CFG['Sources']['Source1']['DBUser'] = 'XXXXXXXX';
$CFG['Sources']['Source1']['DBPassword'] = 'XXXXXXXX';
$CFG['Sources']['Source1']['DBTableName'] = 'SystemEvents';
$CFG['Sources']['Source1']['DBEnableRowCounting'] = false;
rosco
Avarage
 
Posts: 15
Joined: Mon Aug 15, 2005 2:14 pm

Re: Performance Issues

Postby alorbach » Thu Feb 19, 2009 11:57 am

The page generation itself took "1.9843" seconds in this case. But the site needed longer to display?
User avatar
alorbach
Site Admin
 
Posts: 1129
Joined: Thu Feb 13, 2003 11:55 am

Re: Performance Issues

Postby rosco » Thu Feb 19, 2009 12:17 pm

Correct. Here's some timed runs

25 records - Page rendered in: 0.0375 seconds | DB queries: 2 | GZIP enabled: yes | Script Timeout: 30 seconds - Took 12s to display page
50 records - Page rendered in: 0.0701 seconds | DB queries: 2 | GZIP enabled: yes | Script Timeout: 30 seconds - Took 20s to display page
75 records - Page rendered in: 0.0980 seconds | DB queries: 2 | GZIP enabled: yes | Script Timeout: 30 seconds - Took 19s to display page
100 records - Page rendered in: 0.4086 seconds | DB queries: 4 | GZIP enabled: yes | Script Timeout: 30 seconds - Took 25s to display page
250 records - Page rendered in: 0.3017 seconds | DB queries: 6 | GZIP enabled: yes | Script Timeout: 30 seconds - Took 58s to display page
500 records - Page rendered in: 1.0262 seconds | DB queries: 12 | GZIP enabled: yes | Script Timeout: 30 seconds - Took 177s to display page

My original test was set for 500 rows. I thought it was set for 25. Sorry.

Do these times seem about right?
rosco
Avarage
 
Posts: 15
Joined: Mon Aug 15, 2005 2:14 pm

Re: Performance Issues

Postby alorbach » Thu Feb 19, 2009 12:44 pm

This is a strange, you can see that the page generation time is always below 2 seconds. And as phplogcon uses a template system, the whole page is prepared and generated at once, and flushed to the browser.

So the issue has to be something else here.
Try to disable GZIP Compression in general Options, and see if this changes anything. If you have Opera, please run some tests with this browser, and verify if there is some file, image or something else where the page loading hangs.

best regards,
Andre
User avatar
alorbach
Site Admin
 
Posts: 1129
Joined: Thu Feb 13, 2003 11:55 am

Re: Performance Issues

Postby rosco » Thu Feb 19, 2009 1:23 pm

Same issue I'm afraid. The logo banner at the top appears and it seems to hang up when the records are getting passed to the browser.

Just for curiosity sake, I just reinstalled v 1.2.3 and I'm browsing through the records with excellent response
rosco
Avarage
 
Posts: 15
Joined: Mon Aug 15, 2005 2:14 pm

Re: Performance Issues

Postby rgerhards » Thu Feb 19, 2009 1:33 pm

my 2 cts: v1 is a totally different code base, but it is interesting to see that it performs so much better...
User avatar
rgerhards
Site Admin
 
Posts: 2647
Joined: Thu Feb 13, 2003 11:57 am

Re: Performance Issues

Postby alorbach » Fri Feb 20, 2009 11:41 am

As the page generation time is always below 2 seconds, it has to be a different issue. Can you temporary disable that Opera loads images? My guess is that something is missing, and causing the site loading to lag for some reason.

best regards,
Andre Lorbach
User avatar
alorbach
Site Admin
 
Posts: 1129
Joined: Thu Feb 13, 2003 11:55 am

Re: Performance Issues

Postby rosco » Fri Feb 20, 2009 2:09 pm

Hi there,

Images disabled and it didnt make any difference I'm afraid.

Sorry

Rosco
rosco
Avarage
 
Posts: 15
Joined: Mon Aug 15, 2005 2:14 pm

Re: Performance Issues

Postby rosco » Fri Feb 20, 2009 2:20 pm

Some timings with images disabled:

25 records - Page rendered in: 1.3855 seconds | DB queries: 3 | GZIP enabled: yes | Script Timeout: 30 seconds - 3s to display page
50 records - Page rendered in: 0.6793 seconds | DB queries: 3 | GZIP enabled: yes | Script Timeout: 30 seconds - 2s to display page
75 records - Page rendered in: 5.0202 seconds | DB queries: 3 | GZIP enabled: yes | Script Timeout: 30 seconds - 12s to display page
100 records - Page rendered in: 2.1242 seconds | DB queries: 4 | GZIP enabled: yes | Script Timeout: 30 seconds - 4s to display page
250 records - Page rendered in: 1.9239 seconds | DB queries: 5 | GZIP enabled: yes | Script Timeout: 30 seconds - 7s to display page
500 records - Page rendered in: 18.5620 seconds | DB queries: 8 | GZIP enabled: yes | Script Timeout: 30 seconds - 24s to display page.

Ok so it looks like it is a problem with the images after all.

If only there was a way to disable this in IE so I could do a fair test with that.

Cheers

Rosco
rosco
Avarage
 
Posts: 15
Joined: Mon Aug 15, 2005 2:14 pm

Google Ads



Return to Help

Who is online

Users browsing this forum: No registered users and 0 guests

cron