Greetings. We have had several applications crashing (resultsdb, resultsdb_ci_listener) or being slow (bodhi) of late. I did some digging today and discovered that db01 is pretty saturated on I/O. This means all the apps that use db01 are fighting i/o and returning things slower than they should. On looking more, it was mailman that was using the vast amount of the i/o. I of course thought at first that it was crawlers, but it is not. Instead it seems to be the bounce processor. This processor wakes up every few minutes and does a query for any bounces in the bounceevent table that are processed = 'false'. If it finds any, it processes them. However, that table is now 50GB and contains 152167015 rows (all of them pretty much processed = 'True').
