Odd performance fluctation with php-fpm and nginx

What about your memory management? The last weeks i did some simlar tests and brought one server to the limit. I saw a lot of changes to the memory. In my case huge amount of data was brought into the swap instead of the RAM to handle the load. After one test i had a real strange result, no RAM was used anymore and complete all was gone to the swap. Maybe this is what the following requests is slowing down.

This is a example image how my swap looked like after a load test enter image description here