How we make Magento fast
A combination of the following hardware and software is used to make Magento run fast.
We also use several tools to monitor, graph and analyse the performance 24/7.
Hardware
- No virtualisation, bare metal hardware performance
- Top quality enterprise hardware, redundant: cpu, memory, disks, power, fans
- A fast hardware raid controller with 1 GB BBU Cache
- Tons of memory, 128 Gb per server
- Lots of CPUs: 16 cores / 32 threads Xeon
- Datacenter grade SSD Disks
- A bios configuration tweaked for Magento performance
- Out-of-band management
Operating System
- Ubuntu 16.04 LTS Server
- Critical updates are installed within 1 workday
- Updates are installed at least every week
- No generic hosting control panel like Plesk / DirectAdmin / cPanel, we have our own specialised configs
Web Server
- Nginx 1.10.x with HTTP/2 and OCSP Stapling for high traffic sites, with our own add-on to minify JS and CSS
- Apache 2.4.x with HTTP/2 for customers who want to use .htaccess files
- HaProxy 1.6.x for SSL offloading and load balancing
- Every web server configuration is tweaked for Magento
PHP
Database
- MySQL 5.7.x via mysqlnd
- Configuration tweaked for Magento
- All databases are optimised every night
- We regularly run MySQLTuner and Tuning Primer
Cache
- In Redis via Cm_Cache_Backend_Redis
- Cm_Cache_Backend_File
- JeroenVermeulen_BlockCache
- Varnish Cache 4.0.x with Turpentine for some customers
- A Cache Warmer script that reads sitemap XML
Sessions
- In Redis via Cm_RedisSession
- Tweaks in PHP & HHVM configuration for optimal Magento sessions
- A script that cleans up old sessions
Search
Fixes
- Stampede Resistant Config
- JeroenVermeulen_RewriteFix
- Disable Logs & Reports via XML config files
- A script to losslessly compress images via image_optim
- Mirasvit Fast Async Re-indexing
- AOE Scheduler
Security
- On-site spare hardware
- Daily backup with off-site rotation
- Daily MySQL export using mysqldump
- An undisclosed firewall
- Our network has DDoS filtering using NaWas
- Several configuration changes to increase security
Monitoring
- 24/7 monitoring via Nagios, alerting via PagerDuty
- Munin
- ClusterStatD
- Service Uptime
- Our own Siege based load testing script.
- A lot of own monitoring scripts for Nagios and Munin
Development
- JetBrains PhpStorm with Magicento
- XDebug Debugging + Profiling on staging servers
- XHProf (also on HHVM) with XHGui
- PhpMyAdmin
- n98-magerun
- Modman
- MySQL Query Logging
- Magento Profiler
- PageSpeed Insights
