How we make Magento fast
A combination of the following hardware and software is used to make Magento run fast.
We also use several tools to monitor, graph and analyse the performance 24/7.
Hardware
- No virtualisation, bare metal hardware performance
- Top quality enterprise hardware, redundant: cpu, memory, disks, power, fans
- A fast hardware raid controller with 2 GB BBU Cache
- Tons of memory, 128 Gb per server
- Lots of CPUs: 20 cores / 40 threads Xeon
- Datacenter grade SSD Disks
- A bios configuration tweaked for Magento performance
- Out-of-band management
Operating System
- Ubuntu 18.04 LTS Server
- Critical updates are installed within 1 workday
- Updates are installed at least every week
- No generic hosting control panel like Plesk / DirectAdmin / cPanel, we have our own specialised configs
Web Server
- Nginx 1.14.x with HTTP/2 and OCSP Stapling for high traffic sites, with our own add-on to minify JS and CSS
- Apache 2.4.x with HTTP/2 for customers who want to use .htaccess files
- HaProxy 1.8.x for SSL offloading and load balancing
- Every web server configuration is tweaked for Magento
PHP
Database
- MySQL 5.7.x via mysqlnd
- Configuration tweaked for Magento
- All databases are optimised every night
- We regularly run MySQLTuner and Tuning Primer
Cache
- Cache in Redis via Cm_Cache_Backend_Redis
- Cm_Cache_Backend_File
- MageHost_BlockCache
- Varnish Cache 4.1.x with Turpentine for Magento 1.x
- Varnish Cache 5.2.x with for Magento 2.x
- A Cache Warmer script that reads sitemap XML
Sessions
- Sessions in Redis via Cm_RedisSession
- Tweaks in PHP & HHVM configuration for optimal Magento sessions
- A script that cleans up old sessions
Search
- Mirasvit Sphinx Search for Magento 1.x
- Elasticsearch for Magento 2.x
Fixes
- Stampede Resistant Config
- MageHost_RewriteFix
- Disable Logs & Reports via XML config files
- A script to losslessly compress images via image_optim
- Mirasvit Fast Async Re-indexing
- AOE Scheduler
Security
- On-site spare hardware
- Daily backup with off-site rotation
- Daily MySQL export using mysqldump
- An undisclosed firewall
- Our network has DDoS filtering using NaWas
- Several configuration changes to increase security
Monitoring
- 24/7 monitoring via Nagios, alerting via PagerDuty
- Munin
- ClusterStatD
- Service Uptime
- Our own Siege based load testing script.
- A lot of own monitoring scripts for Nagios and Munin
Development
- JetBrains PhpStorm with Magicento
- XDebug Debugging + Profiling on staging servers
- XHProf with XHGui
- PhpMyAdmin
- n98-magerun & n98-magerun2
- Modman
- MySQL Query Logging
- Magento Profiler
- PageSpeed Insights
