Apache Performance Tuning Part 1 Scaling Up Sander
- Slides: 43
Apache Performance Tuning Part 1: Scaling Up Sander Temme <sander@temme. net>
http: //httpd. apache. org/docs/1. 3/misc/perf-tuning. html says: “Apache is a general webserver, which is designed to be correct first, and fast second. Even so, its performance is quite satisfactory. Most sites have less than 10 Mbits of outgoing bandwidth, which Apache can fill using only a low end Pentiumbased webserver. ” 2
3
The Silver Bullet “Make my web server go fast, please”
5
Sorry There is No Silver Bullet
No Silver Bullet • Every site is different – Dynamic Content – Static Content • Different Traffic Patterns • SSL or Plaintext • No Cookie Cutter Approach 7
Performance Tuning • • Ready Aim Fire Aim some more Understand Aim even more Fire 8
In practice • • Setup for analysis Monitor and analyse Tune configuration Lather, rinse, repeat 9
Monitoring Your Server 10
Purposes of Monitoring • • Observation Extrapolation Signals/Alerts Testing 11
Monitoring Apache 12
Monitoring Solaris: SE Toolkit • Lightweight • Programmable • Alive http: //www. sunfreeware. com/setoolkit. html 13
Other Monitoring Tools • • vmstat iostat top free 14
Web Server Logs • Error. Log – Log. Level: debug, info, notice, warn, error, crit • Access Log: Transfer. Log or Custom. Log – Common Log Format 15
Common Log Format 172. 16. 2. 91 - - [16/Nov/2003: 15: 23: 27 [16/Nov/2003: 15: 23: 28 [16/Nov/2003: 15: 23: 29 [16/Nov/2003: 15: 23: 34 -0800] -0800] "GET "GET /~sctemme/ HTTP/1. 1" 200 1446 /~sctemme/css/doc. css HTTP/1. 1" 200 167 /~sctemme/css/menu. css HTTP/1. 1" 200 623 /favicon. ico HTTP/1. 1" 404 283 /~sctemme/index. html HTTP/1. 1" 200 1446 Client IP 172. 16. 2. 91 RFC 1413 ident - username - timestamp [16/Nov/2003: 15: 23: 29 -0800] Request "GET /favicon. ico HTTP/1. 1" Status Code 404 Content Bytes 283 16
Analysis • Analyse Apache log files • Periodically run vmstat, iostat – Set up a script • Watch for Trends – Tells you when to buy new kit • Watch for Peaks – And how your system behaves 17
Configuring for Performance • Configuring Apache • Tuning the Operating System 18
Apache Configuration • • • Process/Thread Management DNS Lookups Avoid. htaccess Files Disable unused modules Tune your App Tier 19
DNS Lookups • Hostname. Lookups • Access Control – Bad: Deny from example. com – Good: Deny from 172. 160. 234. 5 20
. htaccess Files • Per-directory configuration files • Accessed for every request • Best performance: Allow. Override none GET /dir 1/dir 2/restricted. html HTTP/1. 0 21
Max. Clients • • Configuration file directive Maximum number of workers Apache 1. 3, 2 Prefork: processes Apache 2 Worker: threads * processes • Limit according to resources (memory) 22
Server-side Includes • We Love Them! – Easy to implement – Easy to manage • We Hate Them! – They break sendfile() – They may break cacheability • X-bit hack 23
The X-Bit Hack • Directive: XBit. Hack on|off|full – Default: off • On: – Every text/html document that has User Execute bit set is parsed • Full: – If Group Execute bit is set, send Last. Modified of file on disk 24
Sizing Max. Clients • Take total RAM • Subtract OS allowance – look at free value without Apache, etc. • Subtract external program allowance – JVM, cgi programs, My. SQL? • Divide by httpd process size – Read process size from top 25
Top 26
Selecting Your MPM • Processes and Threads • Differences between platforms • Thread-safety issues 27
Processes and Threads • Process: – Own copy of data structures – Shares: program code, shared memory – Context switches expensive • Thread: – Runs within process – Shares process environment – No context switch 28
Platforms and Threading • • • Context switches expensive on Solaris, AIX Context switches cheaper on Linux Solaris uses M: N threading Linux uses 1 process per thread Linux. Threads implementation is old – Replaced by Native Posix Thread Library (NPTL) in 2. 6 – NTPL already in RH 9, RHAS 3 29
Thread-safety • Third-party modules and libraries – mod_perl: experimental threading in Perl 5. 6; more mature in Perl 5. 8 – PHP: uses many third-party libraries • Free. BSD: threading not reliable until 5. x – Apache 2. 2 Worker MPM runs on Free. BSD 30
Tune your App Tier • Tomcat – Edit server. xml, tune min. Processors, max. Processors – Use APR -> Persistent connections – Tune JVM (Heap, Garbage Collection) • My. SQL – Ships with various scenarios in support-files: • my-{small, medium, large, huge}. conf – PHP & prefork: every child makes a connection – Tune max_connections variable in my. cnf 31
System Tuning Tips • RAM and swap space • ulimit: files and processes • Turn off unused services and modules 32
RAM and Swap • • Swap is disk-based Extension of RAM Excessive swapping kills performance Tune Max. Clients Never have more memory than swap – Upgrade RAM -> add more swap space 33
ulimit • Per-process resource limits • Built-in command of sh, bash • Important limits: – processes (-u) – open files (-n) • Set in invoking shell • Code in Apache 2. 0 startup script – ulimit -S -n `ulimit -H -n` • Linux: /etc/security/limits. conf 34
Caching Content • Dynamic Content is Expensive • Static Content Relatively Cheap • Several Approaches: – Dynamic caching – Pre-rendering popular pages (index. rss…) 35
mod_cache Configuration <If. Module mod_cache. c> <If. Module mod_disk_cache. c> Cache. Root /raid 1/cacheroot Cache. Enable disk / # A page modified 100 min. ago will expire in 10 min. Cache. Last. Modified. Factor. 1 # Always check again after 6 hours Cache. Max. Expire 21600 </If. Module> 36
Make Popular Pages Static • RSS Feeds • Popular catalog queries • … (Check your access log) 37
Static Page Substitution <Directory "/home/sctemme/inst/blog/httpd/htdocs"> Options +Indexes Order allow, deny Allow from all Rewrite. Engine on Rewrite. Cond %{REQUEST_FILENAME} !-f Rewrite. Cond %{REQUEST_FILENAME} !-d Rewrite. Rule ^(. *)$ /cgi-bin/blosxom. cgi/$1 [L, QSA] </Directory> 38
Tips • Observe Before You Act • Act on Monitoring Results • Don’t Overload Your System 39
Q&A
Conference Roadmap • • Apache Web Server Cookbook (Training) From CGI to mod_perl 2. 0, Fast! mod_perl for Speed Freaks! Apache Performance Tuning Part 2: Scaling Out • Moving to Apache HTTP Server 2 at Yahoo! • Performance Tuning Apache Tomcat 41
Current Version http: //people. apache. org/~sctemme/Apcon. US 2007/
Thank You
- Apache performance tuning
- Apache web server performance tuning
- Apache traffic server performance
- Ssis data flow performance tuning
- Sql server 2005 performance
- Mainframe mips optimization
- Performance tuning in oracle for beginners
- Glusterfs performance tuning
- Abap performance tuning
- York university moodle
- Frog sql
- Ssas performance tuning
- Sshfs performance tuning
- Maximo performance tuning
- Erm performance tuning
- Database performance tuning and query optimization
- Ms access performance analyzer
- Harrison performance and tuning
- Jörg stryk
- Data warehouse performance tuning
- Terminal server performance tuning
- Informix performance tuning
- Informix performance tuning
- Hawai saared
- Sander põllumäe
- Aysberg buzulu
- Ben sander amd
- Sincretismo percettivo infantile
- Sander cornelis
- Pedro v. sander
- Pedro v. sander
- Hand sander
- Portable electric sander hazards
- Sander eising
- Sander vaneker
- Sander ten kate
- Sander leemans
- Joel sander
- Sander oja
- Color 29052007
- Roland sander
- Sander viilup
- Inductive miner
- Sander claassen