Professional Documents
Culture Documents
0 To 60 in 3.1: Tyler Carlton Cory Sessions
0 To 60 in 3.1: Tyler Carlton Cory Sessions
1
Presented by,
MySQL AB® & O’Reilly Media, Inc.
Tyler Carlton
Cory Sessions
<Insert funny joke here>
Presented by,
MySQL AB® & O’Reilly Media, Inc.
The Project
Medium sized demographics data mining
project
1,700,000+ User base
Hundreds of data points per user
“Legacy” System – Why Upgrade?
Main DB (External Users)
Offline backup (Internal Users)
+
Weekly manual copy backups
Max of 3 simultaneous data
pulls
8hr+ data pull times for
complex data pulls
Random index corruption
Notes:
Smaller is Better
Scalable
Distributed processing
5 – 9’s Reliability
Instant data availability
between internal
& external users
What We Built – NDB Data Nodes
8 Node NDB cluster
Dual Core 2 Quad 1.8 ghz
16 Gig ram (Data memory)
6x Raid 10 SAS 15k RPM drives
What We Built – API & MGMT Nodes
3 API nodes + 1 management node
Dual Core 2 Quad 1.8 ghz
8 Gig ram
300 gig 7200rpm (Raid 0)
NDB Issues with a Large Data Set
NDB load times
Loading from backup: ~ 1 hour
Restarting NDB nodes: ~ 1 hour
Totaling 75 MBs
during peak(600 Mbs)
Monitoring & Maintenance
SNMP Monitoring: CPU, Network, Memory, Load, Disk
Cron Scripts:
Node status &
Node down notification
Backups
Database maintenance routines
Tyler Carlton
www.qdial.com
tcarlton@gmail.com
Cory Sessions
CorySessions.com
OrangeSoda.com