Data processing : challenges and tools

The need to process large amounts of data in real-time is becoming a critical need in many areas such as social network trends, website statistics and intrusion detection in large data centres.