We are already in the era of ‘connected things’ -- our mobile phones, computers, tablets and wearables sync and talk via ‘cloud’.
IoT presents a lot of challenges, especially data coming in at high volume and high velocity - imagine billions of devices each sending readings every few seconds or minutes. All this data need to be stored and analyzed. Plus we need to think about security, privacy and compliance.
In this talk we will present a reference data architecture for IoT. We draw on the industry’s best practices on Big Data including Lambda architecture patterns. Lambda architecture outlines generic, scalable and fault-tolerant data processing. We will illustrate a potential data pipeline and discuss how each stage might be implemented and technology choices at each stage.
