I saw an interesting Tech Target blog on the storage requirements associated with Big Data projects recently. It’s interesting to see just how many technology concepts are now either blurring together or becoming interdependent.
Consider this as an example. A shipping company installs tracking devices on every vehicle and container they use – it might be tens of thousands of individual items that can now be tracked and monitored and more effectively moved into position. Clearly that increased efficiency is great for the company, but what does it mean in terms of additional IT infrastructure?
First there is a need for an IoT strategy – the Internet of Things – where all these individual items can be tagged and monitored in some way. Either they can independently broadcast their location or they can be monitored using devices that pass in close proximity to them.
So the sheer amount of information that is being captured requires a Big Data strategy because instead of just having an inventory of items, now you need to model the items and their location in real-time. Your database has to become a reflection of the business.
Then a data analysis strategy is required because you need to build models that can maximise the efficiency of the data model and improve on what humans can do manually. As the machines learn the optimum processes, much of the system will be able to run automatically.
But underpinning all of this will be a storage strategy because the amount of data that is created, stored, and manipulated will be huge compared to earlier inventory-based systems. In some cases the data capture will appear to be extraneous – capturing the movement around a port of a single container might not by itself add a lot of value to your business, but when aggregated with the location and movement of every container and analysed, efficiencies can be created.
And this leads back to the use of a cloud strategy to ensure that all these systems always have the storage and computing power available whenever needed.
It’s becoming hard to consider any of these strategies as distinct from each other because the way that IT projects work today has moved far from the world of PC-based applications. Enterprise systems are getting bigger and better, but they need more consideration and strategic planning to succeed.