Future directions for Apache Flink/Data Artisans
What's in data Artisans roadmap for the evolution of Apache Flink? Here are some of the items, as listed in Flink Forward keynote from Day 2.
What's in data Artisans roadmap for the evolution of Apache Flink? Here are some of the items, as listed in Flink Forward keynote from Day 2.
Unlike the world of relational databases, where SQL is the de facto query language, in graph there is a number of query languages. Images taken from https://developer.ibm.com/dwblog/2017/overview-graph-database-query-languages/
Traditionally, operational databases and platforms for data analysis have been two different worlds. This has come to be seen as natural, as after all the requirements for use cases that need immediate results and transactional integrity are very different from those that need complex analysis and long-running processing.
Remember how we noted data is going the way of the cloud? While there are no signs of this slowing down, there's another interesting trend unraveling, the so-called Insight Platforms as a Service (IPaaS). The thinking behind this is simple: if your data is in the cloud anyway, why not use a platform that's also in the cloud to run analytics on them, and automate as much of the process as possible?
The endless streams of data generated by applications lends its name to this paradigm, but also brings some hard to deal with requirements to the table: How do you deal with querying semantics and implementation when your data is not finite, what kind of processing can you do on such data, and how do you combine it with data from other sources or feed it to your machine learning pipelines, and do this at production scale?
The pace of change is catalyzed and accelerated at large by data itself, in a self-fulfilling prophecy of sorts: data-driven product -> more data -> better insights -> more profit -> more investment -> better product -> more data. So while some are still struggling to deal with basic issues related to data collection and storage, governance, security, organizational culture, and skillset, others are more concerned with the higher end of the big data hierarchy of needs.
As descriptive and diagnostic analytics are getting commoditized, we are moving up the stack towards predictive and prescriptive analytics. Predictive analytics is about being able to forecast what's coming next based on what's happened so far, while prescriptive analytics is about taking the right course of action to make a desirable outcome happen.
Not only does Acronis Backup 12.5 Advanced and Standard Editions ensure the authenticity and integrity of data backups by storing backup file checksum certificates in the blockchain database, it also features automatic ransomware protection.
Flink is moving forward in release 1.2, with an array of new features.
While this may seem like a theoretical construct, its implications can be far-reaching.