By launching Databricks in 2013, the company’s founders ventured out of the University of California, Berkeley, into entrepreneurship after four years of research and development. The foundation of their success – the distributed cluster computing framework “Spark” – became a top-level Apache Software Foundation project shortly thereafter and has had more than 1,200 contributors from over 300 companies to date.
Here’s what’s really special about this project: With up to 100x speed for data transformation and complex streaming applications, it’s possible to overcome the limitations of Hadoop installations. The innovative ecosystem for artificial intelligence and machine learning, ease of use, and multi-language support for Python, Java, Scala, R, and SQL also contribute significantly to the high level of dissemination.
With “Microsoft Azure Databricks” and “Databricks on AWS,” Databricks offers complete Spark environments, optimized for the cloud. Particularly impressive features include the decoupling of “storage” and “computing,” the minimal time required for implementation and operation, and consumption-based billing. In addition, there are functionalities such as “Databricks Delta,” right-role concepts, and single sign-on.
initions has been a Databricks partner since 2017. Since 2019, we have been a Premier Partner SI (System Integrator) at the highest partner level of Databricks. With our certified team of data engineers and data scientists, we develop architectures, implement solutions, realize proofs of concept, and conduct training sessions.
Applications can be found in everything from artificial intelligence (machine learning), near-real-time streaming, and IoT and data lake requirements. This includes issues in time series analysis and time series prediction, fraud detection, and image recognition as well as application scenarios from industry 4.0, sensor data processing, and integration of trading systems.
Beyond the development of machine learning models, we realize concepts for the entire “end-to-end machine learning life-cycle” and productive use.
As “Top Regional Partner DACH,” initions was given an award by Databricks at the Spark+AI Summit Europe 2019 for its close and successful cooperation.