By Tim Gasper and Juan Sequeda
At data.world, we believe that when the world's data is transformed into knowledge, opportunities emerge for everyone. This is accomplished by creating a connected web of data, metadata, and organizational knowledge. It’s why data.world was the first modern data catalog built on a knowledge graph and the only one to operationalize its benefits for everyday use.
Why Knowledge Graphs
Why did we build our catalog on a knowledge graph and not relational or traditional graph data stores? Just look at Facebook, Amazon, Google, and Netflix. What do they all have in common? Their intelligent, highly adopted user experiences run on knowledge graphs under the hood. Knowledge graphs changed the game in big tech and they can have a similar impact in the enterprise.
Current state of affairs
The problem with existing data catalog solutions is twofold:
First, top down governance has failed us. We've tried to institutionalize governance and this has led to the creation of more silos, barriers and has slowed the path to insight. Data teams are not growing as fast as the complexity of data, systems, and business questions that need to be answered. We need a modern, intelligent approach that accelerates the path to insight, saves time and is scalable.
Second, machine learning is not a silver bullet. Without context, traditional approaches to automation are often cosmetic, incorrect and incomplete. Some data catalogs leverage simplistic machine learning that doesn’t help operationalize or create trusted data products. Others deliver complex, top-down workflows that discourage participation and fail to address the challenges of siloed data. Only a knowledge graph can navigate the complex relationships between people and data to deliver relevant, contextual automations.
What’s the solution to address these challenges?
Introducing Eureka™
We’re excited to announce Eureka™, a new suite of knowledge-graph powered data catalog capabilities. Eureka™ is the face of data.world's knowledge graph, helping data teams save time and scale, so your organization can do governance better and more comprehensively. Now you can accelerate time to insight with your data catalog at the center.
Eureka™ is made up of four capabilities:
Eureka Bots™
data.world with Eureka Bots™ enables you to build your data catalog quickly and at scale with intelligence. Before, you would have to do manual work to set up your catalog such as add relationships, tags, policies, stewards. Machine learning can help but lacks the key context and knowledge of your organization. Now you can use data.world’s knowledge graph and semantic query engine to automatically populate people, policy, context-oriented fields, and all types of relationships.
Some examples:
- Automatically generate a business glossary from database metadata and connect it to tables and columns
- Automatically tag and organize your metadata
- Automatically generate relationships
- Automatically apply people roles and assignments
- Automatically propagate sensitive data types and apply governance policies
- Automatically calculate popularity, complexity, and quality scores
Eureka Action Center™
Eureka Action Center™ sets you up with what is the next action you should focus on, specific to your role. Before, you didn’t know the context of all the work and where you should start. Now, data.world is the home for the actions that you need to work on next. It takes insights and pushes it to the places that matter using webhooks, Slack integration, etc.
For example:
- As a data engineer, you can focus on broken pipelines, issues, hotspots, clusters.
- As a data steward, you can focus on popular assets that are under-documented, draw attention to potential governance issues, and track the usage of your data products.
- As a data consumer: you can find popular assets and get back to important or recent work fast
Eureka Answers™
Eureka Answers™ delivers an intelligent search experience. When you search in other catalogs, you just get a list of things. With data.world, you not only get the answer, you get the concept you are looking for, just like a knowledge card on search engines. This means less time searching and more time doing.
- Search for “Orders” – quickly understand the “Order” concept, the best data to access, the most relevant related dashboards, and key people who you can ask questions – all without a single additional click.
Eureka Explorer™
Coming this fall, Eureka Explorer™ will enable you to visually explore your knowledge graph. We are the only data catalog that shows you the clusters, where the sensitive data is coming from and where it is flowing, popular data resources, and more. You can see the forest from the trees, but also zoom into the trees, such as column-level technical lineage.
See what Eureka™ can do for you
Harness the power of the knowledge graph to save time and scale your organization today. Get a demo of data.world with Eureka™.
