I simply spoke at Zero Gravity by Incorta, a contemporary cloud knowledge pipeline occasion. I’ve been working with knowledge pipelines for years, so it was wonderful sharing about my experiences taming the chaos in right this moment’s fashionable knowledge stack!
In case you missed my speak or need to dive into the main points, right here’s my slide deck from this speak. If in case you have any questions, please drop a remark or attain out to me on Twitter or LinkedIn!
As we speak, metadata is in every single place. Each part of the trendy knowledge stack and each person interplay on it generates metadata. Aside from conventional varieties like technical metadata (e.g. schemas) and enterprise metadata (e.g. taxonomy, glossary), our knowledge techniques now create fully new types of metadata.
All these new types of metadata are being created by residing knowledge techniques, typically in real-time. This has led to an explosion within the measurement and scale of metadata. Nevertheless, this has made it tough for centralized knowledge engineering and reporting groups to completely leverage metadata that holds the important thing to the elusive promised land — a single supply of reality.
Groups right this moment battle to maintain tempo with “service requests” and to ramp up on area experience wanted. The online result’s misplaced alternative. However by successfully amassing metadata, a crew can unify context about all their instruments, processes, and knowledge.
This session covers how can knowledge groups leverage metadata to energy higher collaboration, enabling organizations to speed up onboarding and construct knowledge merchandise outdoors the central crew. I’ll cowl lively metadata and the way its utility by means of embedded collaboration, open API interface, powered by information graphs, programmable-intelligence bots, knowledge course of automation, reverse metadata, might help meet enterprise governance requirements.
Curious to be taught extra? Right here’s extra info on all the things I referenced throughout my speak:
