What We’ve Coated
All through the One Massive Cluster Caught sequence we’ve explored impactful finest practices to realize management of your Cloudera Knowledge platform (CDP) atmosphere and considerably enhance its well being and efficiency. We’ve shared code, dashboards, and instruments that will help you in your well being enchancment journey. We’d like to supply one final device.
The Environmental Well being Scorecard
We observe atmosphere well being on the macro degree with a dashboard that mirrors our weblog sequence methodology with just a few additions. We set quarterly OKR (Goals and Key Outcomes) targets to enhance our rating.
At decrease ranges of grain our measurements are data-driven and automatic, however on the macro degree we want to use some subjectivity (in fact our weightings will differ from yours as we’re on a distinct journey). Our information and analytics leaders meet month-to-month to judge our well being enchancment and log subjective measures. Some might name that anecdotal proof however we worth the pairing of our data-driven evaluation with our observable actuality.
Platform Well being
All of it begins with platform well being which we selected to measure in 3 dimensions: {hardware} efficiency, providers efficiency, and optimum configuration/tuning. We offered dozens of how-to manuals to acquire visibility and tune your atmosphere.
Is it shocking that we weighted platform well being solely an 8 on a 100 level scale? Our mannequin considers the period and useful resource dedication required to finish 80% of the journey, and since our platform optimization took only some assets just a few months, we weighted it low. Should you’ve obtained a multiyear platform journey forward of you, you’ll weigh it extra closely.
NOTE: The Optimally configured quantity is only a rely of tunings we accomplished, and the odds are subjective evaluations.
Visibility and Transparency
Weighted a 20?! Yup. It’s that vital to us as we’ve written. We selected separate measures for our personal jobs and our customers’ jobs. With 100% monitoring, alerting (notifications to DevOps), and notifications (to our prospects), why didn’t we earn a 20? As a result of we weren’t as proactive in resolving points as our OKR targets indicated we ought to be.
Knowledge Democratization
Though we didn’t weblog about information democratization, we discover it an vital measure of environmental well being. Each different measurement is meaningless if essential information parts are unavailable to choice makers. By the way, this measure is within the reverse seat of the see-saw because the others: ungoverned information democratization is the one biggest reason behind all the issues we’re attempting to influence. Take into consideration that.
Knowledge Course of Well being
Though we didn’t dedicate a weblog to this well being measure, we offered quite a few directions to restore issues you discover. The objectives we selected within the dashboard are vital to us, however select these which might be vital to you. The person scores are counts however the total well being rating will not be a sum, it’s subjective. This can be a multiyear journey.
Knowledge Asset Standardization
This measure will get our highest weighting at 25 out of 100. The well being of the atmosphere is most depending on the belief that customers have within the information. The higher your information observability, and the higher the quantity that’s accessed through enterprise commonplace dashboards and governance-certified sources of reality, the higher the chance for belief. The belief develops by way of an understanding of the information as maintained by way of metadata in your Knowledge Catalog: classification, lineage, forex, and enterprise context . You may see that we did nice on report standardization however we’ve longer to go to certify our enriched datasets and information marts, and to repipe our customers’ property. One other multiyear journey.
Knowledge High quality & Knowledge Governance Extensibility
Like information standardization this goes to the center of trusted information. We’ve 37 whole well being factors measuring information trustworthiness. Which will appear counterintuitive when utilized to an environmental “well being” measure, however that’s how we see it. You may even see these and different measures otherwise.
Better of Luck!
We smile on the chance that we’d have enabled you to be extra environment friendly or succesful (or each!). Go to our Group Web page, our blogs, and Knowledge and IT Leaders web page for a lot extra.
