December is normally a busy time of last-minute procuring, events, celebrations, and wrapping items. As we closed out December, we spent a whole lot of time giving the reward of extra nice options and enhancements to the Atlan platform.
Listed below are our 11 favourite options from December 2022, that includes new integrations, insights, price optimizations, automations, metrics, and extra.
Supporting and integrating your (meta)information household
The 12 months’s finish is a superb time to mirror on the previous 12 months and sit up for the 12 months forward. At Atlan, we wish to create the energetic metadata layer throughout the complete information stack. From fashionable cloud warehouses to conventional documentation instruments, we launched new connections and integrations in December to assist all of your wants.
1. New Hive Connector bundle
Folks usually ask about our assist for file techniques like Parquet, Avro, Iceberg, and extra. We all know your entire information is essential, so we’re excited to introduce our Hive integration to deal with these distributed file techniques.
Now you’ll be able to connect with Hive, catalog your entire tables, and think about pattern information extracted from the desk. As soon as the info is introduced in, customers can leverage the asset 360° profiles for his or her Hive property to assign possession, apply certificates, tag classifications, affiliate the right enterprise phrases, and even run queries to additional discover the info.
2. Google Sheets: assist for brand spanking new information property and downloadable lineage affect evaluation
Spreadsheets have at all times been the OG of information documentation. Earlier within the 12 months, we launched our integration with Google Sheets to hurry up the metadata documentation course of for information groups. Now, we’ve got expanded that integration to make documentation even simpler and extra sturdy throughout your complete information property.
Now you’ll be able to import column-level metadata from Tableau information sources, Energy BI tables, Looker Explores, and Salesforce objects instantly into Google Sheets. This makes it simpler to doc metadata from a number of information property, lowering handbook documentation and releasing up beneficial time for information groups.
As well as, now you can fetch and obtain an information asset’s downstream affect in Google Sheets. Understanding how a easy change to 1 asset can affect property downstream is vital to the steadiness and belief of the enterprise. One change to a dataset upstream can create chaos in downstream information pipelines and dashboards, leading to a disruption to the enterprise. This downstream affect evaluation will assist customers stop breaks and preserve belief as they modify upstream property.
Purchasing the most well-liked information property and saving on prices
Each vacation season, individuals are searching for methods to seek out and save on these “must-have” objects. Wouldn’t or not it’s nice if we may assist information groups and information shoppers with the identical idea? This set of releases helps information groups not solely save prices but in addition perceive the “most-used” property of their information property.
3. Value-optimized information preview for BigQuery
Everyone seems to be wanting to save cash in the course of the holidays, and it’s no totally different on the subject of your cloud information warehouse payments.
With this launch, customers can now lower your expenses with a brand new information preview function for all BigQuery table-type property. Out there within the Property and Insights tab, customers obtain a value nudge with the exact bytes that might be spent whereas executing a question. This seems for all property, corresponding to views, materialized views, and so forth. From there, customers can resolve in the event that they nonetheless wish to proceed working the question based mostly on the quantity of bytes spent.
4. Recognition and utilization metrics for Snowflake
Controlling information prices usually comes all the way down to understanding which information property you’ll be able to belief, which have recent information, that are used usually, and which might be eradicated. That’s why we’ve added new utilization and recognition metrics to assist information groups handle their Snowflake property.
Use these capabilities to save lots of cloud information warehouse spending prices by figuring out essentially the most used property, studying which queries are sluggish or costly, discovering individuals with essentially the most context on every information asset, and extra.
Empowering everybody with queries and insights
Whether or not you have fun the tip of the 12 months with Christmas, Hanukkah, Kwanzaa, or one other custom fully, the vacations are about embracing variety — and Atlan is simply the identical. Information groups like to question info in a wide range of methods. One of many methods we assist this variety is thru Atlan’s Insights tab, the place you need to use customized SQL-based queries to discover and analyze your entire information property. Now we’ve got made this expertise even simpler, extra intuitive, and extra highly effective.
5. Search and kind capabilities come to question outcomes
Who doesn’t love to question information? However what occurs when the outcomes are within the flawed order, otherwise you overlook to jot down a kind command in your SQL? Or what when you merely can’t discover an merchandise within the outcomes that you simply’re searching for?
At Atlan, we by no means miss an opportunity to reinforce our person expertise. Now, with simply the clicking of a button, you’ll be able to type the info columns in both ascending or descending order. You can too use the search bar to seek out an merchandise you need and get the outcomes you want. These two capabilities restrict the necessity for SQL and scale back the variety of queries you should get the fitting outcomes.
6. Higher management over question collections
Capturing and disseminating essential data is vital for empowering various information individuals and serving to them succeed.
With this launch, extra individuals can add their data to question collections. Whereas solely the gathering proprietor can delete a group, different members can now invite, replace, and handle the gathering. All of this ensures that essential data is captured and maintained even when the question proprietor leaves or is unavailable.
7. Updates to the Insights Dashboard
Understanding how individuals are querying your group’s information is usually a problem. Now, within the Atlan Reporting Heart, you may get the insights you want with the Insights tab.
- Examine what number of visible queries have been saved, and who the highest customers are
- Monitor all the saved queries, for each SQL and visible queries
- Discover all scheduled queries arrange in Atlan, sorted by frequency, together with the highest customers scheduling queries
- Discover different facets like connectors, licensed property, classifications, and extra.
Activating the fashionable information stack with end-to-end lineage
Information lineage performs a key position in fixing issues like root trigger evaluation or affect evaluation. And the extra various your information property, the extra essential lineage turns into for understanding how they’re all associated. That’s why Atlan is all about activating end-to-end information lineage to your complete information property, from information sources to the BI layer.
8. New Atlan + dbt partnership is now GA!
A few of you’ll have heard about Atlan and dbt’s partnership and Semantic Layer integration. Right now, we’re excited to launch Atlan + dbt for everybody!
Atlan pulls in metrics and fashions from dbt and maps column-level lineage throughout the fashionable information stack, creating 360° context to your information and serving to information groups work collectively higher. Atlan’s deep integration with dbt and its Semantic Layer additionally enables you to create repeatable, metadata properties — like desk homeowners and verified tags — in your dbt fashions.
9. Checklist-based search in lineage graphs
When attempting to view a big lineage graph, the flexibility to seek for property in that graph turns out to be useful. To make that have far more seamless, we’ve got launched list-based search that can assist you shortly discover lineage.
All the property in a graph will now present up as an inventory as quickly as you attempt to search the lineage graph. Merely click on or sort the asset title you might be searching for, and the asset and its related lineage might be highlighted.
Delivering the magic of automation
The top of the 12 months is normally hectic — a lot to do, so little time. Wouldn’t or not it’s nice if there was a magic wand to assist full all the duties that you’ve got in your record?
Whereas we aren’t magicians right here at Atlan, we do like to automate wherever doable. Prior to now, we’ve introduce options like our Google integration or Trident strategies to automate handbook duties. However this month included our greatest automation win up to now.
10. Introducing Atlan Playbooks
One of many widespread questions we get from information groups is, “How can we automate our metadata?” Whereas different groups like advertising or gross sales can do action-based automation at scale with instruments like Zapier or Salesforce, information groups don’t have the bandwidth to code customized automations for every various use case. Why can’t there be a Zapier for metadata?
That’s the reason we’ve got developed the primary low-code/no-code metadata automation for information groups. With Atlan’s Playbooks, customers can now create rule-based automations at scale. These can drive infinite use instances throughout your group, all the pieces from deprecating unused property and defending delicate information to altering possession and reporting failed property.
Including a sprinkle of vacation cheer for Admins
We are able to always remember those that are in control of governing and managing a corporation’s information property. Sure, the admins. The individuals who play probably the most essential roles in a corporation — disseminating the info property that information groups must assist various enterprise use instances.
11. New overview web page for Workflows
Workflows is a busy place, with connections to create, jobs to run, and the most recent runs to observe. All of this may be tough for admins to handle and not using a single view into all these actions. To make life simpler, we’ve got added an outline web page for every connection, permitting admins to immediately get details about the most recent runs for a specific workflow and extra.
We’re at all times working to assist information groups get essentially the most from metadata throughout their information property, and this month’s new options are only a few of the 200 updates we delivered all year long. Take a look at our favourite options from 2022 or our November product roundup for much more metadata magic.
💡 To be taught extra in regards to the newest options in Atlan, try shipped.atlan.com. You can too subscribe to our Product Updates publication for all updates.
💡 To be taught extra about all of our releases, try shipped.atlan.com. You can too subscribe to our Product Updates publication for all the most recent information.
💡 To take a look at Atlan for your self, go to our product tour.
💡 Prepared to begin utilizing these new options? Attain out to our Gross sales group or your Buyer Success Supervisor to learn how.
