Initially revealed on April 12, 2022.
As firms transfer to Spark and a Lakehouse structure, they’re realizing that the info instruments are lagging manner behind. It’s essential to be a programmer to successfully use Spark and Airflow.
There are some low-code ETL instruments, however is that sufficient? Corporations need to deal with their knowledge pipelines like mission-critical apps. They need DevOps for knowledge, with GIT, take a look at protection, and CI/CD. As well as, firms want end-to-end visibility of their knowledge pipelines, together with monitoring, metadata, and column-level lineage.
The place are the info instruments for these capabilities and the way do non-programmers use these?
In in the present day’s podcast, you’ll see how Prophecy’s low-code knowledge engineering platform, constructed on Spark and Airflow, offers a whole resolution for creating, deploying, and monitoring knowledge pipelines. We’ll communicate with Raj Bains, who’s the founder & CEO of Prophecy.
Raj has spent 20 years constructing highly effective instruments – Microsoft Visible Studio, founding engineer for CUDA at NVIDIA, product supervisor for Hive at Hortonworks. He’s captivated with making all organizations productive with knowledge and making the lives of knowledge engineers higher by decreasing toil and growing the enjoyment.
Additionally, when you like what you hear, Prophecy has a particular provide for our listeners. Go to Prophecy.IO/request-a-demo and put in “SED” for the referral code. Should you resolve to buy inside 3 months of the demo, you get 10% off. If you buy after 3 months, you continue to get 5% off.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
Transcript
Transcript offered by We Edit Podcasts. Software program Engineering Every day listeners can go to weeditpodcasts.com to get 15% off the primary three months of audio modifying and transcription providers with code: SED. Because of We Edit Podcasts for partnering with SE Every day. Please click on right here to view this present’s transcript.