The Microsoft Azure Container Networking crew is worked up to announce Retina, a cloud-native container networking observability platform that allows Kubernetes customers, admins, and builders to visualise, observe, debug, and analyze Kubernetes’ workload visitors regardless of Container Community Interface (CNI), working system (OS), and cloud. We’re excited to launch Retina as an open-source repository that helps with DevOps and SecOps associated networking instances in your Kubernetes clusters and we invite the open-source group to innovate together with us.
Retina
A cloud-native container networking observability platform
Embracing and advancing open-source software program
Cloud native applied sciences like Kubernetes have made constructing functions that may run anyplace, simpler. On the similar time, many functions have develop into extra advanced, and managing them within the cloud is more and more tough. As firms construct cloud-native functions composed of interconnected providers after which deploy them to a number of public clouds in addition to their non-public infrastructure, community associated observability, troubleshooting, and debugging has develop into more and more tough.
With the ability of prolonged Berkley Packet Filter (eBPF), it’s now potential to supply actionable community insights together with how containerized micro-services work together and accomplish that in non-intrusive methods with none change within the functions itself—that’s precisely what Retina units out to attain. Retina will assist democratize community observability and troubleshooting by bringing new focus to the expertise of utility builders. Retina offers builders with easy methods to watch and troubleshoot their functions for points reminiscent of packet drops and latency with out worrying in regards to the complexities of the underlying community infrastructure and transformations.
Based mostly on our optimistic expertise locally with eBPF and Cilium, we’re excited to construct on this relationship and interact each extra intently and with extra communities. We imagine that by opening Retina to the group, we are able to profit from knowledgeable suggestions, modern concepts, and collaborative efforts that can assist improve and develop Retina’s capabilities.
Retina options and capabilities
Drawing from our intensive expertise managing a number of container networking providers for the Azure Kubernetes Service (AKS), we recognized important gaps in community monitoring, the gathering of community metrics and traces from Kubernetes clusters. Retina is a cutting-edge answer that closes these gaps and is designed to deal with the advanced challenges of managing and supporting Kubernetes networks offering infrastructure- and site-reliability engineers complete insights into cluster networking. Retina additionally offers deep visitors evaluation with Kubernetes-specific context, translating metrics into both industry-standard Prometheus or community stream logs.
Current open-source options are sometimes tightly coupled with particular CNI’s, OS, or knowledge planes, thereby limiting their versatility and use. For that reason, Retina has been designed and developed to be a extremely versatile, adaptable, and extensible framework of plugins able to working seamlessly with any CNI, OS, or cloud supplier—making it a invaluable addition to any present toolset. Retina helps each Linux and Home windows knowledge planes, guaranteeing it meets the varied wants of infrastructure- and site-reliability engineers, whereas sustaining a minimal reminiscence and CPU footprint on the cluster—this stays true even at scale. Retina’s pluggability design ethos helps us simply lengthen and adapt to handle new use instances with out relying on any particular CNI, OS, or knowledge airplane.
Considered one of Retina’s key options offers deep community visitors insights that embrace Layer 4 (L4) metrics, Area Identify System (DNS) metrics, and distributed packet captures. It seamlessly integrates the Kubernetes app mannequin providing pod-level metrics with detailed context. It emits actionable networking observability knowledge into industry-standard Prometheus metrics offering node-level metrics (for instance, ahead, drop, Transmission Management Protocol (TCP), Consumer Datagram Protocol (UDP), and Linux utility) and pod-level metrics (reminiscent of fundamental metrics, DNS, and API server latency.)
Retina’s distributed packet captures are label-driven—permitting customers to specify what, the place, and who to seize packets from. Moreover, it offers historic context of community stream logs and superior debugging capabilities that improve community troubleshooting and efficiency optimization.
Our imaginative and prescient for Retina
Many enterprises are multi-cloud and need options that work nicely not simply on Microsoft Azure, however on different clouds in addition to on-premises. Retina is open-source and multi-cloud from day one. By open-sourcing Retina, we purpose to share our data and imaginative and prescient for Kubernetes networking observability with the broader cloud-native ecosystem. Our hope is that Retina will evolve and develop by means of collaboration with different builders and organizations who share related experiences and objectives on this area.
By way of structure, extensibility was key from the outset and can stay going ahead. Retina provides extensibility in knowledge assortment—permitting customers to simply add new metrics and insights. It additionally provides extensibility in exporters—enabling customers to combine with different monitoring techniques and instruments. This flexibility ensures that Retina can adapt to completely different use instances and environments, making it a flexible and highly effective platform for Kubernetes networking observability. In conclusion, we envision Retina as a platform permitting anybody to contribute, lengthen, and innovate on in the end creating a strong, purpose-built, and complete answer for Kubernetes networking observability.
Getting began
We hope this weblog publish has given you an outline of Retina, its options, and advantages. Retina is a challenge that we’re very enthusiastic about, and we welcome your suggestions, options, and contributions. Whether or not you’re a community engineer, a DevOps engineer, a web site reliability engineer, or a cloud-native fanatic, we invite you to check out Retina and see the way it may also help you acquire deeper visibility into your Kubernetes networks.
