Protobuff and gRPC

Mar 2, 2023Download as PPTX, PDF0 likes28 views

Protocol Buffer & gRPC Protocol buffers are a data serialization format that allows structured data to be converted into a format that can be stored or shared across systems. It provides a compact binary format that is faster and smaller than JSON. Protocol buffers use an IDL (interface description language) to define the schema, which is then used to generate code for reading and writing protocol buffer data in multiple languages. gRPC is an open source RPC framework developed by Google that uses protocol buffers for data serialization and HTTP/2 for transport. It supports various types of interactions including unary, server-streaming, client-streaming, and bidirectional streaming.

Data Serialization
Data serialization is the process of converting structured data to a format that allows
sharing or storing of data in a from that allow recovery of its original structure. De-
serialization is the exact opposite.
Serialization formats
• XML
• JSON
• CSV
• YML
• Protobuf etc.

Protocol buffers
• Protocol buffers are a flexible, efficient, automated mechanism for serializing structured
data and its
• Language-neutral
• Platform-neutral
• Extensible

JSON
• Advantages
• Data can take any forms (arrays, nested elements)
• Is a widely accepted format in web
• Can ne read by pretty much any language
• Can be easily shared over a network
• Disadvantages
• Data has no schema enforcing
• Json Objects can be quite big in size because of repeated keys
• No comments, metadata

protobuff
• Advantages
• Data is fully typed
• Data is compressed automatically (less CPU usage)
• Schema is needed to generate code and read the data
• Documentation can be embedded in the schema
• Data can be read across any language(Java, C#, Go, Python, JS etc..)
• Schema can be evolved over the time, in a safe manner
• 3-10x smaller, 20-100x faster then XML
• Code is generated for you automatically
• Disadvantages:
• Support for some language might be lacking
• Can’t open the serialized data with the text editor

$Structure message Person { string first_name = 1; string last_name = 2; int32 age = 3; }$

gRPC
• Developed by Google, under the name Stubby.
• In 2015 Google liberalized it as open source and named it gRPC.
• Adopted by large companies in the very first year like Netflix, Cisco, Docker etc.
• Became part of Cloud Native Computing Foundation in 2017.

Core features that make it awesome
• Idiomatic client libraries in 11 languages
• Highly efficient on wire and with a simple service definition framework
• Bi-directional streaming with http/2 based transport
• Pluggable auth, tracing, load balancing and health checking

gRPC Interaction
• Unary: when the client sends a single request and receives a single response.
• Server-streaming: when the server responds with a stream of messages to a client's request.
Once all the data is sent, the server additionally delivers a status message to complete the
• Client-streaming: when the client sends a stream of messages and in turn receives a single
response message from the server.
• Bidirectional-streaming: the two streams (client and server) are independent, meaning that they
both can transmit messages in any order. The client is the one who initiates and ends the

A presentation given by Sumit Amar, Vice President of Engineering at WEX , at our 2024 Platform Summit, October 8-9. In this session we will evaluate various data formats (JSON, XML, Protocol Buffers, and YAML), and discuss their pros and cons in varying scenarios. We will also evaluate how they pair with adequate data channels (HTTP/S, Binary over gRPC, gRPCweb in browsers, or Web Sockets). We will review various API use cases and map them with the right combination of data formats and channels for best performance, scalability, and maintainability.

Introduction to gRPC. Advantages and Disadvantagesabdulrehmanlatif65

��

Web technologies: recap on TCP-IPPiero Fraternali

��

TCP/IP is the standard communication protocol on the internet. It is comprised of several layers including application, transport, internet, and link layers. The transport layer includes TCP and UDP which provide connection-oriented and connectionless data transmission respectively. TCP ensures reliable data delivery through features like connections, acknowledgments, and flow control. IPv6 is the latest version of the Internet Protocol which addresses the shortcomings of IPv4 like limited address space. IPv6 features include a larger 128-bit address space, simplified header format, built-in security, and autoconfiguration capabilities.

Module 5 Application and presentation Layer .pptxAASTHAJAJOO

��

The document discusses the application and presentation layers of the OSI model. It provides details on: - The application layer protocols like HTTP, FTP, email and how they use the transport layer protocols TCP and UDP. - The traditional client-server and new peer-to-peer paradigms used at the application layer. - How the HTTP protocol works for the world wide web including URL structure, static/dynamic web documents, browser and server functions. - The key components and functioning of specific application layer protocols - FTP for file transfer and email for electronic mail exchange.

UNIT I DIS.pptxPremkumar R

��

This document discusses distributed systems and key concepts related to communication in distributed environments. It begins with an introduction to distributed systems and examples. It then covers challenges like APIs for internet protocols, external data representation and marshaling, multicast communication, remote procedure calls, and group communication. Key aspects of distributed systems like features, quality of service parameters, resource sharing, and examples are also summarized.

Data Communication and Newtworking 1 .pptxSidraAhmad29

��

Data Communication and Newtworking 1 .pptxSidraAhmad29

��

Hadoop introductionmusrath mohammad

��

Hadoop Ecosystem and Low Latency Streaming ArchitectureInSemble

��

Modern Distributed Messaging and RPCMax Alexejev

��

This document provides an overview of lightweight messaging and remote procedure call (RPC) systems in distributed systems. It discusses messaging systems, typical peer-to-peer and broker-based messaging topologies, characteristics and features of messaging systems, main classes of messaging systems including enterprise service buses (ESBs), JMS implementations, AMQP implementations, and lightweight modern systems. It also covers RPC, serialization libraries, differences between messaging and RPC, examples of ZeroMQ for peer-to-peer messaging, Apache Kafka for broker-based messaging, and Twitter Finagle for scalable RPC.

Linux Inter Process CommunicationAbhishek Sagar

��

his Course is about learning How Linux Processes Talk to each Other. This is a sub-domain of Linux System Programming. We shall explore various popular mechanism used in the industry through which Linux processes to exchange data with each other. We will go through the concepts in detail behind each IPC mechanism, discuss the implementation, and design and analyze the situation where the given IPC is preferred over others.

Hpc lunch and learnJohn D Almon

��

This document discusses ideas and technologies for building scalable software systems and processing big data. It covers: 1. Bi-modal distribution of developers shapes architecture/design and the need for loosely/tightly coupled code. 2. Internet companies like Google and Facebook innovate at large scale using open source tools and REST architectures. 3. A REST architecture allows scalability, extensible development, and integration of tools/ideas from the internet for non-internet applications.

403983283sdsadsadsadasdsda-CCNA-PPT-pptx.pptxmindhackers161

��

Data Serialization in Python JSON vs. PickleInexture Solutions

��

Unit 1 web technology uptu slideAbhishek Kesharwani

��

The document discusses web technology and client-server computing. It provides an overview of the history and development of the World Wide Web from its creation by Tim Berners-Lee in 1989. It describes common web protocols like HTTP, TCP/IP, FTP, and SMTP. It also discusses strategies for web development projects and how to connect devices to the internet. Finally, it outlines the basic roles and interactions in a client-server computing model.

(ATS3-DEV04) Introduction to Pipeline Pilot Protocol Development for DevelopersBIOVIA

��

An overview of techniques for building Pipeline Pilot protocols, using the languages and paradigms familiar to software developers. Sound engineering principles should be applied to the development of protocols, so this session will discuss concepts like modularity and re-use, minimizing side effects, clarity of interfaces, multi-threading, version control. We will also cover the data pipelining architecture of Pipeline Pilot and how that affects the approach to protocol authoring.

Common crawlpresentationHadoop User Group

��

CommonCrawl is a non-profit organization that builds a comprehensive web-scale crawl using Hadoop. It crawls broadly and frequently across all top-level domains, prioritizing the crawl based on rank and freshness. The data is uploaded to Amazon S3 and made widely accessible to enable innovation. CommonCrawl uses a modest Hadoop cluster to crawl over 100 million URLs per day and processes over 800 million documents during post processing. The goal is to reduce the cost of "mapping and reducing the internet" to spur new opportunities.

Building a Scalable Web Crawler with HadoopHadoop User Group

��

Building a Scalable Web Crawler with Hadoop by Ahad Rana from CommonCrawl Ahad Rana, engineer at CommonCrawl, will go over CommonCrawl’s extensive use of Hadoop to fulfill their mission of building an open, and accessible Web-Scale crawl. He will discuss their Hadoop data processing pipeline, including their PageRank implementation, describe techniques they use to optimize Hadoop, discuss the design of their URL Metadata service, and conclude with details on how you can leverage the crawl (using Hadoop) today.

IT-NET GROUP 3 REPORT.pptxEdJulleza

��

The document discusses the session layer, presentation layer, and application layer of the OSI model. It provides details on the functions and protocols of each layer. It also discusses the layers of the TCP/IP model and how they compare to the OSI model layers. The networking layers allow systems to establish communication sessions, format and encrypt data, and provide services to application processes. Common protocols like TCP, IP, HTTP, and FTP are described.

Application Layerushabarad142

��

Viloria osi layer4-7Jhoniel Viloria

��

The document discusses the Open Systems Interconnection (OSI) reference model, which introduced standards for network communication. The OSI model organizes network functions into seven layers, with each layer building on the services provided by the previous layer. Layers 1-4 deal with flow of data through the network, while layers 5-7 deal with services for applications. The model helps ensure compatibility between different network technologies.

Building an Event Bus at Scalejimriecken

��

At Hootsuite, we've been transitioning from a single monolithic PHP application to a set of scalable Scala-based microservices. To avoid excessive coupling between services, we've implemented an event system using Apache Kafka that allows events to be reliably produced + consumed asynchronously from services as well as data stores. In this presentation, I talk about: - Why we chose Kafka - How we set up our Kafka clusters to be scalable, highly available, and multi-data-center aware. - How we produce + consume events - How we ensure that events can be understood by all parts of our system (Some that are implemented in other programming languages like PHP and Python) and how we handle evolving event payload data.

MODULE-5_CCN.pptxDr. Shivashankar

��

The document discusses the course outcomes and modules for a Computer Network course. The course aims to help students understand networking concepts and protocols at different layers. It will cover topics like network architectures, protocols, configurations, and analysis of simple networks. The textbook listed is Data Communications and Networking by Forouzan. Module 5 focuses on the application layer and protocols like SMTP, FTP, DNS etc. It also discusses client-server and peer-to-peer paradigms along with HTTP, web clients and servers, URLs, and caching using proxy servers.

Summer 2017 undergraduate research powerpointChristopher Dubois

��

Computer Networks Module 1-part 1.pdfShanthalaKV

��

18CS52 VTU Computer Network & Security MODULE 1-Part 1 Principles of Network Applications: Network Application Architectures, Processes Communicating, Transport Services Available to Applications, Transport Services Provided by the Internet, Application-Layer Protocols. The Web and HTTP: Overview of HTTP, Non-persistent and Persistent Connections, HTTP Message Format, User-Server Interaction: Cookies, Web Caching, The Conditional GET, File Transfer: FTP Commands & Replies, Electronic Mail in the Internet: SMTP, Comparison with HTTP, Mail Message Format, Mail Access Protocols

[Distributed System] ch4. interprocess communicationGyuhyeon Nam

��

RPC in SmalltalkESUG

��

RPC allows calling methods on remote objects by marshalling parameters and unmarshalling return values. There are many challenges to RPC including unreliable networks, latency, security, and changing topologies. Smalltalk supports RPC through mechanisms like distributed events, value/reference passing, and marshaling objects to formats like JSON to enable communication across networks and between systems. Developing distributed systems requires strategies for handling issues like passing large objects efficiently and updating interfaces when remote objects change.

Mcroservices with docker kubernetes, goang and grpc, overviewFaculty of Technical Sciences, University of Novi Sad

��

This document discusses technologies used for distributed systems and microservices including Golang, Protocol Buffers (Protobuf), gRPC, HTTP/2, Docker, and Kubernetes. It provides overviews of each technology, their uses, benefits, and how they enable building distributed systems through containerization and orchestration of microservices. When building distributed systems, these technologies help address challenges through a microservices architecture, horizontal scaling, language independence, and focusing on code deployment over servers.

"Conflicts within a Team: Not an Enemy, But an Opportunity for Growth", Orest...Fwdays

��

Conflicts within a team are not always a bad sign. On the contrary, they can become a powerful tool for development. In this talk, Orest will share my experience and practical tools for resolving conflicts constructively, which help not only maintain harmony in the team but also improve its overall performance. You will learn how to turn conflicts into opportunities to strengthen team bonds, enhance communication skills, and achieve better results.

Spin Glass Models of Neural Networks: The Curie-Weiss Model from Statistical ...Charles Martin

��

The Curie–Weiss Model is a classic from physics that is foundational to understanding the statistical mechanics approach to the theory of neural networks. And, in particular, to the theory behind weightwatcher. In this deck, I present: • Core Mathematical Techniques: Explore the mean-field theory and the saddle-point approximation (SPA) in the large-N limit, which provide a clear derivation of the phase diagram. • Simple Phase Behavior: See how the model predicts a phase transition—from a disordered paramagnetic state to an ordered ferromagnetic state—which parallels the behavior observed in neural network training. • Bridging to Modern Theory: The math here is also essential for understanding the theoretical backbone behind Weightwatcher SETOL theory. Both introduce critical techniques that help explain and predict phase behavior in modern deep learning architectures. Whether you’re a physicist or an ML practitioner, these insights offer a deeper look at how classical models inform today’s neural network theory.

More Related Content

Similar to Protobuff and gRPC (20)

Hadoop Ecosystem and Low Latency Streaming ArchitectureInSemble

��

Modern Distributed Messaging and RPCMax Alexejev

��

Linux Inter Process CommunicationAbhishek Sagar

��

Hpc lunch and learnJohn D Almon

��

403983283sdsadsadsadasdsda-CCNA-PPT-pptx.pptxmindhackers161

��

Data Serialization in Python JSON vs. PickleInexture Solutions

��

Unit 1 web technology uptu slideAbhishek Kesharwani

��

(ATS3-DEV04) Introduction to Pipeline Pilot Protocol Development for DevelopersBIOVIA

��

Common crawlpresentationHadoop User Group

��

Building a Scalable Web Crawler with HadoopHadoop User Group

��

IT-NET GROUP 3 REPORT.pptxEdJulleza

��

Application Layerushabarad142

��

Viloria osi layer4-7Jhoniel Viloria

��

Building an Event Bus at Scalejimriecken

��

MODULE-5_CCN.pptxDr. Shivashankar

��

Summer 2017 undergraduate research powerpointChristopher Dubois

��

Computer Networks Module 1-part 1.pdfShanthalaKV

��

[Distributed System] ch4. interprocess communicationGyuhyeon Nam

��

RPC in SmalltalkESUG

��

Mcroservices with docker kubernetes, goang and grpc, overviewFaculty of Technical Sciences, University of Novi Sad

��

Hadoop Ecosystem and Low Latency Streaming ArchitectureInSemble

��

Modern Distributed Messaging and RPCMax Alexejev

��

Linux Inter Process CommunicationAbhishek Sagar

��

Hpc lunch and learnJohn D Almon

��

403983283sdsadsadsadasdsda-CCNA-PPT-pptx.pptxmindhackers161

��

Data Serialization in Python JSON vs. PickleInexture Solutions

��

Unit 1 web technology uptu slideAbhishek Kesharwani

��

(ATS3-DEV04) Introduction to Pipeline Pilot Protocol Development for DevelopersBIOVIA

��

Common crawlpresentationHadoop User Group

��

Building a Scalable Web Crawler with HadoopHadoop User Group

��

IT-NET GROUP 3 REPORT.pptxEdJulleza

��

Application Layerushabarad142

��

Viloria osi layer4-7Jhoniel Viloria

��

Building an Event Bus at Scalejimriecken

��

MODULE-5_CCN.pptxDr. Shivashankar

��

Summer 2017 undergraduate research powerpointChristopher Dubois

��

Computer Networks Module 1-part 1.pdfShanthalaKV

��

[Distributed System] ch4. interprocess communicationGyuhyeon Nam

��

RPC in SmalltalkESUG

��

Mcroservices with docker kubernetes, goang and grpc, overviewFaculty of Technical Sciences, University of Novi Sad

��

Recently uploaded (20)

"Conflicts within a Team: Not an Enemy, But an Opportunity for Growth", Orest...Fwdays

��

Spin Glass Models of Neural Networks: The Curie-Weiss Model from Statistical ...Charles Martin

��

Cloud Computing The Future of Technologyjoelmcapg

��

"This PowerPoint presentation provides an in-depth overview of cloud computing, covering its fundamental concepts, service models (IaaS, PaaS, SaaS), deployment models (Public, Private, Hybrid, and Community Cloud), benefits, challenges, and real-world applications. It also highlights key cloud providers and emerging trends in cloud technology. Ideal for students, professionals, and anyone interested in understanding the future of cloud computing."

Women in Automation: Career Development & Leadership in AutomationUiPathCommunity

��

The month of March is a month when we focus on the women in our community: their expertise and their achievements. But also their potential for guidance and mentorship as we look to find role models and help our entire community reach its maximum potential, in a gender diverse and inclusive environment. Join us on March 19 for a first hand story on starting an automation career and leadership orientation as a woman expert in the automation field. Agenda: Choosing a career in automation as a woman, despite having a strong background in core software development How a strong background in core development can be leveraged to build a career in automation/digital transformation Choosing a technical role in automation rather than non-technical positions as a woman Leading teams as a woman in Turkey’s tech industry How professionals from fields other than computer engineering (both STEM and non-STEM) can transition into automation careers Mentoring professionals from different fields in their automation careers We are honored to have with us one of best women in automation advocates and professionals in Turkey: 👩‍🏫 Kardelen Cihangir, Technical Team Lead @VBM Turkey. ❓ If you have any questions or feedback, please refer to the "Women in Automation 2025" dedicated Forum thread. You can find there extra details and updates.

"AI-Driven Automation for High-Performing Teams: Optimize Routine Tasks & Lea...Fwdays

��

Every day, managers and team leads face numerous routine tasks: creating and updating issues in Jira, running meetings, syncing the team, handling retrospectives, and managing documentation. Most of these processes take up valuable time that could be spent on strategic leadership and team development. In this talk, I will show how AI can optimize team processes, automate routine tasks, and make workflows more efficient. You will learn how AI enhances Scrum processes and helps streamline team management. I will also share my experience in automating workflows in Jira and Slack: how to reduce manual work with simple automation rules, set up automatic notifications for blockers, generate Confluence pages, track team productivity, and extract valuable insights. What will you gain from this talk??

WSO2Con 2025 - Building Secure Business Customer and Partner Experience (B2B)...WSO2

��

Building modern B2B applications requires addressing complex identity and access management needs, from seamless onboarding to managing organizational hierarchies and user relationships. This session dives into the challenges of developing B2B apps and showcases how WSO2 B2B CIAM solutions can simplify and enhance these aspects. We’ll explore key concepts such as organizational modeling, hierarchical structures, and organization onboarding strategies. You’ll learn how to design secure user login experiences, implement "Bring Your Own Identity Provider" (BYO IdP) functionality, and connect users seamlessly to their organizations. The session will also provide a preview of WSO2 IAM roadmap for B2B applications, highlighting upcoming features designed to address evolving business challenges.

"Surfing the IT Waves: How Not to Drown in the Information Ocean", Serhii Nem...Fwdays

��

In the world of IT, where technologies develop at the speed of light, it's crucial to understand not only what to learn but also when to do it. In this presentation, we will explore a practical approach to the professional development of an IT specialist and figure out how to effectively track industry innovations without compromising your main work. We will discuss what truly influences your value as a developer, when it's worth investing time in learning new technologies, and how this relates to other important skills - from English proficiency to understanding the business value of projects. The presentation will be useful for both beginners who are just entering the job market and experienced developers who strive to remain competitive.

Google News Consideration for SEO | Google Search NYCPrimary Position

��

Columbia Weather Systems - Product OverviewColumbia Weather Systems

��

Columbia Weather Systems offers professional weather stations in basically three configurations for industry and government agencies worldwide: Fixed-Base or Fixed-Mount Weather Stations, Portable Weather Stations, and Vehicle-Mounted Weather Stations. Models include all-in-one sensor configurations as well as modular environmental monitoring systems. Real-time displays include hardware console, WeatherMaster™ Software, and a Weather MicroServer™ with industrial protocols, web and app monitoring options. Innovative Weather Monitoring: Trusted by industry and government agencies worldwide. Professional, easy-to-use monitoring options. Customized sensor configurations. One-year warranty with personal technical support. Proven reliability, innovation, and brand recognition for over 45 years.

Best Crane Manufacturers in India Industry Leaders & Innovations.pdfHercules Hoists

��

India’s crane manufacturing industry is witnessing significant growth due to increasing infrastructure projects, industrial expansion, and technological advancements. Leading manufacturers focus on innovation, integrating automation and IoT-based monitoring systems to enhance operational efficiency. Companies produce a variety of cranes, including overhead, jib, and mobile cranes, tailored to different sectors like steel, power, and shipping. Indian manufacturers prioritize safety, adhering to international standards such as ISO and IS certifications. With a strong supply chain and competitive pricing, they cater to both domestic and global markets. The industry’s emphasis on quality, reliability, and customization makes India a key player in crane manufacturing.

"Constructive Interaction During Emotional Burnout: With Local and Internatio...Fwdays

��

One of the biggest challenges in workplace communication is expressing dissatisfaction and providing feedback. Over 50% of misunderstandings arise in these situations, regardless of the project. Add emotional burnout and cultural differences, and the consequences can become serious. In his speech, Alexey will tell share feedback tools that work effectively for IT professionals. He will explore why many cultures struggle with giving and receiving constructive criticism and how fundamental argumentation principles, combined with simple empathy-based techniques, can help prevent more than half of potential conflicts.

Digital Twins Transforming Logistics with AI & Cloudyashakhandelwal2

��

Discover how Digital Twins are revolutionizing logistics with real-time tracking, predictive analytics, and AI-powered optimization. This guide explores how Tech4Biz Solutions engineers math-driven models to enhance delivery efficiency, minimize costs, and improve decision-making. Key insights include: What Are Digital Twins? – A dynamic, real-time replica of physical systems AI & IoT in Logistics – How sensors, cloud computing, and AI models power real-time decision-making Optimization Through Mathematics – Reducing latency, maximizing accuracy, and balancing compute efficiency Tech4Biz Expertise – Our end-to-end approach in building highly scalable and intelligent digital twins Learn how businesses can streamline operations, predict delays, and gain a competitive edge with cutting-edge AI-driven logistics solutions.

CSUN 2025 - Personalization of Accessible Charts and Graphs.pptxØystein Moseng

��

Emancipatory Information Retrieval (Invited Talk at UCC)Bhaskar Mitra

��

Our world today is facing a confluence of several mutually reinforcing crises each of which intersects with concerns of social justice and emancipation. This talk will be a provocation for the role of computer-mediated information access in our emancipatory struggles. Information retrieval (IR) is a field in computing that concerns with the design of information access systems, such as search engines and recommender systems, and has traditionally been informed by other fields such as information science, human-computer interaction, and machine learning. I��define emancipatory information retrieval as the study and development of information access methods that challenge various forms of human oppression and situates its activities within broader collective emancipatory praxis. The term "emancipatory" here signifies the moral concerns of universal humanization of all peoples and the elimination of oppression to create the conditions under which we can collectively flourish. In this talk,��I will present an early framework of practices, projects, and design provocations for emancipatory IR, and will situate some of my own recent work within this framework. My goal is to propose a new framing that challenges the field of IR research to embrace humanistic values and commit to universal emancipation and social justice.��In this process, I believe we must both imagine post-oppressive worlds, and reimagine the role of IR in that world and in the journey that leads us there.

The nature of technolog and Computer networks.pptxvallidevi6

��

STIG in Action: Continuous Compliance with MITRE & AnchoreAnchore

��

Join us for part two of our STIG webinar series in partnership with MITRE. We’ll discuss the latest NIST 800-53 and FedRAMP guidance that requires STIG adherence and how this protocol creates new demands on security and operations teams. Our hosts will share insights into how these new demands can be met with security tools that automate STIG compliance. Attendees will learn actionable steps on how to get rid of their traditional spreadsheets and paper binders as Anchore and MITRE hosts explore next generation STIG tooling and guidance. Hosts Aaron Lippold, Chief Architect at MITRE, and Josh Bressers, VP of Security at Anchore, will demo how to: - Leverage MITRE Security Automation Framework© to automate STIG scanning - View and interpret the results of a STIG scan with MITRE SAF© - Remediate STIG findings in container images Automate reporting and replace traditional paper files

Benefits of Using Ultrasonic Level Transmitters for Controlnikeson80

��

Ultrasonic Level Transmitters are a game-changer in liquid and solid level monitoring. These non-contact sensors provide high accuracy, real-time data, and reliable performance in various industries, from water management to chemical processing. With no moving parts, they require minimal maintenance, reducing downtime and operational costs. Their ability to function in harsh environments makes them ideal for remote and automated level control.

Software-Engineering-and-Best-Practices.oziasrondonc

��

Software engineering is more than just writing code—it’s about building scalable, maintainable, and efficient applications. This presentation explores the best practices in software engineering, including coding standards, version control, testing strategies, agile methodologies, and DevOps integration. Learn how to enhance code quality, improve team collaboration, and optimize the software development lifecycle for long-term success.

Powering Energy and Utilities with Data Integration: Smarter Data, Smoother O...Safe Software

��

Join us and special guest speakers Paige Florie and Charles Lubensky from ONEOK, who will take the spotlight to share how they’ve leveraged FME to enhance safety, streamline operations, and automate key workflows in the energy and utilities sectors. From pipeline monitoring to weather-based alerts, discover how ONEOK is using FME to drive efficiency and reduce risk across their organization. The real-world use cases they’ll showcase include: Drilling Permits & Storage Caverns: How automated alerts help prevent costly and dangerous incidents. Weather Alerting for Pipelines: Real-time alerts for tornadoes, hurricanes, and lightning to improve response times. Contract Oversight & Spatial Analysis: Automating contract data processing to track drilling activity, spatialize key locations, and visualize impact areas with color-coded mapping – driving huge ROI. Pipeline Risk Analysis & Alerting: Proactively monitor infrastructure and assess potential hazards. Earthquake & Rainfall Monitoring: Automate inspection triggers based on environmental conditions. Aerial Patrols & Compliance Tracking: Detect changes, automated processing and reporting, alert compliance teams for field operations deployment. Evie from our support team will then showcase how these workflows can be adapted across the utilities and energy sector. She’ll provide a demo with a similar setup to ONEOK’s Weather Alerting in FME, giving you the tools to get started. Learn firsthand from ONEOK how FME is making a real impact across their organization!

WSO2Con 2025 - Building AI Applications in the Enterprise (Part 1)WSO2

��

Building AI applications for the enterprise requires understanding key architectural patterns that enable powerful, scalable, and intelligent solutions. This session explores the core approaches to building AI-driven applications, including Generative AI, Retrieval-Augmented Generation (RAG), and AI Agents. We’ll dive into how to build and integrate AI apps, discover and connect them with enterprise tools, and manage authentication and authorization securely. Additionally, we’ll cover best practices for deploying AI-powered applications and how an AI Gateway can help monitor, secure, and optimize interactions between AI models, agents, and enterprise systems.

"Conflicts within a Team: Not an Enemy, But an Opportunity for Growth", Orest...Fwdays

��

Spin Glass Models of Neural Networks: The Curie-Weiss Model from Statistical ...Charles Martin

��

Cloud Computing The Future of Technologyjoelmcapg

��

Women in Automation: Career Development & Leadership in AutomationUiPathCommunity

��

"AI-Driven Automation for High-Performing Teams: Optimize Routine Tasks & Lea...Fwdays

��

WSO2Con 2025 - Building Secure Business Customer and Partner Experience (B2B)...WSO2

��

"Surfing the IT Waves: How Not to Drown in the Information Ocean", Serhii Nem...Fwdays

��

Google News Consideration for SEO | Google Search NYCPrimary Position

��

Columbia Weather Systems - Product OverviewColumbia Weather Systems

��

Best Crane Manufacturers in India Industry Leaders & Innovations.pdfHercules Hoists

��

"Constructive Interaction During Emotional Burnout: With Local and Internatio...Fwdays

��

Digital Twins Transforming Logistics with AI & Cloudyashakhandelwal2

��

CSUN 2025 - Personalization of Accessible Charts and Graphs.pptxØystein Moseng

��

Emancipatory Information Retrieval (Invited Talk at UCC)Bhaskar Mitra

��

The nature of technolog and Computer networks.pptxvallidevi6

��

STIG in Action: Continuous Compliance with MITRE & AnchoreAnchore

��

Benefits of Using Ultrasonic Level Transmitters for Controlnikeson80

��

Software-Engineering-and-Best-Practices.oziasrondonc

��

Powering Energy and Utilities with Data Integration: Smarter Data, Smoother O...Safe Software

��

WSO2Con 2025 - Building AI Applications in the Enterprise (Part 1)WSO2

��

Protobuff and gRPC

1. Protocol Buffer & gRPC

2. Data Serialization Data serialization is the process of converting structured data to a format that allows sharing or storing of data in a from that allow recovery of its original structure. De- serialization is the exact opposite. Serialization formats • XML • JSON • CSV • YML • Protobuf etc.

3. Protocol buffers • Protocol buffers are a flexible, efficient, automated mechanism for serializing structured data and its • Language-neutral • Platform-neutral • Extensible

4. JSON • Advantages • Data can take any forms (arrays, nested elements) • Is a widely accepted format in web • Can ne read by pretty much any language • Can be easily shared over a network • Disadvantages • Data has no schema enforcing • Json Objects can be quite big in size because of repeated keys • No comments, metadata

5. protobuff • Advantages • Data is fully typed • Data is compressed automatically (less CPU usage) • Schema is needed to generate code and read the data • Documentation can be embedded in the schema • Data can be read across any language(Java, C#, Go, Python, JS etc..) • Schema can be evolved over the time, in a safe manner • 3-10x smaller, 20-100x faster then XML • Code is generated for you automatically • Disadvantages: • Support for some language might be lacking • Can’t open the serialized data with the text editor

6. Structure message Person { string first_name = 1; string last_name = 2; int32 age = 3; }

7. HTTP 1.1 vs HTTP/2

8. gRPC • Developed by Google, under the name Stubby. • In 2015 Google liberalized it as open source and named it gRPC. • Adopted by large companies in the very first year like Netflix, Cisco, Docker etc. • Became part of Cloud Native Computing Foundation in 2017.

9. Core features that make it awesome • Idiomatic client libraries in 11 languages • Highly efficient on wire and with a simple service definition framework • Bi-directional streaming with http/2 based transport • Pluggable auth, tracing, load balancing and health checking

11. gRPC Interaction • Unary: when the client sends a single request and receives a single response. • Server-streaming: when the server responds with a stream of messages to a client's request. Once all the data is sent, the server additionally delivers a status message to complete the • Client-streaming: when the client sends a stream of messages and in turn receives a single response message from the server. • Bidirectional-streaming: the two streams (client and server) are independent, meaning that they both can transmit messages in any order. The client is the one who initiates and ends the

�ݺ�ߣ

Protobuff and gRPC

Recommended

More Related Content

Similar to Protobuff and gRPC (20)

Recently uploaded (20)

Protobuff and gRPC