Serverless Event Streaming with Pulsar Functions-xiaolongStreamNative
?
本文介绍了 Apache Pulsar 的架构及其服务器无事件流处理功能的实现,重点讨论了 Go 函数的设计和使用场景,包括 ETL、数据过滤和动态路由等。Pulsar 函数作为一个轻量级的事件流框架,支持多种语言和运行时,并利用自动负载均衡机制进行函数的管理和调度。文中还提到了一些安全隐患和 Go 语言的使用限制。
This document summarizes an advanced Python programming course, covering topics like performance tuning, garbage collection, and extending Python. It discusses profiling Python code to find bottlenecks, using more efficient algorithms and data structures, optimizing code through techniques like reducing temporary objects and inline functions, leveraging faster tools like NumPy, writing extension modules in C, and parallelizing computation across CPUs and clusters. It also explains basic garbage collection algorithms like reference counting and mark-and-sweep used in CPython.
This document discusses Python technologies used at Douban. It describes how Python is used for web development, including frameworks like Quixote and tools like Mako templates. It also discusses using Python for system tasks like caching with cmemcached, profiling code, and interacting with databases. Overall Python allows Douban to build scalable web applications and services.
Serverless Event Streaming with Pulsar Functions-xiaolongStreamNative
?
本文介绍了 Apache Pulsar 的架构及其服务器无事件流处理功能的实现,重点讨论了 Go 函数的设计和使用场景,包括 ETL、数据过滤和动态路由等。Pulsar 函数作为一个轻量级的事件流框架,支持多种语言和运行时,并利用自动负载均衡机制进行函数的管理和调度。文中还提到了一些安全隐患和 Go 语言的使用限制。
This document summarizes an advanced Python programming course, covering topics like performance tuning, garbage collection, and extending Python. It discusses profiling Python code to find bottlenecks, using more efficient algorithms and data structures, optimizing code through techniques like reducing temporary objects and inline functions, leveraging faster tools like NumPy, writing extension modules in C, and parallelizing computation across CPUs and clusters. It also explains basic garbage collection algorithms like reference counting and mark-and-sweep used in CPython.
This document discusses Python technologies used at Douban. It describes how Python is used for web development, including frameworks like Quixote and tools like Mako templates. It also discusses using Python for system tasks like caching with cmemcached, profiling code, and interacting with databases. Overall Python allows Douban to build scalable web applications and services.
The document summarizes the new design of OneRing compared to the old design. The new design unifies the communication between WebKit and the operating system (OS) and applications by using a publish/subscribe messaging system. This removes the direct dependencies on Qt and makes the interactions more explicit and traceable by using application programming interfaces (APIs) that call apps via URLs and JSON payloads. While adding some overhead, the new design modularizes the system into independent apps/plugins and simplifies the core.
Thrift and PasteScript are frameworks for building distributed applications and services. Thrift allows defining data types and interfaces using a simple definition language that can generate code in multiple languages. It uses a compact binary protocol for efficient RPC-style communication between clients and servers. PasteScript builds on WSGI and provides tools like paster for deploying and managing Python web applications, along with reloading and logging capabilities. It integrates with Thrift via server runners and application factories.
OneRing is a desktop application platform that allows building desktop applications using web technologies like HTML, CSS, and JavaScript. It uses QtWebKit to render web content and exposes a C API and Python bindings to register and run web-based applications as native desktop apps. OneRing-based apps can access native GUI widgets and OS services and are distributed and updated like regular desktop programs.
This document summarizes the architecture of Douban.com. It describes how the site uses Gentoo Linux, Python, Quixote framework, Memcached, MySQL, and other technologies. Key aspects include using Memcached to cache database queries, replication between MySQL masters and slaves, and a front-end layer with Lighttpd and nginx load balancers. It also discusses evolving technologies like DoubanFS for file storage and DoubanDB as a potential MySQL replacement.
This document discusses Python and web frameworks. It begins with an introduction to Python and its advantages for web development. It then discusses several popular Python web frameworks including web.py, Flask, and Django. It also covers related topics like WSGI, templating with Jinja2, asynchronous programming, and deployment with virtualenv.
Erlang is a general-purpose programming language and runtime environment with built-in support for concurrency, distribution and fault tolerance. It is particularly suitable for distributed, reliable, soft real-time concurrent systems such as telecommunication systems. OTP is a large collection of libraries for Erlang that provides support for many common problems in networking and telecommunications systems. Erlang's strengths include high performance, support for transparent distribution and fault tolerance, and a mature and proven runtime environment.
The Linux Virtual Server (LVS) project, initiated by Wensong Zhang, focuses on providing a scalable and highly available network service framework using commodity servers. LVS supports various IP load balancing techniques and can accommodate up to 100 nodes, proving its reliability as seen in major implementations by organizations like Alibaba and Baidu. The project has evolved through community collaboration and emphasizes the importance of open-source development and user feedback.
The presentation discusses the agricultural extension activities of the Department of Agricultural Extension (DAE) in the Southern Ganges Basin of Bangladesh, highlighting past accomplishments, present initiatives, and future plans to improve productivity and food security. It addresses the challenges faced by the region, such as salinity and climate change, and emphasizes the need for innovative technologies and improved agricultural practices. The DAE aims to enhance crop diversification, increase cropping intensity, and promote sustainable agricultural development through various initiatives and collaboration with research institutions.
The document outlines the history of the development of the Department of Agricultural Extension (DAE) in Bangladesh from 1810 to 1983. It traces the establishment of early agricultural institutions by the British government in the 19th century and research organizations in the early 20th century. Key milestones include the establishment of the DAE in 1983 to educate farmers and promote the adoption of new agricultural technologies after various agriculture-focused departments and research bodies were formed over the previous centuries.