1 of 22
Downloaded 102 times
![计算流程 rowkey: 商务定位 [0,2] regionserver 求 SUM(alipay) 属性 属性值 笔记本尺寸 13 寸 笔记本定位 商务定位 查索引 节点 1 1, 2, 3, 4, 5, 6, 7, 8, 9 节点 2 1, 2, 3, 4, 5, 6, 7 节点 2 1, 2, 4 , 6, 7 本地 SUM 运算（ Hbase 扩展 ） 汇总计算 写入缓存](https://image.slidesharecdn.com/hbase-110727075433-phpapp02/85/Hbase-14-320.jpg)
![Q&A thanks blog : www.yiihsia.com weibo : http://weibo.com/neihan e-mail : [email_address]](https://image.slidesharecdn.com/hbase-110727075433-phpapp02/85/Hbase-22-320.jpg)
Recommended
NATIONAL AMERICAN INDIAN HOUSING COUNCIL - 2011 Annual Report
NATIONAL AMERICAN INDIAN HOUSING COUNCIL - 2011 Annual ReportCal Nez Design
?
Cal Nez Design designed, produced and printed these annual reports and delivered it to Anchorage, Alaska in time and with quality.
We reorganized the entire layout of the annual report, quite different from previous years.
There is a science to annual report design and development. There is the overall marketing piece, typography and photography.
We were pleased with it so was the client.Behavioural Program
Behavioural Programmboulerice15
?
This document outlines a cognitive behavioral treatment program to help decrease depression symptoms in a 19-year-old female client named Tasha Cameron. Tasha was previously diagnosed with depression at age 16 and prescribed Zoloft, but recently stopped taking it due to side effects. She is now experiencing depressive symptoms again. The goals of the treatment program are to build a therapeutic alliance, assess Tasha's symptoms, develop treatment goals and objectives, implement cognitive behavioral interventions, and help her maintain improvements after treatment ends. Key roles for the therapist include building rapport, providing structure, and helping Tasha identify factors contributing to her depression. Key roles for Tasha include honesty, commitment to treatment, and openness to change.Navajo Nation Presidential Inauguration Program
Navajo Nation Presidential Inauguration ProgramCal Nez Design
?
The document provides an agenda and background information for the 2007 Navajo Nation Inaugural event held on January 9, 2007 in Window Rock, Navajo Nation, Arizona. The 3-page document includes welcoming remarks, biographies of Dr. Joe Shirley Jr. who was re-elected as Navajo Nation President and Ben Shelly who was elected as Navajo Nation Vice President. It also lists the planned events and activities for the inauguration ceremony and provides a list of members of the 21st Navajo Nation Council.TS?HOOTSOO? MEDICAL CENTER - Newsletter
TS?HOOTSOO? MEDICAL CENTER - NewsletterCal Nez Design
?
The article discusses new advancements at Tséhootsooí Medical Center (TMC). TMC has received approval from the FDA to use a new Digital Breast Tomosynthesis system, making it the only healthcare facility in Indian Country to offer this advanced mammography technology. The technology creates a 3D image of the breast through multiple digitally processed x-rays, allowing physicians to better detect early-stage breast cancers. Additionally, TMC's Turquoise and Coral Adult Clinics have merged to form a new Primary Care Clinic in order to improve patient care through a more coordinated service delivery model. The changes have required some adjustments but are aimed at enhancing the patient experience.Annualreport121411 d
Annualreport121411 dCal Nez Design
?
Dr. Leland Leonard has initiated an incredible concept of utilizing 100% Navajo services. He has given our firm to demonstrate our quality products and service.Drawing Animal Heads
Drawing Animal Headssweetsin
?
The document provides instructions for an art lesson where students will draw different animal heads. It includes links to examples of animals like armadillos, deer, toucans, and mice to use for inspiration. It also discusses Mayan art and includes a link to an example Mayan vase for students to examine key features of Mayan art styles. The lesson encourages students to find the basic shape of the animal heads they are drawing.TS?HOOTSOO? MEDICAL CENTER - Newsletter
TS?HOOTSOO? MEDICAL CENTER - NewsletterCal Nez Design
?
The document is a newsletter from Tséhootsooí Medical Center discussing various topics related to improving healthcare services. It discusses 1) expanding cancer care services by creating a Cancer Care Case Manager position to improve coordination of care between facilities; 2) celebrating National Medical Laboratory Week and honoring laboratory professionals; 3) Tséhootsooí Medical Center's second anniversary of becoming a self-determined healthcare facility under the Indian Self-Determination and Education Assistance Act; and 4) a healing training called Gathering of Native Americans that incorporates Native cultural values to address issues like substance abuse and suicide.
Taller n3 sql
Taller n3 sqlmanuel alejandro
?
The document describes the creation of tables in a database to store information about books, authors, employees, customers, orders, and more. It defines the structure of 11 tables with fields and primary keys. It then provides examples of inserting initial data into some of the tables.Game automation v3
Game automation v3JonathanBrown
?
The document evaluates different automation tools for testing online games that use various web technologies like Flash and HTML5. It discusses the challenges in testing games that have frequent changes. The tools evaluated are Sikuli, Eggplant, and SeeTest. Sikuli is rated highly in simplicity but requires programming. Eggplant requires assisted recording but is more full-featured. SeeTest is easy to use but costs are not negligible. Based on the evaluation criteria like cost, ease of use, and integration with existing frameworks, Sikuli and SeeTest are recommended if wanting to keep an existing testing framework, while also considering Eggplant.Drawing Animal Bodies
Drawing Animal Bodiessweetsin
?
The document provides instructions for an art lesson where students will draw animal heads. It includes links to examples of different animals like armadillos, deer, toucans, and mice to use for inspiration. It also discusses key features of Mayan art and includes links to examples of Mayan vases. Students are instructed to find the basic shape of the animal head they are drawing.PRESIDENTIAL INAUGURATION PROGRAM
PRESIDENTIAL INAUGURATION PROGRAMCal Nez Design
?
The document is a commemorative program for the 2011 inauguration of Ben Shelly as President of the Navajo Nation and Rex Lee Jim as Vice President. The inauguration was held on January 11, 2011 in Window Rock, Arizona. The program provides details of the inauguration events and ceremonies, including musical performances, speeches, oaths of office and cultural presentations. It also provides biographies of President Shelly and Vice President Jim, as well as listings of the Navajo Nation Council members, Board of Election Supervisors, and Judicial Branch leaders.CAL NEZ DESIGN - Self Promotion
CAL NEZ DESIGN - Self PromotionCal Nez Design
?
Cal Nez Design is a 100% Native American graphic design firm with over 21 years of experience. They specialize in understanding Native American culture and communicating effectively for tribal clients. Their portfolio includes design work for governmental agencies, private companies, and events related to the Navajo Nation and other tribes. The founder, Cal Nez, was featured on the cover of Utah Business magazine for his success in bridging cultural gaps through graphic design.
Cndpromoz
CndpromozCal Nez Design
?
Cal Nez Design, 100% Native American Graphic Design and Advertising Agency with over 23 years of experience providing award-winning designs from conceptual design through final printing. www.calnezdesign,comLan Desk 9 Solutions Overview
Lan Desk 9 Solutions OverviewWillem-Jan Willems
?
LANDesk provides IT management solutions including systems management, endpoint security, asset lifecycle management, and IT service management. Their solutions help organizations reduce IT costs and complexity, secure systems, automate processes, and improve productivity through features such as software distribution, inventory management, remote control, patching, and desktop security.Delta Lake Architecture: Delta Lake + Apache Spark Structured Streaming
Delta Lake Architecture: Delta Lake + Apache Spark Structured StreamingXiao Li
?
This talks presents the Delta Lake Architecture in QCon @ Shanghai. The slides is in Chinese.
Big Data Projet Management the Body of Knowledge (BDPMBOK)
Big Data Projet Management the Body of Knowledge (BDPMBOK)Jazz Yao-Tsung Wang
?
12/9 Big Data Conference @ 台大集思會議中心
淘宝网架构变迁和挑战(翱谤补肠濒别架构师日)
淘宝网架构变迁和挑战(翱谤补肠濒别架构师日)vanadies10
?
Introduction of the changine of the architecture of taobao.com. Also some information of the basic production at taobao.comMore Related Content
Viewers also liked (17)
NATIONAL AMERICAN INDIAN HOUSING COUNCIL - 2011 Annual Report
NATIONAL AMERICAN INDIAN HOUSING COUNCIL - 2011 Annual ReportCal Nez Design
?
Cal Nez Design designed, produced and printed these annual reports and delivered it to Anchorage, Alaska in time and with quality.
We reorganized the entire layout of the annual report, quite different from previous years.
There is a science to annual report design and development. There is the overall marketing piece, typography and photography.
We were pleased with it so was the client.Behavioural Program
Behavioural Programmboulerice15
?
This document outlines a cognitive behavioral treatment program to help decrease depression symptoms in a 19-year-old female client named Tasha Cameron. Tasha was previously diagnosed with depression at age 16 and prescribed Zoloft, but recently stopped taking it due to side effects. She is now experiencing depressive symptoms again. The goals of the treatment program are to build a therapeutic alliance, assess Tasha's symptoms, develop treatment goals and objectives, implement cognitive behavioral interventions, and help her maintain improvements after treatment ends. Key roles for the therapist include building rapport, providing structure, and helping Tasha identify factors contributing to her depression. Key roles for Tasha include honesty, commitment to treatment, and openness to change.Navajo Nation Presidential Inauguration Program
Navajo Nation Presidential Inauguration ProgramCal Nez Design
?
The document provides an agenda and background information for the 2007 Navajo Nation Inaugural event held on January 9, 2007 in Window Rock, Navajo Nation, Arizona. The 3-page document includes welcoming remarks, biographies of Dr. Joe Shirley Jr. who was re-elected as Navajo Nation President and Ben Shelly who was elected as Navajo Nation Vice President. It also lists the planned events and activities for the inauguration ceremony and provides a list of members of the 21st Navajo Nation Council.TS?HOOTSOO? MEDICAL CENTER - Newsletter
TS?HOOTSOO? MEDICAL CENTER - NewsletterCal Nez Design
?
The article discusses new advancements at Tséhootsooí Medical Center (TMC). TMC has received approval from the FDA to use a new Digital Breast Tomosynthesis system, making it the only healthcare facility in Indian Country to offer this advanced mammography technology. The technology creates a 3D image of the breast through multiple digitally processed x-rays, allowing physicians to better detect early-stage breast cancers. Additionally, TMC's Turquoise and Coral Adult Clinics have merged to form a new Primary Care Clinic in order to improve patient care through a more coordinated service delivery model. The changes have required some adjustments but are aimed at enhancing the patient experience.Annualreport121411 d
Annualreport121411 dCal Nez Design
?
Dr. Leland Leonard has initiated an incredible concept of utilizing 100% Navajo services. He has given our firm to demonstrate our quality products and service.Drawing Animal Heads
Drawing Animal Headssweetsin
?
The document provides instructions for an art lesson where students will draw different animal heads. It includes links to examples of animals like armadillos, deer, toucans, and mice to use for inspiration. It also discusses Mayan art and includes a link to an example Mayan vase for students to examine key features of Mayan art styles. The lesson encourages students to find the basic shape of the animal heads they are drawing.TS?HOOTSOO? MEDICAL CENTER - Newsletter
TS?HOOTSOO? MEDICAL CENTER - NewsletterCal Nez Design
?
The document is a newsletter from Tséhootsooí Medical Center discussing various topics related to improving healthcare services. It discusses 1) expanding cancer care services by creating a Cancer Care Case Manager position to improve coordination of care between facilities; 2) celebrating National Medical Laboratory Week and honoring laboratory professionals; 3) Tséhootsooí Medical Center's second anniversary of becoming a self-determined healthcare facility under the Indian Self-Determination and Education Assistance Act; and 4) a healing training called Gathering of Native Americans that incorporates Native cultural values to address issues like substance abuse and suicide.Taller n3 sql
Taller n3 sqlmanuel alejandro
?
The document describes the creation of tables in a database to store information about books, authors, employees, customers, orders, and more. It defines the structure of 11 tables with fields and primary keys. It then provides examples of inserting initial data into some of the tables.Game automation v3
Game automation v3JonathanBrown
?
The document evaluates different automation tools for testing online games that use various web technologies like Flash and HTML5. It discusses the challenges in testing games that have frequent changes. The tools evaluated are Sikuli, Eggplant, and SeeTest. Sikuli is rated highly in simplicity but requires programming. Eggplant requires assisted recording but is more full-featured. SeeTest is easy to use but costs are not negligible. Based on the evaluation criteria like cost, ease of use, and integration with existing frameworks, Sikuli and SeeTest are recommended if wanting to keep an existing testing framework, while also considering Eggplant.Drawing Animal Bodies
Drawing Animal Bodiessweetsin
?
The document provides instructions for an art lesson where students will draw animal heads. It includes links to examples of different animals like armadillos, deer, toucans, and mice to use for inspiration. It also discusses key features of Mayan art and includes links to examples of Mayan vases. Students are instructed to find the basic shape of the animal head they are drawing.PRESIDENTIAL INAUGURATION PROGRAM
PRESIDENTIAL INAUGURATION PROGRAMCal Nez Design
?
The document is a commemorative program for the 2011 inauguration of Ben Shelly as President of the Navajo Nation and Rex Lee Jim as Vice President. The inauguration was held on January 11, 2011 in Window Rock, Arizona. The program provides details of the inauguration events and ceremonies, including musical performances, speeches, oaths of office and cultural presentations. It also provides biographies of President Shelly and Vice President Jim, as well as listings of the Navajo Nation Council members, Board of Election Supervisors, and Judicial Branch leaders.CAL NEZ DESIGN - Self Promotion
CAL NEZ DESIGN - Self PromotionCal Nez Design
?
Cal Nez Design is a 100% Native American graphic design firm with over 21 years of experience. They specialize in understanding Native American culture and communicating effectively for tribal clients. Their portfolio includes design work for governmental agencies, private companies, and events related to the Navajo Nation and other tribes. The founder, Cal Nez, was featured on the cover of Utah Business magazine for his success in bridging cultural gaps through graphic design.Cndpromoz
CndpromozCal Nez Design
?
Cal Nez Design, 100% Native American Graphic Design and Advertising Agency with over 23 years of experience providing award-winning designs from conceptual design through final printing. www.calnezdesign,comLan Desk 9 Solutions Overview
Lan Desk 9 Solutions OverviewWillem-Jan Willems
?
LANDesk provides IT management solutions including systems management, endpoint security, asset lifecycle management, and IT service management. Their solutions help organizations reduce IT costs and complexity, secure systems, automate processes, and improve productivity through features such as software distribution, inventory management, remote control, patching, and desktop security.Similar to 基于贬产补蝉别的实时计算分享 (20)
Delta Lake Architecture: Delta Lake + Apache Spark Structured Streaming
Delta Lake Architecture: Delta Lake + Apache Spark Structured StreamingXiao Li
?
This talks presents the Delta Lake Architecture in QCon @ Shanghai. The slides is in Chinese.Big Data Projet Management the Body of Knowledge (BDPMBOK)
Big Data Projet Management the Body of Knowledge (BDPMBOK)Jazz Yao-Tsung Wang
?
12/9 Big Data Conference @ 台大集思會議中心
淘宝网架构变迁和挑战(翱谤补肠濒别架构师日)
淘宝网架构变迁和挑战(翱谤补肠濒别架构师日)vanadies10
?
Introduction of the changine of the architecture of taobao.com. Also some information of the basic production at taobao.com20130626联动优势数据访问层顿础尝架构和实践5（刘胜）数据分片和分页
20130626联动优势数据访问层顿础尝架构和实践5（刘胜）数据分片和分页liu sheng
?
标题：
Architecture and Practice for DAL (5) Data Sharding
Architecture and Practice for Data Access Layer (5) Data Sharding
联动优势数据访问层DAL架构和实践之五：分片数据分片
说明：
How to implement a dalet to access sharding databases.
和已有DAL软件（如许超前DAL手机之家、陈思儒Amoeba/贺贤懋Cobar等）不一样，在前端访问方式的选择上，抛弃JDBC方式，而是为同一个dalet数据服务，同时提供自定义TCP长连接和HTTP长连接两种接口。
因而通过抛弃JDBC可以获得多方面的好处——
1）可减少S端协议解析和查询分析的开销；
2）也简化C端编程。
3）后端存储就不再限于RDB了，而可以是任意NOSQL、文件、缓存、甚至是Tuxedo等在线服务。
4）可以实现无状态了，更容易横向扩展。
5）从接口上就可消除join等关键字的误用，避免引起服务端负担过重。罢补辞产补辞图片存储与肠诲苍系统到服务
罢补辞产补辞图片存储与肠诲苍系统到服务Wensong Zhang
?
首先，描述淘宝网对图片等多媒体对象存储和发送需求，介绍淘宝对象存储与发送系统的全貌和现有规模；接着详细描述存储淘宝图片的分布式文件系统罢贵厂，它的架构与设计思想、性能指标和现有的部署规模；然后阐述淘宝颁顿狈系统的总体结构，一级颁补肠丑别和二级颁补肠丑别的规划和基于开源的系统实现和优化，使用厂厂顿/厂础厂/厂础罢础混合存储系统，并根据访问热度变化将对象在不同的存储介质上迁移；最后，描述从淘宝对象存储与颁顿狈系统走向基础设施服务，并总结这一过程中的经验和经济规律模型。
开源+自主开发 - 淘宝软件基础设施构建实践
开源+自主开发 - 淘宝软件基础设施构建实践Wensong Zhang
?
本报告先简要介绍淘宝网的业务和背后网站系统的主要组成部分，描述所使用的主要软件和当前的系统规模，以及未来的技术挑战，当前的淘宝网站系统是完全采用开源软件和自主开发。
接着，叙述淘宝系统的主要发展过程，在系统规模较小时主要采用商用软件，随着规模越来越大商用软件逐步无法满足需求，不得不采用开源软件结合自主开发，一方面通过使用开源软件提高系统开发的效率，另一方面通过自主开发可以按需求在架构上取舍将系统性能做到极致，这里会举三个例子说明，一是淘宝如何逐步建设世界上最大的面向图片的CDN系统，采用高性价比的混合存储系统，目前有1000Gbps流量的承载能力，今年会发展到约2400Gbps，二是根据网页使用图片的特定抛弃目录空间实现了高可扩展的对象存储系统TFS，目前部署了6PB多的存储空间，存放了4PB多的图片，今年会建设到12PB的存储空间，三是将淘宝的核心数据库从基于IBM小型机、Oracle商用数据库和EMC高端存储的解决方案迁移基于PC服务器加MySQL数据库，结合高速非易失的PCI-E存储设备和多层次的系统优化，实现近百倍的性能提升，非常轻松地应付双11和双12的大促活动。这个过程可以总结出商用软件不能满足大规模系统的需求，采用开源软件与自主开发相结合，有更好的可控性，更高的可扩展性，规模效应使得研发投入都有更高的产出。
然后，描述淘宝的开源策略，淘宝系统中使用大量的开源软件，并在开源软件的基础上进行改进和定制，并把工作成果回馈给上流的开源社区，例如淘宝维护了自己的Linux内核树并不断地向Linux社区贡献patch，目前淘宝在对Linux内核贡献补丁数的公司排名为115，开源了基于Nginx的Tengine服务器，以及向Oracle回馈了JVM的补丁和MySQL的补丁，向Apache回馈hadoop和hbase的补丁等等。淘宝建设了淘蝌蚪开源平台，并开源多年开发主力的基础软件，如分布式存储系统TFS、分布式缓存和K/V系统TAIR、海量数据库OceanBase、分布式数据库中间件 TDDL、手机自动化测试框架Athrun等等。淘宝针对数据密集型应用的特点定制了低功耗服务器，先应用在CDN系统中，淘宝创建了greencompute.org网站，并开源了低功耗服务器的硬件规格和应用测试数据，阿里云开源了直流服务器，和业界一起推进绿色计算。
淘宝是开源系统的受益者，并积极参与开源生态系统的建设，促进开源生态系统的发展，积累更好的口碑，凝聚人才，迎接未来更大的技术挑战。
Trinity BDM - 橋接傳統與未來
Trinity BDM - 橋接傳統與未來Etu Solution
?
Trinity 大幅提昇企業面對大量快速變化資訊潮流時的競爭力。
現今企業 BI 多建於 RDBMS 上，伴隨大量的 ETL 與資料交換作業。在導入 Hadoop Big Data 應用之後, 如何有效地與既有 BI 系統介接，且進一步整合，以發揮整體綜效，將是一項挑戰。
Trinity 藉由優越的架構，在傳統 Structured Data 與 Hadoop Big Data 的應用間，建立無縫的交換作業，讓資訊分析人員直接運用熟悉的方式，以大幅降低導入 Big Data 應用時的學習曲線與後續對系統維運所投入的人力。
20120613联动优势数据访问层顿础尝架构和实践4（刘胜）最新特性
20120613联动优势数据访问层顿础尝架构和实践4（刘胜）最新特性liu sheng
?
说明：
和已有DAL软件（如许超前手机之家DAL、陈思儒Amoeba/贺贤懋Cobar等）不一样，在前端访问方式的选择上，抛弃JDBC方式，而是为同一个dalet数据服务，同时提供自定义TCP长连接和HTTP长连接两种接口。
因而通过抛弃JDBC可以获得多方面的好处——
1）可减少S端协议解析和查询分析的开销；
2）也简化C端编程。
3）后端存储就不再限于RDB了，而可以是任意NOSQL、文件、缓存、甚至是Tuxedo等在线服务。
4）可以实现无状态了，更容易横向扩展。
5）从接口上就可消除join等关键字的误用，避免引起服务端负担过重。
Data Engineering in Taiwan: PAST, NOW and FUTURE
Data Engineering in Taiwan: PAST, NOW and FUTUREJazz Yao-Tsung Wang
?
2019-09-06 DataCon.TW 2019 Opening Session
基于贬产补蝉别的实时计算分享
- 1. 实时计算架构 北疯
- 2. 产物介绍
- 3. 产物 数据魔方全属性查询 2010.12~ 淘词 2011.6~ 淘宝指数 ( 开发中 )
- 4. prom 海量数据实时计算框架 - prom 2010.8 开始开发 2010.12 上线 通用性强，支持任何计算规则
- 5. 数据规模 T 级数据量 百万级记录实时计算分析 存储于 hbase
- 6. 特点 多维度 实时 (3s 内响应 ) 海量数据
- 7. 架构变迁
- 8. 第一版 redis + tokyocabinet 2010.12 ~ 2011.6 mget 随机读取明细
- 9. 第二版 HBase 2011.5~ 明细数据冗余 带宽瓶颈、 server 工作繁忙
- 10. 第三版 HBase 本地计算 (region 端 ) 2011.6~ 扩展 client -> region 开发、运维复杂
- 11. HBase 的使用
- 12. 定义表 两个列族 (index 和 data) index 一般保存 id 列表 data 保存 id 明细列表
- 13. 数据储存 云梯 Hbase Hbase Hbase …… 索引：交易 id 列表 属性对 交易 1 （二进制，定长） 交易 2
- 14. 计算流程 rowkey: 商务定位 [0,2] regionserver 求 SUM(alipay) 属性 属性值 笔记本尺寸 13 寸 笔记本定位 商务定位 查索引 节点 1 1, 2, 3, 4, 5, 6, 7, 8, 9 节点 2 1, 2, 3, 4, 5, 6, 7 节点 2 1, 2, 4 , 6, 7 本地 SUM 运算（ Hbase 扩展 ） 汇总计算 写入缓存
- 15. java 客户端 HTable HTablePool Get Result
- 16. java 客户端
- 17. 例子
- 18. 缓存 总结果 单日结果 集合交集偏移量 索引（内部缓存）
- 20. 总结 冗余顺序读 替代 批量随机读 通用性 vs 性能 定长、 byte
- 21. 下一步 全部采用 hbase 本地计算 抽取框架 提高性能
- 22. Q&A thanks blog : www.yiihsia.com weibo : http://weibo.com/neihan e-mail : [email_address]