2013年7月16日にシンガポールで開催された第一回アジア組み合わせテストワークショップ(1st Asian Workshop on Combinatorial Testing for Complex Computer Systems)で発表した"Combinatorial Testing in Japan"のスライドを日本語にしました(だいぶ遅くなりましたが)。
英語版はこちら
/Bugler/combinatorial-testing-injapan20130616
Misra cpp, cert cpp 2016 and RTL design style guide with HAZOPKiyoshi Ogawa
?
safety and security system with MISRA C++, CERT C++ and STARC RTL design style guide using HAZOP analysis. In Japan we use English on safety and security analysis with source code and coding standards in English.
Introduction to the 10th IEEE International Conference on Software Testing, Verification and Validation (ICST 2017) held on 13-17 March, 2017 in Tokyo, Japan.
How to Make Awesome 狠狠撸Shares: Tips & Tricks狠狠撸Share
?
Turbocharge your online presence with 狠狠撸Share. We provide the best tips and tricks for succeeding on 狠狠撸Share. Get ideas for what to upload, tips for designing your deck and more.
狠狠撸Share is a global platform for sharing presentations, infographics, videos and documents. It has over 18 million pieces of professional content uploaded by experts like Eric Schmidt and Guy Kawasaki. The document provides tips for setting up an account on 狠狠撸Share, uploading content, optimizing it for searchability, and sharing it on social media to build an audience and reputation as a subject matter expert.
IoT(internet of things) devices may be very dangerous for society. IoT cyber security Counter measurement will be proposed. Before study, check some slides, youtube movies and/or quiita contents. Main part will be announced at the room. HAZOP study for security analysis will be introduced today. Electric power source, harmonic generation, smoking, firing, wireless, noise, and human resources are discussed.
Misra cpp, cert cpp 2016 and RTL design style guide with HAZOPKiyoshi Ogawa
?
safety and security system with MISRA C++, CERT C++ and STARC RTL design style guide using HAZOP analysis. In Japan we use English on safety and security analysis with source code and coding standards in English.
Introduction to the 10th IEEE International Conference on Software Testing, Verification and Validation (ICST 2017) held on 13-17 March, 2017 in Tokyo, Japan.
How to Make Awesome 狠狠撸Shares: Tips & Tricks狠狠撸Share
?
Turbocharge your online presence with 狠狠撸Share. We provide the best tips and tricks for succeeding on 狠狠撸Share. Get ideas for what to upload, tips for designing your deck and more.
狠狠撸Share is a global platform for sharing presentations, infographics, videos and documents. It has over 18 million pieces of professional content uploaded by experts like Eric Schmidt and Guy Kawasaki. The document provides tips for setting up an account on 狠狠撸Share, uploading content, optimizing it for searchability, and sharing it on social media to build an audience and reputation as a subject matter expert.
IoT(internet of things) devices may be very dangerous for society. IoT cyber security Counter measurement will be proposed. Before study, check some slides, youtube movies and/or quiita contents. Main part will be announced at the room. HAZOP study for security analysis will be introduced today. Electric power source, harmonic generation, smoking, firing, wireless, noise, and human resources are discussed.
情報システム障害解析のための知識グラフ構築の試み / Constructing a knowledge graph for information sys...Shinji Takao
?
人工知能学会 第25回知識流通ネットワーク研究会発表 http://sigksn.html.xdomain.jp/conf25/index.html
システム障害解析に関する専門家知識の抽出、グラフ化、DB化を行った際得られた知見と、知識流通手段としての知識グラフの可能性と課題を考察した結果を報告します。
Knowledge graphs have been getting attention because of its relevance to interpretable AI. Not only that, they also can be useful as a knowledge sharing mean which enable non-experts to utilize experts’ knowledge. We aim to report findings from constructing a knowledge graph through eliciting experts’ knowledge and building a knowledge database. We also suggest the possibilities and issues of knowledge graph as a knowledge sharing mean.
Timeline to the New Normal for Software TestingKeizo Tatsumi
?
The document provides a timeline of key technologies, methodologies, and trends in software development and testing from 1995 to 2018. It includes the rise of mobile/social media, cloud/big data analytics, agile/continuous development practices, test automation tools, and the growth of digital business models and IoT. Development has shifted to more iterative practices like agile, DevOps, and continuous delivery, while testing has evolved to continuous and automated approaches to keep pace with faster development cycles.
Test Automation - Past, Present and FutureKeizo Tatsumi
?
The document discusses the history and future of test automation. It covers test automation from its beginnings in the 1950s-1960s, through its growth in the 1970s-1990s driven by the software crisis and emergence of new technologies. The document then discusses the present state of test automation, including tools for web, mobile, and cloud testing. Finally, it discusses potential future research areas like cloud/SaaS testing and the role of the test automator in planning and implementing automation strategies and frameworks.
Software testing magazines in the worldKeizo Tatsumi
?
This document lists 9 software testing magazines from around the world, including Testing Experience, Tea-Time with Testers, Testing Circus, Software Test & Quality Assurance, NZTester/OZTester, Testing Trapeze, Professional Tester, Methods & Tools, and TEST Magazine. Each magazine website is provided as a resource for readers to learn more about software testing.
How to Learn The History of Software Testing Keizo Tatsumi
?
The document provides a history of software testing covering several topics:
1. It discusses the prehistory of software testing, noting that Ada Lovelace is considered the first programmer and suggesting she may have also been the first tester while working on Charles Babbage's Analytical Engine in the 19th century.
2. It outlines the evolution of computers, software engineering, and the growth of software testing from the 1950s to the present day. Key periods included the debugging, demonstration, destruction, evaluation, and prevention-oriented periods.
3. It describes some of the early testing techniques developed in the 1960s-1970s, including the concept of test control processes at IBM, equivalence partitioning, and boundary
Conceptual support for test case design (COMPSAC 87)Keizo Tatsumi
?
My presentation slides for COMPSAC '87. One of the earliest presentation about Combinatorial Testing.
K.Tatsumi, S.Watanabe, Y.Takeuchi, and H.Shimokawa, "Conceptual support for test case design," Proc. 11th Intl. Computer Software & Applications Conf.(COMPSAC), Oct. 1987
I put together historical topics regarding combinatorial testing on this timeline.
In the 1930s, Ronald Fisher developed the Design of Experiments.
Rao introduced orthogonal arrays in the 1940s
From the 1950s, Genichi Taguchi developed a methodology for applying statistics to improve quality in manufacturing and established the Quality Engineering.
Afterwards, his methodology got a great reputation and was named "Taguchi method" in the United States.
I think this reputation in the US was transmitted to Japan, Taguchi method drew attention in Japan in the early 1980s.
Shortly after, software QA engineers at Fujitsu started to apply the Design of Experiments to software testing in 1983, and they published papers in 1984 and 1987.
In the late 1980s, a few case studies were reported from NEC and IBM Japan, howe
In 1989, Fujitsu introduced this technique to AT&T.
After that, OATS, CATS and AETG were developed by AT&T group companies.
From the mid 1990s, combinatorial testing began to spread in the US.
In 1995, Dr. Phadke's paper was translated into Japanese and printed in the journal of Quality engineering.
Also, some case studies were reported in the community of quality engineering in the late 1990s.
However, combinatorial testing got much attention again after HAYST method was announced by Fuji Xerox in 2004.
Currently, many Japanese testers consider that Combinatorial Testing is one of the must-have techniques.
For Japan, we can say combinatorial testing is a re import technique.
The History of Software Engineering and Software Testing (World and Japan)Keizo Tatsumi
?
The document provides a detailed timeline of the history of software engineering and software testing from 1950 to 2010. It covers the evolution of computer systems, software, systems and services, management perspectives on software engineering, and the growth of software testing. Key events and developments are noted for both the world/US and Japan. The timeline shows the transition from hardware-focused to software-focused eras as computing technologies advanced.
The document provides a history of software testing from the 1950s to 2010. It outlines some of the major developments in testing techniques over the decades, including decision tables in 1957, equivalence partitioning and boundary value analysis in the late 1960s, cause-effect graphs in 1970, orthogonal arrays and combinatorial testing techniques from the 1980s onward, and model-based techniques like classification trees in the 1990s and covering arrays in the 2000s. The timeline shows when key techniques and methods were developed.
6. 6
主要な国際会議 -アカデミック系
? ISSTA (International Symposium on Software Testing and Analysis)
主催:ACM (Association for Computing Machinery)
第1回は1993年、元をたどると1978年のworkshop
研究者、企業の実務者、ICSTに比べてアカデミア寄り
併設ワークショップ: モデル検査、テスト自動化?モデルベース、パフォーマンス など
? ICST (International Conference on Software Testing, Verification and Validation)
主催:IEEE (The Institute of Electrical and Electronics Engineers)
第1回は2008年(ノルウェイ)、毎年、米欧で交互に開催
研究者、企業の実務者
併設ワークショップ: モデルベース、セキュリティ、組み合わせ、クラウド など
? ICSE併設ワークショップ (International Conference on Software Engineering)
AST (Automation of Software Test)
SBST (Search-Based Software Testing)
RST (Requirements Engineering and Testing)
MET (Metamorphic Testing)
(C) Keizo Tatsumi 2017
7. 7
主要な国際会議 – ビジネス系
? STAREAST, STARWEST (Software Testing Analysis & Review Conference)
主催:SQE (Software Quality Engineering)
第1回は1992年
コンサルタント、実務者の発表が中心
? CAST (Conference of the Association for Software Testing)
主催:AST (The Association for Software Testing)
第1回は2006年
コンサルタント、実務者の発表が中心
? EuroSTAR (European conference on Software Testing, Analysis & Review)
主催:QualTech Ltd.
第1回は1993年
コンサルタント、実務者の発表が中心
? その他
GTAC (Google Test Automation Conference)
Google主催のカンファレンス, 2006年から毎年開催
Agile Testing Days
ヨーロッパで開催, 2009年にドイツで開始され毎年開催
2017年6月に米国Bostonで第1回Agile Testing Days USAが開催予定
(C) Keizo Tatsumi 2017
8. ▲ ▲ ▲ ▲
EDSAC(最初の????型???????) IBM System/360 IBM System/370 Cray-1(スパコン)
▲ ▲ ▲ ▲ ▲
UNIVAC1(世界初の商用???????) DEC PDP-1 DEC PDP-8 Apple PC IBM PC ▲
▲ ▲ ▲ Sun-
IBM 701 IBM 704 Intel 4004MPU
▲ ▲ ▲
Program Test Methods Symposium 1st Workshop 2nd Work
▲ ▲ on Software Testing
Courant Symposium IEEE Symposium on Computer Software Reliability
on Debugging Techniques ▲
in Large Systems International Conference on Reliable Software
1965 19701950 1955 1960 1975 1980
シンポジウム
8
2. テストの会議の歴史
1957, Digital Computer Programming
(McRacken)
?最も初期のプログラミング教科書
?”Program Checkout”の章でデバッグや
テストを説明
1961, Computer Programming Fundamentals
(Leeds & Weinberg)
?IBM社のLeedsとWeinbergが書籍
?初めて"Program Testing"の章が設けられた
1970, Debugging Techniques in Large
Systems (Rustin(Ed.))
?デバッグ技術のシンポジウム
?IBM社のElmendorf(原因結果グラフ考案者)
がテストプロセスに関して発表
1972, The Computer Program Test Methods
Symposium
?最初のテストのシンポジウム
?1973年に論文集を書籍化した“Program Test
Methods“(Hetzel(Ed.))がテストの最初の書籍
(C) Keizo Tatsumi 2017
9. 9
テストの会議の歴史
Cray-1(スパコン)
▲ ▲ ▲ ▲ ▲
Apple PC IBM PC ▲ Apple Macintosh iPhone iPad
Sun-1 ▲ ▲
Sun SPARC Intel Pentium Pro
▲ ▲ ▲ ▲ ▲ ▲ ▲
1st Workshop 2nd Workshop 3rd Workshop ISSTA ▲
on Software Testing Testing, Verification, ICST
um on Computer Software Reliability and Analysis (TAV) ▲ ▲
STAREAST/STARWEST CAST
onal Conference on Reliable Software ▲ ▲
EuroSTAR GTAC
▲ ▲
ソフトウェアシンポジウム(第1回) ソフトウェアテストシンポジウム(JaSST)
▲SPCシンポジウム(第1回)
20102000 20051980 1985 1990 1995
1978, Software Testing and Test Documentation Workshop
?最初のテストのワークショップ、世界の60人の専門家が出席
?1979年3月にWorkshop report発行(IEEE Computer誌)
?この後、1982年、1986年に継続して開催され、これが現在の
ISSTA (International Symposium on Software Testing and
Analysis) へ続く
ChairmanのEd Miller
(C) Keizo Tatsumi 2017
10. 10
3. ICSTの概要
? 2008年に第1回を開催
研究と実践をつなぐ新しいフォーラム
研究と産業(industry)のトラックと、専門分
野に関する多数のワークショップで構成
? 開催実績
1. ICST 2008 Lillehammer, Norway April 9-11, 2008
2. ICST 2009 Denver, Colorado, USA April 1-4, 2009
3. ICST 2010 Paris, France April 7-9, 2010
4. ICST 2011 Berlin, Germany March 21-25, 2011
5. ICST 2012 Montreal, QC, Canada April 17-21, 2012
6. ICST 2013 Luxembourg, Luxembourg March 18-22, 2013
7. ICST 2014 Cleveland, Ohio, USA March 31- April 4, 2014
8. ICST 2015 Graz, Austria April 13-17, 2015
9. ICST 2016 Chicago, IL, USA April 10-15, 2016
10. ICST 2017 Tokyo, Japan March 13-17, 2017
The IEEE International Conference on Software Testing Verification and Validation(ICST)
(C) Keizo Tatsumi 2017
14. 14
論文数、参加者数 (ASTERメンバー参加会議)
? ICST 2015 Graz, Austria
参加者: 約250名
論文数: ????-129本、採択-32本(25%)
日本: 参加者-16名、発表-10件
? ICST 2016 Chicago, IL, USA
参加者: 約200名
論文数: 研究-130本、採択-34本(26%)
日本: 参加者-13名、発表-9件
? ICST 2017 Tokyo, Japan
参加者:
論文数: 研究-135本、採択-36本(27%)
日本:
参加者キット
検討中
乞うご期待
(C) Keizo Tatsumi 2017
15. 15
4. ICST 2017 プログラム概要
? Program at a Glance
3/12(Sun) 3/13(Mon) 3/14(Tue) 3/15(Wed) 3/16(Thu) 3/17(Fri)
Co-located
Events Day
Workshops & Co-
located Events
Day
Main Conference
Day
Main Conference
Day
Main Conference
Day
Workshops &
Doctoral
Symposium Day
?IWESEP ?Mutation ?Keynote-1 ?Keynote-2 ?Keynote-3 ?A-MOST
?Asian PLoP ?TAIC PART ?InSTA
?ITEQS ?ACSE
?IWCT
?IWESEP ?Banquet
?Asian PLoP
?Doctoral
Symposium
?IPSJ SIGSE (in
Japanese)
?Various sessions
?Welcome
reception
?Various sessions ?Various sessions
?Open steering
committee
?IPSJ SIGSE (in
Japanese)
(C) Keizo Tatsumi 2017
16. 16
メイン?カンファレンス – 基調講演
? Keynote-1 (3/14)
Title: The State of Continuous Integration Testing
at Google
Speaker: John Micco, Google, USA
? Keynote-2 (3/15)
Title: TBA
Speaker: Kenji Nishikawa, Toyota Motor
Corporation, Japan
? Keynote-3 (3/16)
Title: TBA
Speaker: TBA (from Europe)
(C) Keizo Tatsumi 2017