際際滷

際際滷Share a Scribd company logo
Software Engineer in Test in 蟆 螳覦 - TERA  ろ 螳 螳ロ蟾? 
蟾  覩(sungmkim@bluehole.net) 
Lead SET / 觚襭 ろ
蠏  れ 谿るゼ 蟷 螻旧 襴
∬ 螳覦 ろ 螳 螻殊 螳ロ蟾? 襯 螻覩狩 覿, 
襦蠏碁覦  ろ語 蟯 襷殊 覿, 
 螳覦 襦語れ 蟯 殊 覿り 蟆襷  朱 譬蟆給.
1 覿 (15:50 ~ 16:50) 
1.覦 螳 
2.Software Engineer in Test? 
Test Automation 
SET at Bluehole Studio 
3.TERA Test Framework 
TeraPuppet 
TeraTest 
Selenium Integration 
4.Q & A 
Agenda
2覿 (17:00 ~ 18:00) 
1.Test Scenarios 
2.CI & 覦壱 磯 
3.炎骸 豸′ 
4.Summary 
1.DEMO 
2.蟾讌 炎骸 
3.  
5.Q & A 
Agenda
LG Electronics : 3 years Project: 4 mobile devices 
Sungmin Kim 
襦 螳覦 譬 11 谿 螳覦 
蠏碁Μ螻 伎  譬,  (螻  ) 觜 
Email: smkyhh@gmail.com / sungmkim@bluehole.net 
覦 螳 
Realtime Worlds, Client Programmer : 1 year Project: My Worlds (Data Generation) 
Microsoft, SDET and SDE 2 : 5 years Project: Office 2010, Office 2013 (SharePoint Designer) Award: Gold Star Stock Awards (2011) with SPD Test Automation 
Bluehole Studio, Lead SET (2013.08 ~ ) : 1.5 years Project: TERA (Test Automation )
Software Engineer in Test
Software Engineer in Test 
∬記伎 れ , 蟲 覲危ク 
Blizzard, Riot, EA 煙 蟆 覦蟆 SET 豈 
SET @ Blizzard, EA, Riot, Google,  
SET @ Bluehole Studio  
SDET @ Epic Games, Microsoft Game Studios, 
ろ 覿殊 襦蠏碁襾 (TEST  QA) 
ろ  
貊 る 蟆讀 
螳覦 螻 伎 譟郁鍵 蟆讀 
襦蠏碁覦 牛 ろ 
Performance, Security 伎 蟆讀 
讌願 &  伎 蟯襴 
讌   
ろ 覿朱 覓 襦蠏碁襾瑚  
Software Engineer in Test ?
Software Engineer in Test 
貉危郁   蟆讀    殊 貉危磯ゼ 牛 蟆讀   
覦覲旧  (Regression ) 
 豺 蟆讀 
Performance, Security, Code Defects 
∬覦 , 譟一 蟲譟, 襦 炎鴬 煙 磯 豢蟲 覦レ  殊   
* 觚襭 ろれ 蟆曙 
Test 螳ロ Project 1螳 (TERA) 
譟一 蟲譟: TERA Project 蠍一 150 覈 ( QA 譟一  ) 
炎鴬: 蟆 (MMORPG) 
豢 蟲螳: 6螳 (蟲, 譴蟲, 襷, 朱蓋, 覿覩, ) 
->  SET 語 1覈 ; 
Software Engineer in Test ? 
For software?
Software Engineer in Test 
覈 蟆 蟆讀   . 
覩 
UX 
覲旧″ 蟆曙 覃壱 
∬覦 QA 覲企  覓 螳 
QA 譟一螻 螳覦 譟一螻殊  襷れ 譴 
1) 覓 , 2) 貉る襴讌 レ, 3) 螳覦 襦語 螳 
螳覦觜 螳 
ろ  
讌覲伎  (ろ 企轟 蟾 覓願 伎  企 襷れ伎  襴る  ) 
螻殊  ろ 襦語  
襦 覿 覦 襯 牛 螳覦  レ 
Software Engineer in Test ? 
覩 
UX
Test Automation
KGC 2014, 'Software Enginner in Test' in Game Development (Bluehole Studio)
ろ ? 
Software Engineer in Test ? 
Product リ鍵  觜 螳  譴  
ъリ鍵朱 觜襯願 朱 伎襯 蟆讀 & ろ 襯 蠍磯朱  れ 螳覦 覦覯襦  螳 
ъ讌覲伎 危覃 觜 螳 豸°伎 螻殊 
ш鍵覲 襴 蟆讀 訖 , Security, Performance 覦 Localization ろ語  
щれ Coverage 豸′ 牛 譴覲  豕襯 牛  ろ 蟆讀 觜 豸′
  ろ 
Software Engineer in Test ? 
Reference: http://xunitpatterns.com/Goals of Test Automation.html
DEMO
KGC 2014, 'Software Enginner in Test' in Game Development (Bluehole Studio)
 蟲伎 蟾? 
 覦 (襷 覦.) 
豈 (轟 螳覦 觸蠍磯..) 
∬化 覿譟 ( 襷螻 蟲郁 谿り .) 
豐蠍 螳覦 觜 
襦語 覿 覩碁 
螳覦 譴 蟆讀 譴 讌  
 ろ 覲 
螳覦 Process 覲企る 轟レ Output 
(朱 覦..) vs ろ 螳覦 
Software Engineer in Test ? 
螳 る 
覦 
Because 
Because 
 企蟆 伎. 
企至 讌 覈襯願. 
語 讌 覈襯碁. 
るジ 蟆  蟆 襷 
蠍壱 焔..
 SET  螳ロ蟾? 
∬記 螳覦 蟆曙 Microsoft  螳覦 蟆 & 覓誤 觜蟲 谿願 覯  
襦 炎鴬螻 蟲 Online Game 螳覦 蟆曙  SET  襴螳 譴 
Software Engineer in Test ? 
SET at Bluehole Studio 
SDET at Microsoft 
レ 
 豢覿 讌 
蠏覈(1) 螳覦 
れ 螳覦    
 覈 蟆 襷  . 
豕 蠍一  螳 
企 谿 覓誤 
 SDET / SDE り骸 蟯 覲 蟲襯 
襦語 & 蟲れ  螳豢伎 
Career Path  覦  
 
谿讌  覓誤 
∬鍵譟 Process 牛  
蠏覈(1) 螳覦 
襤一 
覲襯 蠑 蟆 曙  
∬鍵譟    
企 谿 覓誤 
 
轟 
QA 譟一 譟伎 (TERA 蟆曙) 
觜 譴 
覈 蟆 襷れ伎  
QA 譟一  (Office 2010, 2013 螳覦 蟆曙) 
貉る襴讌 譴 
∬覦 豐蠍磯 螻 殊企襴
 SET  螳ロ蟾? 
豌伎 覲覲企る 
Software Engineer in Test ? 
1) 蠍一 蠏殊 牛 貉る襴讌  
2) ろ   牛 讌 覲伎襦 誤  覦 觜 螳 
3) 螳覦 螻殊 ろ  牛 伎 譟郁鍵 蟆讀 
 覈襦 讌 る 谿 螳レ煙  蟆企 蠍磯
SET at Bluehole Studio
Microsoft  ろ  襦語る 襷れ 襷るレ 
Bluehole Studio  ろ   譴 
∬ 覃 企蟾?  瑚鍵 
TERA ろ 襯 蠍 襷れ  蟆 (れ 蟲螳, れ 蟇一 貊,  襦  ) 
覿覈  讌 蟆企 覩衰  
SET at Bluehole Studio 
My SET History (2013.08 ~)
My SET History (2013.08 ~) 
SET at Bluehole Studio 
襦 SET, 覓伎 ? 
SET 讌覓  覦  襴 
 ろ 襯  Tera Puppet 1.0 螳覦 
 ろ 襯  Tera Test 螳覦 
 襯  Selenium  覦 襴  蟲 螳覦 
 BTS ろ  JIRA  覦 れ 
QA  ろ 襯   螳覦 
QA ろ 襯  讌 覦 蠍一  
蟲螳覲 覦壱 ろ 磯 牛  襴  
ろ   牛 螳覦 襦語  
Client Performance  讌 豸′ 
: 
∬覦 讌 譴 & 蠑語  譴
SET at BHS 
Software Engineer in Test ? 
Bluehole Studio  覈 蟆 Test Automation Framework  誤螻 螳覦 
QA 覦 るジ 螳覦り骸  牛 豌 ろ  襴 
ш覦 ろ 覦 Unit ろ  覦 讌 
ы  ろ碁ゼ  殊企襴 覦  螳覦 
ъれ れ襯 蠍磯 Code Defect 蟆讀 覦 Security Test, Performance Test 覦 蟯  螳覦, Code Coverage 豸′ 煙  
ъ襦 蠍一  覿,  襦語 蟇語 蠍一 螻  ろ 覦覯襦  
23 
Gathering requirements and Planning test automation framework 
Designing and developing test automation framework 
Executing test cases and supporting QA and developers 
Maintenance
企 覿覿 るゴ 
Game (TERA) 
Application (MS Office 2010) 
ろ   
觜  危 
螳覦 豐蠍 螻覿 
襦讌 襴 
觜蠍 
蠍 
蟆讀  
Source Code + Data 
Source Code + Data 
蟆讀  
覩 + 蠍磯 
蠍磯 
  
 り骸 Play 蟆讀  
 
螳覦 蠏覈 
1 6螳 * 1覈 
10 伎 * ? 覈 
QA 
覲 QA 譟一  
覲 QA 譟一  
蟲螳 
6 蟲螳 
30+ 蟲螳 
OS 
Windows 7 or Windows XP 
覈 OS 
Product 覈 
豬覩 
覓 
伎 覦 
豺 + 覲伎 
 螳レ 
一危 譯手鍵 
觜襴 (1 ~ 2譯) 
朱 襴 
SET at Bluehole Studio
 
SET at Bluehole Studio 
SET 
Product  覈 , ろ  覦 殊企襴 蠍壱 覦 螳覦 
るジ 螳覦れ企 QA 覿れ   襦 螳覦 殊企襴 襴 螻 
襦 蠍一 螳覦 覦 襭 螻 
QA 蟲  牛 ろ  螳覦 
襴 & 貊 襴觀 
QA 
襴  覦 伎 覿 
襴 蟯襴 覦 讌 覲伎 
 ろ  , , 殊企襴  朱覦 
 螳覦  蠍壱  
DEV 
ろ  ろ 覦 襴れ 覓  
螳覦 ろ 
蟆郁骸  覦 伎
讌 豐覦 
 襷 螳覦螻 襦語れ   
螻 觜 20  蠍 
襾語 80 蠍 
谿り  
蟯襴 
螳覦 
螳覦 ろ 
Unit Test 
貊 貉る襴讌 レ 
一危 貉る襴讌 レ 
Server Performance 豸′ 
: 
SET at Bluehole Studio
KGC 2014, 'Software Enginner in Test' in Game Development (Bluehole Studio)
TERA Test Framework
豌 螳覦 vs 碁 襭 
碁 襭 伎 蟆 ろ  螻 覦 
TERA 覯 & 企殊伎誤 貊襯  危危螻, 
れ Product 貊  ろ  ろ 蟲豢 
れ Product 貊 螳覦 
蟲 襴るゼ 襷  , 襴  &  覦 牛  
Unit Test 覦 れ ろ 殊企襴 螳覦 牛 豢   
.NET 伎 螳覦 一煙 伎 
 蟆曙 螻糾 殊企襴襯  (e.g. Selenium) 
TERA Test Framework 
IN-HOUSE 
EXTERNAL SOLUTION
Framework Overview 
TERA Test Framework 
TeraPuppet (Record & Playback for TERA) 
-麹 /  牛 襴  覦 ろ 
-蟲 所 襴るゼ 襷り  螳 
-讌覲伎螳 暑. 
-れ  蠍磯ル  螳ロる  
Selenium Integration (Record & Playback for Web) 
- ろ碁ゼ  Open source library Selenium  ろ  
-TeraPuppet 螻 磯 蟆  襴れ 磯  ろ 螳 
- 蠍磯  ろ語  
TeraTest (C# Library & Script) 
-ろ 殊企襴 蠍磯 
-C# 朱 蟲焔 れ .NET 殊企襴  螳 
-蠏覈 一危 碁ゼ   蟆讀企 轟 覲旧″ 螻一  蟆曙一  襴   
-襴   殊企襴 螳覦 覲  
Puppeteer (BlueholeTestWeb) 
-  蠍磯 襴 蟯襴 覦 ろ 
CI with the test automation (TeraTestAgent) - TERA 覦壱 朱 ろ  襴り 襦 螳覦 
TERA
TeraPuppet 
TERA Test Framework 
31 
Record & Playback 覦 
 譴 蟆, 1) 企殊伎誤語 覯螳 譯手 覦 , 2) 蟆 企 UI Event, 3) Key Event, 4) Mouse Event, 5) 蠏 語 れ 蠍磯レ 蟲蠍  Custom Action 煙 麹螻, 企れ 譟壱,  襴るゼ 襷 , れ  覦 
讌蟯企襦 襦蠏碁覦 覈磯朱 蟲 所 襴  螳 
XML 蠍磯 襴る 蟲 
  螻 蟆讀蠍  れ 覓碁螻 蠍磯 
麹 蠍磯, ろ襴 貂′,   磯, EXCEL 磯, DB 譟一
TeraPuppet 
TERA Test Framework 
32 
Excel 煙   一危 豌襴 螳 
襦蠏碁襾碁れ 襦蠏 伎企, 覯蟾 襦  螳 
Packet螻 Event襯 襷   襦 れ 襴るゼ 襷   
∬蟆 覓碁 , 豌  覓碁れ 覩襦 覲旧″ 蠍磯レ 蟆讀 伎 覲 蠍磯 蟲  
QAれ Tera Client 蟆讀 蟆曙磯 Puppet  れ  襴るゼ  譴 
QA覿 襷れ伎殊 Puppet 覃伎
TeraPuppet 
TERA Test Framework 
33 
DEMO
TeraTest 
TERA Test Framework 
34 
C#  伎 TERA  & 蟆讀 
襦蠏碁覦  企朱, 蟲 所 ろ襴渚 煙 牛 TERA襯 危螻 蟆讀  襦 殊企襴襯 襷れ 
Native 貊襦 螳覦 TERA襯 Managed World襦 伎り鍵  覲 螳覦  
覲旧″ 襴る, 襦蠏碁覦 レ  覿覿, C# 襷螳 殊企襴襯 襦  覿覿 伎覃 譬 (e.g.  一危磯ゼ 伎 蟆讀, TeraPuppet朱   襴)
TeraTest 
TERA Test Framework 
35 
C++ /CLI Layer 
C# (with WPF (Windows Presentation Foundation)  MVVM ) 
∬覦れ UnitTest 螳覦  
Puppet螻 磯 れ Packet  螳 
覿覿 襴るれ 企 蟲 螳 
れ Library 螳覦 譴 
BOT 
DirectX 蠍磯 Game UI 蟆讀
TeraTest 
TERA Test Framework 
36 
DEMO
AutoIt vs Selenium 
AutoIt 螻 Selenium 譴 レ煙  Selenium  
QA  襦蠏碁覦 語企ゼ C#朱  
 朱 C# Study 讌 
TERA Test Framework 
AutoIt 
Selenium 
貊 企 
(, 譴, ) 
- 
- 
レ 
譴 
 
貉るる 
燕 
譴 
 
レ 
豕豐 讌 ル化  
豌 Library 讌 
貊   
朱 貊襯 燕伎朱 Firefox IDE 
れ レ (Excel 磯, .NET 磯 ) 
れ 語 讌 覦 覲 (VBA, C#, Autoit ) 
 
AutoIt 豌 語企ゼ 覦一  
C++ / C# 磯 企れ 
IDE襦 豕豐 煙 貊  企れ 
轟 語(C#) 覦一
Selenium Integration 
TERA Test Framework 
Open Source Library Selenium    ろ  
轟 蟆曙 譴 覿覿 磯ゴ螻, HTML 蠍磯 蟲譟一企襦 碁  殊企襴  危螻   (JavaScript ) 
  蠍磯  伎伎 蟆讀  
SET螳 Selenium Library 覦 Puppet   襦 螳覦 
QA 覿り 企ゼ  れ 襴  
Puppet 企 TeraTest 磯  牛, れ 蟆 牛 蟆讀 ( Puppet 朱 TERA 蟆 れ -> Selenium 覈轟企ゼ 牛 蟆讀 - > Puppet朱 覲蟆暑 蟆 蟆郁骸 蟆讀 )
Selenium Integration 
TERA Test Framework 
DEMO
2覿 .. 
TERA Test Framework  襴 
覦壱 磯 (CI) 
炎骸 
磯 
譬  /   
 
Q & A
Q & A
2覿 (17:00 ~ 18:00) 
1.Test Scenarios 
2.CI & 覦壱 磯 
3.炎骸 豸′ 
4.Summary 
1.DEMO 
2.蟾讌 炎骸 
3.  
5.Q & A 
Agenda
Test Scenarios
KGC 2014, 'Software Enginner in Test' in Game Development (Bluehole Studio)
ろ  襴 
Test Scenarios 
  殊 貉危郁    襦 ろ 襴  
∬鍵レ    襴るゼ   蟆 螻殊 
襴るゼ  襷 蟆 蟆渚螻 誤郁 譴 
襴るゼ 覈 襷 蟆曙, 觜襷 り 煙 伎 螻 
觜蟲  貉豸襯 朱  蟆 螻殊 
  
  
覦 蟲朱  
∬鍵レ  覈襯企 覿る 襴  牛  蟆郁骸 覲 
れ レ ( e.g. performance 蟆讀) 
襴 螻旧螳 螳ロ覃, 蟲螳 觜 豢螳 觜 豕 
れ OS 蟲螳覲 OS 所 蟆讀 螳 
襴 讌 覲伎 觜 覦 
豐蠍 襴  觜 覦 
 ろ誤 蟆螻 100%
TERA ろ  襴  
Test Scenarios 
5 螳 蟲螳  螳ロ 400  螳 伎 襴 
蟲螳: 蟲, 譴蟲, 朱蓋, , 覿覩 
覈: 觜蟆讀, 伎 蟆讀, 螳覦壱, 碁 貉豸 
: 蠏 貉豸, 蠍一ヾ 貉豸, Performance 
蟲: TeraPuppet, TeraTest, Selenium Integration 
QA 覿れ れ  誤磯 蠑語 襴  譴 
QA SET   覿 譴 
QA: 襴  
SET: 襴  蟲 螳覦 覦 襴 Template 螻 
∬語 螳覲 蟆曙 覲襦 襴蟇磯 CI (Continuous Integration) & 覦壱磯 ろ 牛
襴  (TeraPuppet) 
Test Scenarios
襴  (TeraTest) 
Test Scenarios
襴  (Selenium) 
Test Scenarios
襴れ 螻 讌 覲伎 ろ  螳 譴
Framework Overview 
TERA Test Framework 
TeraPuppet (Record & Playback for TERA) 
-麹 /  牛 襴  覦 ろ 
-蟲 所 襴るゼ 襷り  螳 
-讌覲伎螳 暑. 
-れ  蠍磯ル  螳ロる  
Selenium Integration (Record & Playback for Web) 
- ろ碁ゼ  Open source library Selenium  ろ  
-TeraPuppet 螻 磯 蟆  襴れ 磯  ろ 螳 
- 蠍磯  ろ語  
TeraTest (C# Library & Script) 
-ろ 殊企襴 蠍磯 
-C# 朱 蟲焔 れ .NET 殊企襴  螳 
-蠏覈 一危 碁ゼ   蟆讀企 轟 覲旧″ 螻一  蟆曙一  襴   
-襴   殊企襴 螳覦 覲  
TERA CLIENT 
Puppeteer (BlueholeTestWeb) -  蠍磯 襴 蟯襴 覦 ろ 
CI with the test automation (TeraTestAgent) 
- TERA 覦壱 朱 ろ  襴り 襦 螳覦
CI & 覦壱 磯
Continuous Integration 企 
CI & 覦壱磯 
讌朱 襴 貉碁,  襦語るゼ ろ 蟆 
語伎 讌 レ螻 語企ゼ 覦壱 蟇碁Μ 螳 譴企 
讌 牛  譴 觜螻 螳 譴企 豐
Test Automation & CI   
CI & 覦壱磯 
Reference: http://www.embeddedinsights.com/channels/2012/03/19/unit-test-tools-and-automatic-test-generation/
TeraTest Agent 
CI & 覦壱磯 
∬覦    語 牛, 伎 觜襯 蟆讀 譴 
覦壱螳 襭覃, 覯 企殊伎誤碁ゼ れ , 朱 ろ  襴るれ 蟆讀 
∬記螳覲襦 れ蟆 覦壱螳 讌螻, れ QA 覓伎 覩襦, 願 襤一  ろ 蟲豢 覦 蟆郁骸  譴 
TERA 蠍一ヾ 覦壱 ろ 襷覓朱 蠍  覲 ろ 
C# (with WPF) 朱 螳覦
TeraPuppeteer 
TeraPuppet 襴るゼ 蟆朱 貅譯朱  蠍磯 襴  蟲 
襴  蟆郁骸, 襴 , 誤 襦蠏 煙 蟯襴 
覈 ろ  蟆郁骸襯   覲   螻 
AngularJS & Bootstrap 朱 螳覦 
CI & 覦壱磯
E-mail 
∬讀 覈 襭覃, 螻 碁 蟆讀 蟆郁骸 觜襯   
伎 蟯襴 
CI & 覦壱磯 
Web 
BTS (JIRA)
ろ 蟆郁骸 覦 , SET 覦 企 襴 企轟 覿れ 觜襯 伎   
伎 蟯襴 
CI & 覦壱磯
KGC 2014, 'Software Enginner in Test' in Game Development (Bluehole Studio)
炎骸 豸′
Code Coverage 
炎骸 豸′ 
ろ 襴るれ  貊 覈 % 螳 讌襯 蟆 豸′蠍  覦覯 
Automation & Manual Test 危  豢 螳ロ讌襯 螳    譴 讌
Code Coverage 
炎骸 豸′ 
Microsoft  ろ語 譯殊 豸′ 讌 Code Coverage 
Office襯  朱 Application 貊襯 牛 螳覦 朱 
Code Coverage 蟆郁骸
Code Coverage in 蟆 螳覦 
炎骸 豸′ 
Game 蟆曙磯 Code Coverage 豸′襷朱 螻 
貊襯 牛 螳覦 + 貉豸 一危磯ゼ 牛 螳覦 
Client + Server + Contents Data 
Packet Coverage 
Server  Client  豌 Packet 譴 覈 %  Packet  ろ語  蟆讀 讌 
TERA 蟆曙, 覲企 誤 ろ 貉る襴讌 豸′ , Code Coverage 訖襷  Packet Coverage 豸′ 譴 
Data Coverage 
豌 一危 譴 覈 % 一危郁 ろ語  貉る讌 
螻殊 Coverage 豸′ 覦覯 螻覩 譴 
Packet Coverage
Summary
DEMO 
Summary
 螻 
Summary
QA 覿り骸 螳覦 覿れ ろ  覓伎 煙 語 
ろ 襯 牛 襴  
觜觜  讌  
∬鍵覲 Packet 蟆讀 40%襯 ろ 襦 蟆讀 螳 
5螳 蟲螳 朱 ろ  襴  譴 
朱 觜  ろ碁ゼ 譯朱 蟆讀   
 蟯 覓 讌 
蠍 炎骸 
Summary 
襷讌 讌襷 襴 谿  れ ろ  襾語
蠍 炎骸 
Summary
  
襦 螳覦 
 レ伎  
螳覦襷 讌譴     
讌 谿讌  覓誤 
覈 蟆 襷れ伎  
れ ろ & 襦語 蟲豢  
蠏覈 襦 炎鴬 襷 SET 谿  
 
危願螻螳 渚 蠍一ヾ 譟一螻殊  覓  曙  
  襴り   (, 襴觀, 覃  ) 
TERA 譟一 2007 覿   螳覦 覦 QA 覓誤襯 螳讌螻  
譟一 襷 螻牛   襦 蠑語 螻覩手骸 碁  
Summary
襷覓伎朱Μ
襷覓伎朱Μ 
 ろ 螻 
炎概螻 ろ 螳襴手幻 れ 螻覩手骸 谿るゼ 牛   蠍語 谿場螳 譴
Q & A
Software Engineer in Test  覓伎 蟯 殊螳  ? 
sungmkim@bluehole.net / smkyhh@gmail.com

More Related Content

What's hot (20)

讌 ろ(Pair Testing) 螳 襦
讌 ろ(Pair Testing) 螳 襦讌 ろ(Pair Testing) 螳 襦
讌 ろ(Pair Testing) 螳 襦
SangIn Choung
2010 SW Testing Trend
2010 SW Testing Trend2010 SW Testing Trend
2010 SW Testing Trend
Murian Song
語 ろ
語 ろ語 ろ
語 ろ
蠍 蟾
TDD&Refactoring Day 02: TDD
TDD&Refactoring Day 02: TDDTDD&Refactoring Day 02: TDD
TDD&Refactoring Day 02: TDD
Suwon Chae
(SW ろ 2谿)ろ語蟲
(SW ろ  2谿)ろ語蟲(SW ろ  2谿)ろ語蟲
(SW ろ 2谿)ろ語蟲
Lim SungHyun
ろ語讌蟲 燕 豕譬
ろ語讌蟲 燕 豕譬ろ語讌蟲 燕 豕譬
ろ語讌蟲 燕 豕譬
guest7178884
116 deview2013-guitar
116 deview2013-guitar116 deview2013-guitar
116 deview2013-guitar
NAVER D2
[AUG]螳覦 QA螳 ろ 襦語
[AUG]螳覦 QA螳  ろ 襦語[AUG]螳覦 QA螳  ろ 襦語
[AUG]螳覦 QA螳 ろ 襦語
豌覩
Test Driven Development (TDD) basic
Test Driven Development (TDD) basicTest Driven Development (TDD) basic
Test Driven Development (TDD) basic
Curt Park
手骸 ろ 螳 (ろ瑚鍵覲瑚 3 2)
手骸  ろ 螳 (ろ瑚鍵覲瑚 3 2)手骸  ろ 螳 (ろ瑚鍵覲瑚 3 2)
手骸 ろ 螳 (ろ瑚鍵覲瑚 3 2)
SangIn Choung
[H3 2012] る碁覦 蟆曙 App.讌蟯襴
[H3 2012] る碁覦 蟆曙 App.讌蟯襴[H3 2012] る碁覦 蟆曙 App.讌蟯襴
[H3 2012] る碁覦 蟆曙 App.讌蟯襴
KTH, 貅危壱危
蠍磯ろ語蠏 ろ瑚 襦
蠍磯ろ語蠏 ろ瑚 襦蠍磯ろ語蠏 ろ瑚 襦
蠍磯ろ語蠏 ろ瑚 襦
SangIn Choung
testing for agile?, agile for testing
testing for agile?, agile for testingtesting for agile?, agile for testing
testing for agile?, agile for testing
SangIn Choung
IoT 螳覦襯 Embedded C TDD襯 企慨
IoT 螳覦襯  Embedded C TDD襯 企慨IoT 螳覦襯  Embedded C TDD襯 企慨
IoT 螳覦襯 Embedded C TDD襯 企慨
Taeyeop Kim
ろ 貅伎れ SW 讌
ろ 貅伎れ SW 讌ろ 貅伎れ SW 讌
ろ 貅伎れ SW 讌
ろ TDD(ろ 譯朱 螳覦覦覯襦)
ろ  TDD(ろ 譯朱 螳覦覦覯襦)ろ  TDD(ろ 譯朱 螳覦覦覯襦)
ろ TDD(ろ 譯朱 螳覦覦覯襦)
KH Park (覦蟆渚)
覲牛 螳覦 _ろ_貅伎
覲牛 螳覦 _ろ_貅伎覲牛 螳覦 _ろ_貅伎
覲牛 螳覦 _ろ_貅伎
ろ 一れ 襦 (覿: )
 ろ 一れ 襦 (覿:  ) ろ 一れ 襦 (覿:  )
ろ 一れ 襦 (覿: )
SangIn Choung
C++ 貊 讌 蟯襴 觜覯
C++ 貊 讌 蟯襴 觜覯C++ 貊 讌 蟯襴 觜覯
C++ 貊 讌 蟯襴 觜覯
ろ 譯朱 螳覦 By googletest 1 れ 牛襯 讌 money 螳豌
ろ 譯朱 螳覦 By googletest   1 れ 牛襯 讌 money 螳豌ろ 譯朱 螳覦 By googletest   1 れ 牛襯 讌 money 螳豌
ろ 譯朱 螳覦 By googletest 1 れ 牛襯 讌 money 螳豌
Mickey SJ Lee
讌 ろ(Pair Testing) 螳 襦
讌 ろ(Pair Testing) 螳 襦讌 ろ(Pair Testing) 螳 襦
讌 ろ(Pair Testing) 螳 襦
SangIn Choung
2010 SW Testing Trend
2010 SW Testing Trend2010 SW Testing Trend
2010 SW Testing Trend
Murian Song
語 ろ
語 ろ語 ろ
語 ろ
蠍 蟾
TDD&Refactoring Day 02: TDD
TDD&Refactoring Day 02: TDDTDD&Refactoring Day 02: TDD
TDD&Refactoring Day 02: TDD
Suwon Chae
(SW ろ 2谿)ろ語蟲
(SW ろ  2谿)ろ語蟲(SW ろ  2谿)ろ語蟲
(SW ろ 2谿)ろ語蟲
Lim SungHyun
ろ語讌蟲 燕 豕譬
ろ語讌蟲 燕 豕譬ろ語讌蟲 燕 豕譬
ろ語讌蟲 燕 豕譬
guest7178884
116 deview2013-guitar
116 deview2013-guitar116 deview2013-guitar
116 deview2013-guitar
NAVER D2
[AUG]螳覦 QA螳 ろ 襦語
[AUG]螳覦 QA螳  ろ 襦語[AUG]螳覦 QA螳  ろ 襦語
[AUG]螳覦 QA螳 ろ 襦語
豌覩
Test Driven Development (TDD) basic
Test Driven Development (TDD) basicTest Driven Development (TDD) basic
Test Driven Development (TDD) basic
Curt Park
手骸 ろ 螳 (ろ瑚鍵覲瑚 3 2)
手骸  ろ 螳 (ろ瑚鍵覲瑚 3 2)手骸  ろ 螳 (ろ瑚鍵覲瑚 3 2)
手骸 ろ 螳 (ろ瑚鍵覲瑚 3 2)
SangIn Choung
[H3 2012] る碁覦 蟆曙 App.讌蟯襴
[H3 2012] る碁覦 蟆曙 App.讌蟯襴[H3 2012] る碁覦 蟆曙 App.讌蟯襴
[H3 2012] る碁覦 蟆曙 App.讌蟯襴
KTH, 貅危壱危
蠍磯ろ語蠏 ろ瑚 襦
蠍磯ろ語蠏 ろ瑚 襦蠍磯ろ語蠏 ろ瑚 襦
蠍磯ろ語蠏 ろ瑚 襦
SangIn Choung
testing for agile?, agile for testing
testing for agile?, agile for testingtesting for agile?, agile for testing
testing for agile?, agile for testing
SangIn Choung
IoT 螳覦襯 Embedded C TDD襯 企慨
IoT 螳覦襯  Embedded C TDD襯 企慨IoT 螳覦襯  Embedded C TDD襯 企慨
IoT 螳覦襯 Embedded C TDD襯 企慨
Taeyeop Kim
ろ 貅伎れ SW 讌
ろ 貅伎れ SW 讌ろ 貅伎れ SW 讌
ろ 貅伎れ SW 讌
ろ TDD(ろ 譯朱 螳覦覦覯襦)
ろ  TDD(ろ 譯朱 螳覦覦覯襦)ろ  TDD(ろ 譯朱 螳覦覦覯襦)
ろ TDD(ろ 譯朱 螳覦覦覯襦)
KH Park (覦蟆渚)
覲牛 螳覦 _ろ_貅伎
覲牛 螳覦 _ろ_貅伎覲牛 螳覦 _ろ_貅伎
覲牛 螳覦 _ろ_貅伎
ろ 一れ 襦 (覿: )
 ろ 一れ 襦 (覿:  ) ろ 一れ 襦 (覿:  )
ろ 一れ 襦 (覿: )
SangIn Choung
C++ 貊 讌 蟯襴 觜覯
C++ 貊 讌 蟯襴 觜覯C++ 貊 讌 蟯襴 觜覯
C++ 貊 讌 蟯襴 觜覯
ろ 譯朱 螳覦 By googletest 1 れ 牛襯 讌 money 螳豌
ろ 譯朱 螳覦 By googletest   1 れ 牛襯 讌 money 螳豌ろ 譯朱 螳覦 By googletest   1 れ 牛襯 讌 money 螳豌
ろ 譯朱 螳覦 By googletest 1 れ 牛襯 讌 money 螳豌
Mickey SJ Lee

Similar to KGC 2014, 'Software Enginner in Test' in Game Development (Bluehole Studio) (20)

VSTS Azure襯 伎 襦語 蟯襴
VSTS Azure襯 伎  襦語 蟯襴VSTS Azure襯 伎  襦語 蟯襴
VSTS Azure襯 伎 襦語 蟯襴
Gyuwon Yi
螳覦 一 レ 蠍磯 V1.2
螳覦 一 レ 蠍磯 V1.2螳覦 一 レ 蠍磯 V1.2
螳覦 一 レ 蠍磯 V1.2
Daniel Lim
煙ロ ろ語 襦語 螳豌蠍
煙ロ ろ語 襦語 螳豌蠍煙ロ ろ語 襦語 螳豌蠍
煙ロ ろ語 襦語 螳豌蠍
DomainDriven DomainDriven
覈覦 蟆 ろ (Appium )
覈覦 蟆 ろ  (Appium )覈覦 蟆 ろ  (Appium )
覈覦 蟆 ろ (Appium )
Jongwon Kim
ALM螻 DevOps 蠏碁Μ螻 Azure DevOps
ALM螻 DevOps 蠏碁Μ螻 Azure DevOpsALM螻 DevOps 蠏碁Μ螻 Azure DevOps
ALM螻 DevOps 蠏碁Μ螻 Azure DevOps
Taeyoung Kim
ろ語 TDD
ろ語 TDDろ語 TDD
ろ語 TDD
Sunghyouk Bae
[ろれ雑ろ]Session 6. scrum螻 jira 蠍磯 語 螳覦 襦語
[ろれ雑ろ]Session 6. scrum螻 jira 蠍磯 語 螳覦 襦語[ろれ雑ろ]Session 6. scrum螻 jira 蠍磯 語 螳覦 襦語
[ろれ雑ろ]Session 6. scrum螻 jira 蠍磯 語 螳覦 襦語
Hee Jae Lee
觜 AgitarOne Junit ろ語 襭螳_201608_v1.2
觜 AgitarOne Junit ろ語 襭螳_201608_v1.2觜 AgitarOne Junit ろ語 襭螳_201608_v1.2
觜 AgitarOne Junit ろ語 襭螳_201608_v1.2
tobeware
ろ語襦 W牛覲伎襭
ろ語襦 W牛覲伎襭ろ語襦 W牛覲伎襭
ろ語襦 W牛覲伎襭
SangIn Choung
畏ろ誠れ雑ろ]語┨危ろ
畏ろ誠れ雑ろ]語┨危ろ畏ろ誠れ雑ろ]語┨危ろ
畏ろ誠れ雑ろ]語┨危ろ
Ji-Woong Choi
螳覦 ろ碁ゼ 襷 (Shift left testing)
螳覦 ろ碁ゼ 襷 (Shift left testing)螳覦 ろ碁ゼ 襷 (Shift left testing)
螳覦 ろ碁ゼ 襷 (Shift left testing)
SangIn Choung
語 螳覦 襦語 覦郁化 る
語 螳覦 襦語 覦郁化 る語 螳覦 襦語 覦郁化 る
語 螳覦 襦語 覦郁化 る
Andrew Sungjin Kim
過メ求 ≡= 梶梶梶 堰= 求メ 釈=
過メ求 ≡= 梶梶梶 堰= 求メ 釈=過メ求 ≡= 梶梶梶 堰= 求メ 釈=
過メ求 ≡= 梶梶梶 堰= 求メ 釈=
覦襭 1qa襦伎6螳讌覦覯
覦襭 1qa襦伎6螳讌覦覯覦襭 1qa襦伎6螳讌覦覯
覦襭 1qa襦伎6螳讌覦覯
SangIn Choung
豌螳 濠 - 襦 襦 企慨蠍
豌螳 濠 - 襦 襦 企慨蠍豌螳 濠 - 襦 襦 企慨蠍
豌螳 濠 - 襦 襦 企慨蠍
Chris Ohk
AWS 蟷 DevOps伎手鍵 :: 覦 :: AWS Summit Seoul 2016
AWS 蟷 DevOps伎手鍵 :: 覦 :: AWS Summit Seoul 2016AWS 蟷 DevOps伎手鍵 :: 覦 :: AWS Summit Seoul 2016
AWS 蟷 DevOps伎手鍵 :: 覦 :: AWS Summit Seoul 2016
Amazon Web Services Korea
How Google Tests Software (蟲蠍 語 ろ)
How Google Tests Software (蟲蠍 語 ろ)How Google Tests Software (蟲蠍 語 ろ)
How Google Tests Software (蟲蠍 語 ろ)
Ye Joo Park
襦 Xxx 螻 苦 螳覦覦覯
襦 Xxx 螻 苦 螳覦覦覯襦 Xxx 螻 苦 螳覦覦覯
襦 Xxx 螻 苦 螳覦覦覯
Build Team Foundation Architecture
Build Team Foundation ArchitectureBuild Team Foundation Architecture
Build Team Foundation Architecture
れ 蟆 螳覦 (Agile Game Agile Game Development From The Trenches)
れ  蟆 螳覦 (Agile Game Agile Game Development From The Trenches)れ  蟆 螳覦 (Agile Game Agile Game Development From The Trenches)
れ 蟆 螳覦 (Agile Game Agile Game Development From The Trenches)
Kay Kim
VSTS Azure襯 伎 襦語 蟯襴
VSTS Azure襯 伎  襦語 蟯襴VSTS Azure襯 伎  襦語 蟯襴
VSTS Azure襯 伎 襦語 蟯襴
Gyuwon Yi
螳覦 一 レ 蠍磯 V1.2
螳覦 一 レ 蠍磯 V1.2螳覦 一 レ 蠍磯 V1.2
螳覦 一 レ 蠍磯 V1.2
Daniel Lim
覈覦 蟆 ろ (Appium )
覈覦 蟆 ろ  (Appium )覈覦 蟆 ろ  (Appium )
覈覦 蟆 ろ (Appium )
Jongwon Kim
ALM螻 DevOps 蠏碁Μ螻 Azure DevOps
ALM螻 DevOps 蠏碁Μ螻 Azure DevOpsALM螻 DevOps 蠏碁Μ螻 Azure DevOps
ALM螻 DevOps 蠏碁Μ螻 Azure DevOps
Taeyoung Kim
[ろれ雑ろ]Session 6. scrum螻 jira 蠍磯 語 螳覦 襦語
[ろれ雑ろ]Session 6. scrum螻 jira 蠍磯 語 螳覦 襦語[ろれ雑ろ]Session 6. scrum螻 jira 蠍磯 語 螳覦 襦語
[ろれ雑ろ]Session 6. scrum螻 jira 蠍磯 語 螳覦 襦語
Hee Jae Lee
觜 AgitarOne Junit ろ語 襭螳_201608_v1.2
觜 AgitarOne Junit ろ語 襭螳_201608_v1.2觜 AgitarOne Junit ろ語 襭螳_201608_v1.2
觜 AgitarOne Junit ろ語 襭螳_201608_v1.2
tobeware
ろ語襦 W牛覲伎襭
ろ語襦 W牛覲伎襭ろ語襦 W牛覲伎襭
ろ語襦 W牛覲伎襭
SangIn Choung
畏ろ誠れ雑ろ]語┨危ろ
畏ろ誠れ雑ろ]語┨危ろ畏ろ誠れ雑ろ]語┨危ろ
畏ろ誠れ雑ろ]語┨危ろ
Ji-Woong Choi
螳覦 ろ碁ゼ 襷 (Shift left testing)
螳覦 ろ碁ゼ 襷 (Shift left testing)螳覦 ろ碁ゼ 襷 (Shift left testing)
螳覦 ろ碁ゼ 襷 (Shift left testing)
SangIn Choung
語 螳覦 襦語 覦郁化 る
語 螳覦 襦語 覦郁化 る語 螳覦 襦語 覦郁化 る
語 螳覦 襦語 覦郁化 る
Andrew Sungjin Kim
過メ求 ≡= 梶梶梶 堰= 求メ 釈=
過メ求 ≡= 梶梶梶 堰= 求メ 釈=過メ求 ≡= 梶梶梶 堰= 求メ 釈=
過メ求 ≡= 梶梶梶 堰= 求メ 釈=
覦襭 1qa襦伎6螳讌覦覯
覦襭 1qa襦伎6螳讌覦覯覦襭 1qa襦伎6螳讌覦覯
覦襭 1qa襦伎6螳讌覦覯
SangIn Choung
豌螳 濠 - 襦 襦 企慨蠍
豌螳 濠 - 襦 襦 企慨蠍豌螳 濠 - 襦 襦 企慨蠍
豌螳 濠 - 襦 襦 企慨蠍
Chris Ohk
AWS 蟷 DevOps伎手鍵 :: 覦 :: AWS Summit Seoul 2016
AWS 蟷 DevOps伎手鍵 :: 覦 :: AWS Summit Seoul 2016AWS 蟷 DevOps伎手鍵 :: 覦 :: AWS Summit Seoul 2016
AWS 蟷 DevOps伎手鍵 :: 覦 :: AWS Summit Seoul 2016
Amazon Web Services Korea
How Google Tests Software (蟲蠍 語 ろ)
How Google Tests Software (蟲蠍 語 ろ)How Google Tests Software (蟲蠍 語 ろ)
How Google Tests Software (蟲蠍 語 ろ)
Ye Joo Park
襦 Xxx 螻 苦 螳覦覦覯
襦 Xxx 螻 苦 螳覦覦覯襦 Xxx 螻 苦 螳覦覦覯
襦 Xxx 螻 苦 螳覦覦覯
Build Team Foundation Architecture
Build Team Foundation ArchitectureBuild Team Foundation Architecture
Build Team Foundation Architecture
れ 蟆 螳覦 (Agile Game Agile Game Development From The Trenches)
れ  蟆 螳覦 (Agile Game Agile Game Development From The Trenches)れ  蟆 螳覦 (Agile Game Agile Game Development From The Trenches)
れ 蟆 螳覦 (Agile Game Agile Game Development From The Trenches)
Kay Kim

KGC 2014, 'Software Enginner in Test' in Game Development (Bluehole Studio)

  • 1. Software Engineer in Test in 蟆 螳覦 - TERA ろ 螳 螳ロ蟾? 蟾 覩(sungmkim@bluehole.net) Lead SET / 觚襭 ろ
  • 2. 蠏 れ 谿るゼ 蟷 螻旧 襴
  • 3. ∬ 螳覦 ろ 螳 螻殊 螳ロ蟾? 襯 螻覩狩 覿, 襦蠏碁覦 ろ語 蟯 襷殊 覿, 螳覦 襦語れ 蟯 殊 覿り 蟆襷 朱 譬蟆給.
  • 4. 1 覿 (15:50 ~ 16:50) 1.覦 螳 2.Software Engineer in Test? Test Automation SET at Bluehole Studio 3.TERA Test Framework TeraPuppet TeraTest Selenium Integration 4.Q & A Agenda
  • 5. 2覿 (17:00 ~ 18:00) 1.Test Scenarios 2.CI & 覦壱 磯 3.炎骸 豸′ 4.Summary 1.DEMO 2.蟾讌 炎骸 3. 5.Q & A Agenda
  • 6. LG Electronics : 3 years Project: 4 mobile devices Sungmin Kim 襦 螳覦 譬 11 谿 螳覦 蠏碁Μ螻 伎 譬, (螻 ) 觜 Email: smkyhh@gmail.com / sungmkim@bluehole.net 覦 螳 Realtime Worlds, Client Programmer : 1 year Project: My Worlds (Data Generation) Microsoft, SDET and SDE 2 : 5 years Project: Office 2010, Office 2013 (SharePoint Designer) Award: Gold Star Stock Awards (2011) with SPD Test Automation Bluehole Studio, Lead SET (2013.08 ~ ) : 1.5 years Project: TERA (Test Automation )
  • 8. Software Engineer in Test ∬記伎 れ , 蟲 覲危ク Blizzard, Riot, EA 煙 蟆 覦蟆 SET 豈 SET @ Blizzard, EA, Riot, Google, SET @ Bluehole Studio SDET @ Epic Games, Microsoft Game Studios, ろ 覿殊 襦蠏碁襾 (TEST QA) ろ 貊 る 蟆讀 螳覦 螻 伎 譟郁鍵 蟆讀 襦蠏碁覦 牛 ろ Performance, Security 伎 蟆讀 讌願 & 伎 蟯襴 讌 ろ 覿朱 覓 襦蠏碁襾瑚 Software Engineer in Test ?
  • 9. Software Engineer in Test 貉危郁 蟆讀 殊 貉危磯ゼ 牛 蟆讀 覦覲旧 (Regression ) 豺 蟆讀 Performance, Security, Code Defects ∬覦 , 譟一 蟲譟, 襦 炎鴬 煙 磯 豢蟲 覦レ 殊 * 觚襭 ろれ 蟆曙 Test 螳ロ Project 1螳 (TERA) 譟一 蟲譟: TERA Project 蠍一 150 覈 ( QA 譟一 ) 炎鴬: 蟆 (MMORPG) 豢 蟲螳: 6螳 (蟲, 譴蟲, 襷, 朱蓋, 覿覩, ) -> SET 語 1覈 ; Software Engineer in Test ? For software?
  • 10. Software Engineer in Test 覈 蟆 蟆讀 . 覩 UX 覲旧″ 蟆曙 覃壱 ∬覦 QA 覲企 覓 螳 QA 譟一螻 螳覦 譟一螻殊 襷れ 譴 1) 覓 , 2) 貉る襴讌 レ, 3) 螳覦 襦語 螳 螳覦觜 螳 ろ 讌覲伎 (ろ 企轟 蟾 覓願 伎 企 襷れ伎 襴る ) 螻殊 ろ 襦語 襦 覿 覦 襯 牛 螳覦 レ Software Engineer in Test ? 覩 UX
  • 13. ろ ? Software Engineer in Test ? Product リ鍵 觜 螳 譴 ъリ鍵朱 觜襯願 朱 伎襯 蟆讀 & ろ 襯 蠍磯朱 れ 螳覦 覦覯襦 螳 ъ讌覲伎 危覃 觜 螳 豸°伎 螻殊 ш鍵覲 襴 蟆讀 訖 , Security, Performance 覦 Localization ろ語 щれ Coverage 豸′ 牛 譴覲 豕襯 牛 ろ 蟆讀 觜 豸′
  • 14. Software Engineer in Test ? Reference: http://xunitpatterns.com/Goals of Test Automation.html
  • 15. DEMO
  • 17. 蟲伎 蟾? 覦 (襷 覦.) 豈 (轟 螳覦 觸蠍磯..) ∬化 覿譟 ( 襷螻 蟲郁 谿り .) 豐蠍 螳覦 觜 襦語 覿 覩碁 螳覦 譴 蟆讀 譴 讌 ろ 覲 螳覦 Process 覲企る 轟レ Output (朱 覦..) vs ろ 螳覦 Software Engineer in Test ? 螳 る 覦 Because Because 企蟆 伎. 企至 讌 覈襯願. 語 讌 覈襯碁. るジ 蟆 蟆 襷 蠍壱 焔..
  • 18. SET 螳ロ蟾? ∬記 螳覦 蟆曙 Microsoft 螳覦 蟆 & 覓誤 觜蟲 谿願 覯 襦 炎鴬螻 蟲 Online Game 螳覦 蟆曙 SET 襴螳 譴 Software Engineer in Test ? SET at Bluehole Studio SDET at Microsoft レ 豢覿 讌 蠏覈(1) 螳覦 れ 螳覦 覈 蟆 襷 . 豕 蠍一 螳 企 谿 覓誤 SDET / SDE り骸 蟯 覲 蟲襯 襦語 & 蟲れ 螳豢伎 Career Path 覦 谿讌 覓誤 ∬鍵譟 Process 牛 蠏覈(1) 螳覦 襤一 覲襯 蠑 蟆 曙 ∬鍵譟 企 谿 覓誤 轟 QA 譟一 譟伎 (TERA 蟆曙) 觜 譴 覈 蟆 襷れ伎 QA 譟一 (Office 2010, 2013 螳覦 蟆曙) 貉る襴讌 譴 ∬覦 豐蠍磯 螻 殊企襴
  • 19. SET 螳ロ蟾? 豌伎 覲覲企る Software Engineer in Test ? 1) 蠍一 蠏殊 牛 貉る襴讌 2) ろ 牛 讌 覲伎襦 誤 覦 觜 螳 3) 螳覦 螻殊 ろ 牛 伎 譟郁鍵 蟆讀 覈襦 讌 る 谿 螳レ煙 蟆企 蠍磯
  • 20. SET at Bluehole Studio
  • 21. Microsoft ろ 襦語る 襷れ 襷るレ Bluehole Studio ろ 譴 ∬ 覃 企蟾? 瑚鍵 TERA ろ 襯 蠍 襷れ 蟆 (れ 蟲螳, れ 蟇一 貊, 襦 ) 覿覈 讌 蟆企 覩衰 SET at Bluehole Studio My SET History (2013.08 ~)
  • 22. My SET History (2013.08 ~) SET at Bluehole Studio 襦 SET, 覓伎 ? SET 讌覓 覦 襴 ろ 襯 Tera Puppet 1.0 螳覦 ろ 襯 Tera Test 螳覦 襯 Selenium 覦 襴 蟲 螳覦 BTS ろ JIRA 覦 れ QA ろ 襯 螳覦 QA ろ 襯 讌 覦 蠍一 蟲螳覲 覦壱 ろ 磯 牛 襴 ろ 牛 螳覦 襦語 Client Performance 讌 豸′ : ∬覦 讌 譴 & 蠑語 譴
  • 23. SET at BHS Software Engineer in Test ? Bluehole Studio 覈 蟆 Test Automation Framework 誤螻 螳覦 QA 覦 るジ 螳覦り骸 牛 豌 ろ 襴 ш覦 ろ 覦 Unit ろ 覦 讌 ы ろ碁ゼ 殊企襴 覦 螳覦 ъれ れ襯 蠍磯 Code Defect 蟆讀 覦 Security Test, Performance Test 覦 蟯 螳覦, Code Coverage 豸′ 煙 ъ襦 蠍一 覿, 襦語 蟇語 蠍一 螻 ろ 覦覯襦 23 Gathering requirements and Planning test automation framework Designing and developing test automation framework Executing test cases and supporting QA and developers Maintenance
  • 24. 企 覿覿 るゴ Game (TERA) Application (MS Office 2010) ろ 觜 危 螳覦 豐蠍 螻覿 襦讌 襴 觜蠍 蠍 蟆讀 Source Code + Data Source Code + Data 蟆讀 覩 + 蠍磯 蠍磯 り骸 Play 蟆讀 螳覦 蠏覈 1 6螳 * 1覈 10 伎 * ? 覈 QA 覲 QA 譟一 覲 QA 譟一 蟲螳 6 蟲螳 30+ 蟲螳 OS Windows 7 or Windows XP 覈 OS Product 覈 豬覩 覓 伎 覦 豺 + 覲伎 螳レ 一危 譯手鍵 觜襴 (1 ~ 2譯) 朱 襴 SET at Bluehole Studio
  • 25. SET at Bluehole Studio SET Product 覈 , ろ 覦 殊企襴 蠍壱 覦 螳覦 るジ 螳覦れ企 QA 覿れ 襦 螳覦 殊企襴 襴 螻 襦 蠍一 螳覦 覦 襭 螻 QA 蟲 牛 ろ 螳覦 襴 & 貊 襴觀 QA 襴 覦 伎 覿 襴 蟯襴 覦 讌 覲伎 ろ , , 殊企襴 朱覦 螳覦 蠍壱 DEV ろ ろ 覦 襴れ 覓 螳覦 ろ 蟆郁骸 覦 伎
  • 26. 讌 豐覦 襷 螳覦螻 襦語れ 螻 觜 20 蠍 襾語 80 蠍 谿り 蟯襴 螳覦 螳覦 ろ Unit Test 貊 貉る襴讌 レ 一危 貉る襴讌 レ Server Performance 豸′ : SET at Bluehole Studio
  • 29. 豌 螳覦 vs 碁 襭 碁 襭 伎 蟆 ろ 螻 覦 TERA 覯 & 企殊伎誤 貊襯 危危螻, れ Product 貊 ろ ろ 蟲豢 れ Product 貊 螳覦 蟲 襴るゼ 襷 , 襴 & 覦 牛 Unit Test 覦 れ ろ 殊企襴 螳覦 牛 豢 .NET 伎 螳覦 一煙 伎 蟆曙 螻糾 殊企襴襯 (e.g. Selenium) TERA Test Framework IN-HOUSE EXTERNAL SOLUTION
  • 30. Framework Overview TERA Test Framework TeraPuppet (Record & Playback for TERA) -麹 / 牛 襴 覦 ろ -蟲 所 襴るゼ 襷り 螳 -讌覲伎螳 暑. -れ 蠍磯ル 螳ロる Selenium Integration (Record & Playback for Web) - ろ碁ゼ Open source library Selenium ろ -TeraPuppet 螻 磯 蟆 襴れ 磯 ろ 螳 - 蠍磯 ろ語 TeraTest (C# Library & Script) -ろ 殊企襴 蠍磯 -C# 朱 蟲焔 れ .NET 殊企襴 螳 -蠏覈 一危 碁ゼ 蟆讀企 轟 覲旧″ 螻一 蟆曙一 襴 -襴 殊企襴 螳覦 覲 Puppeteer (BlueholeTestWeb) - 蠍磯 襴 蟯襴 覦 ろ CI with the test automation (TeraTestAgent) - TERA 覦壱 朱 ろ 襴り 襦 螳覦 TERA
  • 31. TeraPuppet TERA Test Framework 31 Record & Playback 覦 譴 蟆, 1) 企殊伎誤語 覯螳 譯手 覦 , 2) 蟆 企 UI Event, 3) Key Event, 4) Mouse Event, 5) 蠏 語 れ 蠍磯レ 蟲蠍 Custom Action 煙 麹螻, 企れ 譟壱, 襴るゼ 襷 , れ 覦 讌蟯企襦 襦蠏碁覦 覈磯朱 蟲 所 襴 螳 XML 蠍磯 襴る 蟲 螻 蟆讀蠍 れ 覓碁螻 蠍磯 麹 蠍磯, ろ襴 貂′, 磯, EXCEL 磯, DB 譟一
  • 32. TeraPuppet TERA Test Framework 32 Excel 煙 一危 豌襴 螳 襦蠏碁襾碁れ 襦蠏 伎企, 覯蟾 襦 螳 Packet螻 Event襯 襷 襦 れ 襴るゼ 襷 ∬蟆 覓碁 , 豌 覓碁れ 覩襦 覲旧″ 蠍磯レ 蟆讀 伎 覲 蠍磯 蟲 QAれ Tera Client 蟆讀 蟆曙磯 Puppet れ 襴るゼ 譴 QA覿 襷れ伎殊 Puppet 覃伎
  • 33. TeraPuppet TERA Test Framework 33 DEMO
  • 34. TeraTest TERA Test Framework 34 C# 伎 TERA & 蟆讀 襦蠏碁覦 企朱, 蟲 所 ろ襴渚 煙 牛 TERA襯 危螻 蟆讀 襦 殊企襴襯 襷れ Native 貊襦 螳覦 TERA襯 Managed World襦 伎り鍵 覲 螳覦 覲旧″ 襴る, 襦蠏碁覦 レ 覿覿, C# 襷螳 殊企襴襯 襦 覿覿 伎覃 譬 (e.g. 一危磯ゼ 伎 蟆讀, TeraPuppet朱 襴)
  • 35. TeraTest TERA Test Framework 35 C++ /CLI Layer C# (with WPF (Windows Presentation Foundation) MVVM ) ∬覦れ UnitTest 螳覦 Puppet螻 磯 れ Packet 螳 覿覿 襴るれ 企 蟲 螳 れ Library 螳覦 譴 BOT DirectX 蠍磯 Game UI 蟆讀
  • 36. TeraTest TERA Test Framework 36 DEMO
  • 37. AutoIt vs Selenium AutoIt 螻 Selenium 譴 レ煙 Selenium QA 襦蠏碁覦 語企ゼ C#朱 朱 C# Study 讌 TERA Test Framework AutoIt Selenium 貊 企 (, 譴, ) - - レ 譴 貉るる 燕 譴 レ 豕豐 讌 ル化 豌 Library 讌 貊 朱 貊襯 燕伎朱 Firefox IDE れ レ (Excel 磯, .NET 磯 ) れ 語 讌 覦 覲 (VBA, C#, Autoit ) AutoIt 豌 語企ゼ 覦一 C++ / C# 磯 企れ IDE襦 豕豐 煙 貊 企れ 轟 語(C#) 覦一
  • 38. Selenium Integration TERA Test Framework Open Source Library Selenium ろ 轟 蟆曙 譴 覿覿 磯ゴ螻, HTML 蠍磯 蟲譟一企襦 碁 殊企襴 危螻 (JavaScript ) 蠍磯 伎伎 蟆讀 SET螳 Selenium Library 覦 Puppet 襦 螳覦 QA 覿り 企ゼ れ 襴 Puppet 企 TeraTest 磯 牛, れ 蟆 牛 蟆讀 ( Puppet 朱 TERA 蟆 れ -> Selenium 覈轟企ゼ 牛 蟆讀 - > Puppet朱 覲蟆暑 蟆 蟆郁骸 蟆讀 )
  • 39. Selenium Integration TERA Test Framework DEMO
  • 40. 2覿 .. TERA Test Framework 襴 覦壱 磯 (CI) 炎骸 磯 譬 / Q & A
  • 41. Q & A
  • 42. 2覿 (17:00 ~ 18:00) 1.Test Scenarios 2.CI & 覦壱 磯 3.炎骸 豸′ 4.Summary 1.DEMO 2.蟾讌 炎骸 3. 5.Q & A Agenda
  • 45. ろ 襴 Test Scenarios 殊 貉危郁 襦 ろ 襴 ∬鍵レ 襴るゼ 蟆 螻殊 襴るゼ 襷 蟆 蟆渚螻 誤郁 譴 襴るゼ 覈 襷 蟆曙, 觜襷 り 煙 伎 螻 觜蟲 貉豸襯 朱 蟆 螻殊 覦 蟲朱 ∬鍵レ 覈襯企 覿る 襴 牛 蟆郁骸 覲 れ レ ( e.g. performance 蟆讀) 襴 螻旧螳 螳ロ覃, 蟲螳 觜 豢螳 觜 豕 れ OS 蟲螳覲 OS 所 蟆讀 螳 襴 讌 覲伎 觜 覦 豐蠍 襴 觜 覦 ろ誤 蟆螻 100%
  • 46. TERA ろ 襴 Test Scenarios 5 螳 蟲螳 螳ロ 400 螳 伎 襴 蟲螳: 蟲, 譴蟲, 朱蓋, , 覿覩 覈: 觜蟆讀, 伎 蟆讀, 螳覦壱, 碁 貉豸 : 蠏 貉豸, 蠍一ヾ 貉豸, Performance 蟲: TeraPuppet, TeraTest, Selenium Integration QA 覿れ れ 誤磯 蠑語 襴 譴 QA SET 覿 譴 QA: 襴 SET: 襴 蟲 螳覦 覦 襴 Template 螻 ∬語 螳覲 蟆曙 覲襦 襴蟇磯 CI (Continuous Integration) & 覦壱磯 ろ 牛
  • 47. 襴 (TeraPuppet) Test Scenarios
  • 48. 襴 (TeraTest) Test Scenarios
  • 49. 襴 (Selenium) Test Scenarios
  • 50. 襴れ 螻 讌 覲伎 ろ 螳 譴
  • 51. Framework Overview TERA Test Framework TeraPuppet (Record & Playback for TERA) -麹 / 牛 襴 覦 ろ -蟲 所 襴るゼ 襷り 螳 -讌覲伎螳 暑. -れ 蠍磯ル 螳ロる Selenium Integration (Record & Playback for Web) - ろ碁ゼ Open source library Selenium ろ -TeraPuppet 螻 磯 蟆 襴れ 磯 ろ 螳 - 蠍磯 ろ語 TeraTest (C# Library & Script) -ろ 殊企襴 蠍磯 -C# 朱 蟲焔 れ .NET 殊企襴 螳 -蠏覈 一危 碁ゼ 蟆讀企 轟 覲旧″ 螻一 蟆曙一 襴 -襴 殊企襴 螳覦 覲 TERA CLIENT Puppeteer (BlueholeTestWeb) - 蠍磯 襴 蟯襴 覦 ろ CI with the test automation (TeraTestAgent) - TERA 覦壱 朱 ろ 襴り 襦 螳覦
  • 52. CI & 覦壱
  • 53. Continuous Integration 企 CI & 覦壱磯 讌朱 襴 貉碁, 襦語るゼ ろ 蟆 語伎 讌 レ螻 語企ゼ 覦壱 蟇碁Μ 螳 譴企 讌 牛 譴 觜螻 螳 譴企 豐
  • 54. Test Automation & CI CI & 覦壱磯 Reference: http://www.embeddedinsights.com/channels/2012/03/19/unit-test-tools-and-automatic-test-generation/
  • 55. TeraTest Agent CI & 覦壱磯 ∬覦 語 牛, 伎 觜襯 蟆讀 譴 覦壱螳 襭覃, 覯 企殊伎誤碁ゼ れ , 朱 ろ 襴るれ 蟆讀 ∬記螳覲襦 れ蟆 覦壱螳 讌螻, れ QA 覓伎 覩襦, 願 襤一 ろ 蟲豢 覦 蟆郁骸 譴 TERA 蠍一ヾ 覦壱 ろ 襷覓朱 蠍 覲 ろ C# (with WPF) 朱 螳覦
  • 56. TeraPuppeteer TeraPuppet 襴るゼ 蟆朱 貅譯朱 蠍磯 襴 蟲 襴 蟆郁骸, 襴 , 誤 襦蠏 煙 蟯襴 覈 ろ 蟆郁骸襯 覲 螻 AngularJS & Bootstrap 朱 螳覦 CI & 覦壱磯
  • 57. E-mail ∬讀 覈 襭覃, 螻 碁 蟆讀 蟆郁骸 觜襯 伎 蟯襴 CI & 覦壱磯 Web BTS (JIRA)
  • 58. ろ 蟆郁骸 覦 , SET 覦 企 襴 企轟 覿れ 觜襯 伎 伎 蟯襴 CI & 覦壱磯
  • 61. Code Coverage 炎骸 豸′ ろ 襴るれ 貊 覈 % 螳 讌襯 蟆 豸′蠍 覦覯 Automation & Manual Test 危 豢 螳ロ讌襯 螳 譴 讌
  • 62. Code Coverage 炎骸 豸′ Microsoft ろ語 譯殊 豸′ 讌 Code Coverage Office襯 朱 Application 貊襯 牛 螳覦 朱 Code Coverage 蟆郁骸
  • 63. Code Coverage in 蟆 螳覦 炎骸 豸′ Game 蟆曙磯 Code Coverage 豸′襷朱 螻 貊襯 牛 螳覦 + 貉豸 一危磯ゼ 牛 螳覦 Client + Server + Contents Data Packet Coverage Server Client 豌 Packet 譴 覈 % Packet ろ語 蟆讀 讌 TERA 蟆曙, 覲企 誤 ろ 貉る襴讌 豸′ , Code Coverage 訖襷 Packet Coverage 豸′ 譴 Data Coverage 豌 一危 譴 覈 % 一危郁 ろ語 貉る讌 螻殊 Coverage 豸′ 覦覯 螻覩 譴 Packet Coverage
  • 67. QA 覿り骸 螳覦 覿れ ろ 覓伎 煙 語 ろ 襯 牛 襴 觜觜 讌 ∬鍵覲 Packet 蟆讀 40%襯 ろ 襦 蟆讀 螳 5螳 蟲螳 朱 ろ 襴 譴 朱 觜 ろ碁ゼ 譯朱 蟆讀 蟯 覓 讌 蠍 炎骸 Summary 襷讌 讌襷 襴 谿 れ ろ 襾語
  • 69. 螳覦 レ伎 螳覦襷 讌譴 讌 谿讌 覓誤 覈 蟆 襷れ伎 れ ろ & 襦語 蟲豢 蠏覈 襦 炎鴬 襷 SET 谿 危願螻螳 渚 蠍一ヾ 譟一螻殊 覓 曙 襴り (, 襴觀, 覃 ) TERA 譟一 2007 覿 螳覦 覦 QA 覓誤襯 螳讌螻 譟一 襷 螻牛 襦 蠑語 螻覩手骸 碁 Summary
  • 71. 襷覓伎朱Μ ろ 螻 炎概螻 ろ 螳襴手幻 れ 螻覩手骸 谿るゼ 牛 蠍語 谿場螳 譴
  • 72. Q & A
  • 73. Software Engineer in Test 覓伎 蟯 殊螳 ? sungmkim@bluehole.net / smkyhh@gmail.com