蟀適劐講毛漪戈眈誑ロ惆講及芢隅

Mar 27, 20171 like3,110 views

Joe Suzuki

2017爛3堎27゜゜掛杅悝頗景撫湮頗 (黺忑飲湮悝陲儔)

蟀適劐講毛漪戈眈誑ロ惆講及芢隅
2017爛3堎27゜
�躂莌
(湮筅湮悝)
゜掛杅悝頗 2017爛僅景撫湮頗
(黺忑飲湮悝陲儔)

掛琌栳及醴腔
窣適匹手褩汃匹手﹜�隅毛云井卅中眈誑ロ�講及芢隅源楊
黃蕾俶及𨈘堤𪊓輪腔卞淏仄中�
(珨祡俶)
褩汃 1993
2012
赻隴
珨啜
(褩汃匹手窣適匹手)
2015爛 2017爛3堎
(偩隴互匹五凶)
? 黃蕾俶𨈘隅尺及𡛟蚚
? 必用丞賤昴尺及𡛟蚚
? R由永弗奈斥 (BNSL, 2017爛3堎)

必用丞賤昴尺及𡛟蚚
Int. J. Approximate Reasoning, 2017
黃蕾俶𨈘隅尺及𡛟蚚
Entropy J., 2016
HSIC午及掀廌

伕奈玉穴永皿
? 芢隅(褩汃)
? 芢隅(窣適)
1. 暫湔及源楊
2. 枑偶仄化中月源楊
3. 黃蕾俶及𨈘堤﹜珨祡俶
4. 偩隴卞勾中化
5. R由永弗奈斥及畿賡
引午戶

MDL/BIC卞方月眈誑ロ�講及芢隅 (Suzuki 93)
↘ 互�及午五
反0午允月

Bayes卞方月眈誑ロ�講及芢隅 (Suzuki 12)
↘ 互�及午五
反0午允月

珨啜及眈誑ロ�講及芢隅
枑偶及忒�
1. X嵞﹜Y嵞午手﹜�唗卞方勻化﹜扔件皿伙互脹仄中�杅卞卅月方丹卞﹜丟永扑亙卞Еピ月
2. 伎〝卅盟及丟永扑亙匹Еピ曰﹜公及講赽趙(褩汃趙)今木凶犯奈正井日眈誑ロ�講毛芢隅允月
3. 腕日木凶眈誑ロ惆講及笢及郔湮�毛﹜眈誑ロ惆講及芢隅�午允月﹝

褩汃犯奈正毛⻌木化手�觳卅仁�釬允月
肮元�唗及犯奈正及嶲卞﹜噫賜毛中木卅中
? 龰曰丹月�互屾卅中�磁﹜丟永扑亙反�旰允月
? 扔件皿伙卞�仄化﹜龰曰丹月�互嗣中�磁﹜郔羥卅Еピ曰毛�堤允

偩隴互匹五凶仇午
隅燴: 枑偶仄凶珨啜腔卅眈誑ロ�講及芢隅失伙打伉朮丞卞勾中化﹜
↘ 踏隙場戶化
↘ 暫逃桶
眈誑ロ�講反﹜講赽趙仄化手﹜芢隅儕僅互湮五仁反邈切卅中互﹜
丟永扑亙互�井允亢月午﹜綎悝�匹﹜�互苤今仁卅月

黃蕾俶互復薹1匹𨈘堤匹五月 (偩隴及衙謹)
布件穴憝杅
(煦賃桶及
乒犯伙腢亼及
奶丟奈斥)

珨祡俶及淏復卅旦氾奈玄丟件玄
丟永扑亙m匹眈誑ロ�講互I(X,Y)匹丐勻凶午五卞
公木毛�煦趙仄凶丟永扑亙匹反﹜I(X,Y)毛閉尹卅中仇午毛𨈘堤
丟永扑亙m匹及犯奈正及手午匹及
沭璃葆五眈誑ロ�講互0卞卅月仇午毛𨈘堤
左伉斥瓜伙及煦票互坋煦�
煦趙今木凶甲旦玄弘仿丞匹桶
政今木化中月�磁及珨祡俶
及悵偩

R由永弗奈斥 BNSL
(Bayesian Network Structure Learning)
2017爛3堎5゜鼠嶱
枑偶失伙打伉朮丞及坻﹜
矛奶斥失件生永玄伐奈弁
及赻�汜傖卅升
�躂莌 (筅湮)
捶埻�(NAIST)

引午戶
窣適講毛漪戈眈誑ロ�講及芢隅
? 褩汃午窣適毛Е�e仄卅中(�唗及心毛心化中月)
? 珨祡俶
? 黃蕾俶及𨈘堤
? 煦票毛�隅仄卅中
凶仁今氏及𡛟蚚午R由永弗奈斥及鼠嶱
踏摽及掝觳:
沭璃葆五眈誑ロ�講及芢隅午沭璃葆五黃蕾俶及𨈘堤

1) Canonical correlation analysis (CCA) is a statistical method that analyzes the correlation relationship between two sets of multidimensional variables. 2) CCA finds linear transformations of the two sets of variables so that their correlation is maximized. This can be formulated as a generalized eigenvalue problem. 3) The number of dimensions of the transformed variables is determined using Bartlett's test, which tests the eigenvalues against a chi-squared distribution.

21岍廢及忒楊�𢜪 (MIC vs HSIC)Toru Imai

郔巠怀冞及數呾失伙打伉朮丞及旃噶雄砃ohken

[DL�掂頗]Deep Learning 菴15梒桶政悝�Deep Learning JP

Granger秪彆卞方月媆炵蹈犯奈正及秪彆芢隅ㄗ秪彆白尼旦2015ㄘTakashi J OZAKI

弘仿白奴市伙 Lasso 毛蚚中凶�都𨈘眭Yuya Takashina

[DL�掂頗]Wasserstein GAN/Towards Principled Methods for Training Generative Adv...Deep Learning JP

劐煦矛奶朮楊及掊隴Haruka Ozaki

憝杅犯奈正賤昴及衙猁午公及源楊Hidetoshi Matsui

[DL�掂頗]Understanding Black-box Predictions via Influence Functions Deep Learning JP

郔巠怀冞⻌藷joisino

捩賊紼郭謫掂#11matsuolab

弁仿扑永弁卅儂迮悝炾⻌藷ㄩ葆嶕ㄩ方仁妏丹盄倛測杅及鼠宒Hiroshi Nakagawa

(2020.9) 辻迮悝�卞方月趙悝毀𡛟及軑䛐午偞�Ichigaku Takigawa

儂迮悝炾卞云仃月左件仿奶件�薹腔郔巠趙及燴蹦Taiji Suzuki

捩賊紼郭悝炾氪井日⻌月旮脯汜傖乒犯伙⻌藷tmtm otm

啦梗紳莽棗娶幛梭棗滄毛手丹屾仄砆仄仁⻌藷tak9029

[DL�掂頗]Recent Advances in Autoencoder-Based Representation LearningDeep Learning JP

1. Recent advances in autoencoder-based representation learning include incorporating meta-priors to encourage disentanglement and using rate-distortion and rate-distortion-usefulness tradeoffs to balance compression and reconstruction. 2. Variational autoencoders introduce priors to disentangle latent factors, but recent work aggregates posteriors to directly encourage disentanglement. 3. The rate-distortion framework balances the rate of information transmission against reconstruction distortion, while rate-distortion-usefulness also considers downstream task usefulness.

捩賊紼郭謫掂#10matsuolab

旮脯汜傖乒犯伙午岍賜乒犯伙Masahiro Suzuki

捩賊紼郭菴ㄥ梒☆市奈生伙楊★Keisuke Sugawara

啊嗨郭謫掂頗敕眈誑ロ惆講郔湮趙卞方月桶珋悝炾Deep Learning JP

捩賊紼郭謫掂#14matsuolab

儂迮悝炾乒犯伙及瓚剿跦�及掊隴Satoshi Hara

菴20隙旦氾失仿示�馱眭夔本立瓜奈 https://stair.connpass.com/event/109983/ ▽琌栳�賒▼ https://youtu.be/Fgza_C6KphU ▽琌栳正奶玄伙▼ 儂迮悝炾乒犯伙及瓚剿跦�及掊隴 ▽琌栳衙猁▼ 掛琌栳匹反﹜辻迮悝�乒犯伙及瓚剿跦�毛枑尨允月凶戶及掊隴楊卞勾中化畿賡允月﹝詢儕僅卅庲舑?舑�e互褫夔卅辻迮悝�乒犯伙反珨啜卞準都卞恚螝卅�婖毛仄化云曰﹜升及方丹卅價𨃨匹瓚剿互狟今木化中月井毛�嶲互硿中眭月仇午反嬪褣匹丐月﹝仇及方丹卅乒犯伙及皮仿永弁示永弁旦俶毛賤秏允月凶戶卞﹜輪爛�〝卅乒犯伙及掊隴楊互旃噶?枑偶今木化五化中月﹝掛琌栳及ゴ圉匹反引內輪爛及測桶腔卅旃噶卞勾中化畿賡允月﹝摽圉匹反﹜逃桶氪及郔輪及旃噶午仄化☆仿件母丞白巧伊旦玄及�謹趙★午☆乒犯伙蹈伃★卞勾中化畿賡允月﹝

緙�腔秪彆芢�尺及桸渾 -秪彆�婖抻坰毛笢陑卞-Shiga University, RIKEN

儂迮悝炾乒犯伙及瓚剿跦�及掊隴ㄗVer.2ㄘSatoshi Hara

▽菴40隙AI本立瓜奈▼ ☆掊隴匹五月AI﹛?AI反皮仿永弁示永弁旦卅及井ˋ?★ https://www.airc.aist.go.jp/seminar_detail/seminar_040.html ▽琌栳正奶玄伙▼ 儂迮悝炾乒犯伙及瓚剿跦�及掊隴 ▽琌栳衙猁▼ 掛琌栳匹反﹜辻迮悝�乒犯伙及瓚剿跦�毛枑尨允月凶戶及掊隴楊卞勾中化畿賡允月﹝詢儕僅卅庲舑?舑�e互褫夔卅辻迮悝�乒犯伙反珨啜卞準都卞恚螝卅�婖毛仄化云曰﹜升及方丹卅價𨃨匹瓚剿互狟今木化中月井毛�嶲互硿中眭月仇午反嬪褣匹丐月﹝仇及方丹卅乒犯伙及皮仿永弁示永弁旦俶毛賤秏允月凶戶卞﹜輪爛�〝卅乒犯伙及掊隴楊互旃噶?枑偶今木化五化中月﹝掛琌栳匹反仇木日輪爛及測桶腔卅掊隴楊卞勾中化畿賡允月﹝

賊午捩聆喧堯棗紳毛掀誕允月Joe Suzuki

賊摩頗高苀杅旃Joe Suzuki

More Related Content

What's hot (20)

[DL�掂頗]Wasserstein GAN/Towards Principled Methods for Training Generative Adv...Deep Learning JP

劐煦矛奶朮楊及掊隴Haruka Ozaki

憝杅犯奈正賤昴及衙猁午公及源楊Hidetoshi Matsui

[DL�掂頗]Understanding Black-box Predictions via Influence Functions Deep Learning JP

郔巠怀冞⻌藷joisino

捩賊紼郭謫掂#11matsuolab

弁仿扑永弁卅儂迮悝炾⻌藷ㄩ葆嶕ㄩ方仁妏丹盄倛測杅及鼠宒Hiroshi Nakagawa

(2020.9) 辻迮悝�卞方月趙悝毀𡛟及軑䛐午偞�Ichigaku Takigawa

儂迮悝炾卞云仃月左件仿奶件�薹腔郔巠趙及燴蹦Taiji Suzuki

捩賊紼郭悝炾氪井日⻌月旮脯汜傖乒犯伙⻌藷tmtm otm

啦梗紳莽棗娶幛梭棗滄毛手丹屾仄砆仄仁⻌藷tak9029

[DL�掂頗]Recent Advances in Autoencoder-Based Representation LearningDeep Learning JP

捩賊紼郭謫掂#10matsuolab

旮脯汜傖乒犯伙午岍賜乒犯伙Masahiro Suzuki

捩賊紼郭菴ㄥ梒☆市奈生伙楊★Keisuke Sugawara

啊嗨郭謫掂頗敕眈誑ロ惆講郔湮趙卞方月桶珋悝炾Deep Learning JP

捩賊紼郭謫掂#14matsuolab

儂迮悝炾乒犯伙及瓚剿跦�及掊隴Satoshi Hara

緙�腔秪彆芢�尺及桸渾 -秪彆�婖抻坰毛笢陑卞-Shiga University, RIKEN

儂迮悝炾乒犯伙及瓚剿跦�及掊隴ㄗVer.2ㄘSatoshi Hara

[DL�掂頗]Wasserstein GAN/Towards Principled Methods for Training Generative Adv...Deep Learning JP

劐煦矛奶朮楊及掊隴Haruka Ozaki

憝杅犯奈正賤昴及衙猁午公及源楊Hidetoshi Matsui

[DL�掂頗]Understanding Black-box Predictions via Influence Functions Deep Learning JP

郔巠怀冞⻌藷joisino

捩賊紼郭謫掂#11matsuolab

弁仿扑永弁卅儂迮悝炾⻌藷ㄩ葆嶕ㄩ方仁妏丹盄倛測杅及鼠宒Hiroshi Nakagawa

(2020.9) 辻迮悝�卞方月趙悝毀𡛟及軑䛐午偞�Ichigaku Takigawa

儂迮悝炾卞云仃月左件仿奶件�薹腔郔巠趙及燴蹦Taiji Suzuki

捩賊紼郭悝炾氪井日⻌月旮脯汜傖乒犯伙⻌藷tmtm otm

啦梗紳莽棗娶幛梭棗滄毛手丹屾仄砆仄仁⻌藷tak9029

[DL�掂頗]Recent Advances in Autoencoder-Based Representation LearningDeep Learning JP

捩賊紼郭謫掂#10matsuolab

旮脯汜傖乒犯伙午岍賜乒犯伙Masahiro Suzuki

捩賊紼郭菴ㄥ梒☆市奈生伙楊★Keisuke Sugawara

啊嗨郭謫掂頗敕眈誑ロ惆講郔湮趙卞方月桶珋悝炾Deep Learning JP

捩賊紼郭謫掂#14matsuolab

儂迮悝炾乒犯伙及瓚剿跦�及掊隴Satoshi Hara

緙�腔秪彆芢�尺及桸渾 -秪彆�婖抻坰毛笢陑卞-Shiga University, RIKEN

儂迮悝炾乒犯伙及瓚剿跦�及掊隴ㄗVer.2ㄘSatoshi Hara

More from Joe Suzuki (20)

賊午捩聆喧堯棗紳毛掀誕允月Joe Suzuki

賊摩頗高苀杅旃Joe Suzuki

E-learning Development of Statistics and in Duex: Practical Approaches and Th...Joe Suzuki

This document discusses the development of e-learning courses in statistics through the Duex program. Duex is a consortium of Japanese universities and companies focused on data-related human resource development. It produces online statistics and data science courses using a low-cost, high-quality approach involving individual instructors creating video lectures using PowerPoint, scripts, and video editing software. The document outlines Duex's funding and participating institutions, and provides tips for instructors to efficiently create online video courses themselves with minimal budget and assistance from others.

煦皉癹隅楊匹乒犯伙恁亼及數呾講毛腴熬允月Joe Suzuki

蟀適劐講毛漪戈沭璃葆眈誑ロ惆講及芢隅Joe Suzuki

E-learning Design and Development for Data Science in Osaka UniversityJoe Suzuki

This document discusses the development of e-learning courses for data science through the Kansai Data related Human Resource Development Consortium (KDC). KDC was established in 2017 with funding from the Japanese Ministry of Education and includes several universities. It aims to develop online statistics courses to make education more accessible and help train data science professionals. The document outlines KDC's goals, challenges in creating high-quality online courses, and strategies for increasing student enrollment and participation over the next five years as funding is scheduled to end.

UAI 2017Joe Suzuki

1. The document proposes a regular quotient score for Bayesian network structure learning that allows for more efficient branch-and-bound search compared to the existing BDeu score. 2. The existing BDeu score violates regularity, meaning that Markov equivalent structures do not necessarily share the same BDeu score. 3. The authors propose a regular quotient score based on Jeffreys' prior that satisfies regularity, ensuring Markov equivalent structures share the score, enabling more efficient searching during branch-and-bound learning of Bayesian network structures.

AMBN2017 扔氾仿奶玄伐奈弁扑亦永皿Joe Suzuki

CRAN R由永弗奈斥 BNSL及衙猁Joe Suzuki

Forest Learning from DataJoe Suzuki

- The document discusses estimating mutual information and using it to learn forests and Bayesian networks from data. It presents methods for estimating mutual information, finding independence between variables, and using Kruskal's and Chow-Liu algorithms to learn tree structures that approximate joint distributions. Experiments apply these methods to Asia and Alarm datasets to learn Bayesian networks.

A Bayesian Approach to Data CompressionJoe Suzuki

A Conjecture on Strongly Consistent LearningJoe Suzuki

1. The document presents a conjecture about the error probability of overestimating the true order k* when learning autoregressive moving average (ARMA) models from samples. 2. The conjecture states that if the estimated order k is greater than the true order k*, the error probability is equal to the probability that a chi-squared distributed random variable with k - k* degrees of freedom is greater than (k - k*)dn, where dn is related to the sample size n. 3. The author provides evidence that a sum of squared estimated ARMA coefficients could be chi-squared distributed, lending credibility to the conjecture.

A Generalization of the Chow-Liu Algorithm and its Applications to Artificial...Joe Suzuki

A Generalization of Nonparametric Estimation and On-Line Prediction for Stati...Joe Suzuki

This document presents a generalization of Ryabko's measure for universal coding of stationary ergodic sources. The generalization allows constructing a measure 糸n that achieves universal coding for sources without a density function, such as those represented by a measure 米n on a measurable space. 糸n is defined by projecting the source onto increasing finer partitions and weighting the projections. If the Kullback-Leibler divergence between the source and weighting measure converges across partitions, 糸n achieves universal coding for any stationary ergodic source 米n. Examples demonstrate how the approach extends Ryabko's histogram weighting to new source types.

旃噶庄賡(悝汜砃仃)Joe Suzuki

Bayesian Criteria based on Universal MeasuresJoe Suzuki

The document presents Joe Suzuki's work on generalizing Bayesian criteria to settings beyond discrete or continuous distributions. It introduces generalized density functions based on Radon-Nikodym derivatives that allow defining universal measures gn approximating true densities f. These generalized densities enable extending Bayesian criteria like comparing pgnXgnY to (1-p)gXY to assess independence, to any sample space without assuming a specific form. The approach unifies Bayesian and MDL methods under a framework of universality, with various applications like Bayesian network structure learning.

MDL/Bayesian Criteria based on Universal Coding/MeasureJoe Suzuki

The Universal Measure for General Sources and its Application to MDL/Bayesian...Joe Suzuki

1) The document presents a new theory for universal coding and the MDL principle that is applicable to general sources without assuming discrete or continuous distributions. 2) It constructs a universal measure 糸n that satisfies certain conditions to allow generalization of universal coding and MDL. 3) This generalized framework is applied to problems that previously separated discrete and continuous cases, such as Markov order estimation using continuous data sequences and mixed discrete-continuous feature selection.

Universal Prediction without assuming either Discrete or ContinuousJoe Suzuki

1. The document discusses universal prediction without assuming data is either discrete or continuous. It presents a method to estimate generalized density functions to achieve universal prediction for any unknown probabilistic model. 2. A key insight is that universal prediction can be achieved by estimating the ratio between the true density function and a reference measure, without needing to directly estimate the density function. This allows universal prediction for data that is neither discrete nor continuous. 3. The method involves recursively refining partitions of the sample space to estimate the density ratio. It is shown that this ratio can be estimated universally for any density function, achieving the goal of prediction without assumptions about the data type.

Bayesian network structure estimation based on the Bayesian/MDL criteria when...Joe Suzuki

賊午捩聆喧堯棗紳毛掀誕允月Joe Suzuki

賊摩頗高苀杅旃Joe Suzuki

E-learning Development of Statistics and in Duex: Practical Approaches and Th...Joe Suzuki

煦皉癹隅楊匹乒犯伙恁亼及數呾講毛腴熬允月Joe Suzuki

蟀適劐講毛漪戈沭璃葆眈誑ロ惆講及芢隅Joe Suzuki

E-learning Design and Development for Data Science in Osaka UniversityJoe Suzuki

UAI 2017Joe Suzuki

AMBN2017 扔氾仿奶玄伐奈弁扑亦永皿Joe Suzuki

CRAN R由永弗奈斥 BNSL及衙猁Joe Suzuki

Forest Learning from DataJoe Suzuki

A Bayesian Approach to Data CompressionJoe Suzuki

A Conjecture on Strongly Consistent LearningJoe Suzuki

A Generalization of the Chow-Liu Algorithm and its Applications to Artificial...Joe Suzuki

A Generalization of Nonparametric Estimation and On-Line Prediction for Stati...Joe Suzuki

旃噶庄賡(悝汜砃仃)Joe Suzuki

Bayesian Criteria based on Universal MeasuresJoe Suzuki

MDL/Bayesian Criteria based on Universal Coding/MeasureJoe Suzuki

The Universal Measure for General Sources and its Application to MDL/Bayesian...Joe Suzuki

Universal Prediction without assuming either Discrete or ContinuousJoe Suzuki

Bayesian network structure estimation based on the Bayesian/MDL criteria when...Joe Suzuki