Weakly-Supervised Sound Event Detection with Self-AttentionNU_I_TODALAB
?
IEEE ICASSP 2020
Koichi Miyazaki, Tatsuya Komatsu, Tomoki Hayashi, Shinji Watanabe, Tomoki Toda, Kazuya Takeda, Weakly-supervised sound event detection with self-attention, May 2020
Toda Laboratory, Department of Intelligent Systems, Graduate School of Informatics, Nagoya University
2018/8/27 電気学会システム研究会
English title: A Majorization-Minimization-Based Kalman Filter with Hyperbolic Secant Measurement Noise
Authors: H. Tanji, T. Murakami, H. Kamata
Institution: Meiji University
Presented in Technical Meeting on "Systems", IEE Japan
The document describes a real-time DNN voice conversion system with feedback to acquire character traits. It proposes a method to provide real-time feedback of the converted voice to the speaker to encourage speech modification (prosody and emphasis) towards the target speaker's character. Subjective evaluations from the first-person (user) perspective and third-person perspective found that the system improved the reproduction of the target speaker's character, especially for inexperienced users. Providing only pitch feedback was already quite effective.
Weakly-Supervised Sound Event Detection with Self-AttentionNU_I_TODALAB
?
IEEE ICASSP 2020
Koichi Miyazaki, Tatsuya Komatsu, Tomoki Hayashi, Shinji Watanabe, Tomoki Toda, Kazuya Takeda, Weakly-supervised sound event detection with self-attention, May 2020
Toda Laboratory, Department of Intelligent Systems, Graduate School of Informatics, Nagoya University
2018/8/27 電気学会システム研究会
English title: A Majorization-Minimization-Based Kalman Filter with Hyperbolic Secant Measurement Noise
Authors: H. Tanji, T. Murakami, H. Kamata
Institution: Meiji University
Presented in Technical Meeting on "Systems", IEE Japan
The document describes a real-time DNN voice conversion system with feedback to acquire character traits. It proposes a method to provide real-time feedback of the converted voice to the speaker to encourage speech modification (prosody and emphasis) towards the target speaker's character. Subjective evaluations from the first-person (user) perspective and third-person perspective found that the system improved the reproduction of the target speaker's character, especially for inexperienced users. Providing only pitch feedback was already quite effective.
4. http://www.kke.co.jpCopyright ? KOZO KEIKAKU ENGINEERING Inc. All Rights Reserved.
RF Transceiver IC
(LMS6002D)
4
Data Sheet: http://www.limemicro.com/download/LMS6002Dr2-DataSheet-1.2r0.pdf
5. http://www.kke.co.jpCopyright ? KOZO KEIKAKU ENGINEERING Inc. All Rights Reserved.
ソフトウェアセットアップ
本スライドでは、MATLAB/Simulink & Windows のセットアップを紹介
MATLAB/Simulink & Windows以外はWiki参照
https://github.com/Nuand/bladeRF/wiki
5
6. http://www.kke.co.jpCopyright ? KOZO KEIKAKU ENGINEERING Inc. All Rights Reserved.
ソフトウェア環境例
? ユーザプログラム-ドライバ間 I/F
– MATLAB/Simulink, GNURadio(GNURadioCompanion), etc.
? 対応OS
– Windows, Linux, MacOS に対応
? ファームウェア、ドライバを提供
– ソースコードは公開: https://github.com/Nuand/bladeRF
bladeRF
ドライバ
USB3.0
MATLAB/
Simulink
ユーザプロ
グラム
PC
MATLABI/F
I-Q
サンプル
6
7. http://www.kke.co.jpCopyright ? KOZO KEIKAKU ENGINEERING Inc. All Rights Reserved.
7
SDRとMATLAB/Simulinkのツールボックス
(信号処理および通信)
? Signal Processing Toolbox
– 信号処理、解析およびアルゴリズム開発
? DSP System Toolbox
– 信号処理システムの設計およびシミュレーション
? Communications System Toolbox
– 通信システムの物理層の設計とシミュレーション
? Wavelet Toolbox
– ウェーブレット理論を用いた信号、画像の解析および合成
? RF Toolbox
– RFコンポーネント回路の設計、モデリングおよび解析
? Antenna Toolbox
– Design, analyze, and visualize antenna elements and antenna arrays
? Phased Array System Toolbox
– フェーズド アレイ信号処理システムの設計およびシミュレーション
? LTE System Toolbox
– LTE および LTE-Advanced ワイヤレス通信システムの物理層のシミュレーション
? WLAN System Toolbox
– 無線LAN通信システムの物理層のシミュレーション
MathWorks社Webサイト: http://jp.mathworks.com/products/
推奨
8. http://www.kke.co.jpCopyright ? KOZO KEIKAKU ENGINEERING Inc. All Rights Reserved.
インストール手順①
8
対象ファイルをダウンロード Installers bladeRF-win-installer-2015.07.exe
Firmware bladeRF_fw_v1.8.0.img
FPGAImage hostedx40_0.3.4.rbf
ダウンロード先:
Installers : https://www.nuand.com/installers.php
Firmware : https://www.nuand.com/fx3.php
FPGA : https://www.nuand.com/fpga.php
既に、MATLAB/Simulinkがインストールされていると仮定します