Personal Information
Organization / Workplace
Tokyo, Japan Japan
Occupation
Software Engineer - dotData Japan
Industry
Technology / Software / Internet
Website
About
I'm a software engineer specialized in Data Infrastructure and Data Processing Technology.
- Constructing realtime data processing system(Based on Spark, Flink, Kafka etc)
- Operating data analytics platform
-- Hadoop, Fluentd, or something related data processing middleware
-- Monitoring by Prometheus, Zabbix, Elastic stack etc
- Constructing ETL pipeline
-- Workflow management by Digdag, Azkaban, Jenkins etc
- Constructing CI Pipeline(Jenkins)
- Coding skill in Java, Scala, Go, JavaScript, Python and Ruby
- Constructing system on AWS(Kinesis Family, Lambda, S3, EC2, ECS etc)
- Data management of various purpose analytics data
Contact Details
Tags
streamprocessing
spark
big data
kafka
streaming
scala
gearpump
stream
scala gearpump streamprocessing
kafka stream
jjug_ccc
etl
nifi
engineering
architecture
bigdata
aws kinesis
flink
See more
- Presentations
- Documents
- Infographics