I'm a software engineer specialized in Data Infrastructure and Data Processing Technology.
- Constructing realtime data processing system(Based on Spark, Flink, Kafka etc)
- Operating data analytics platform
-- Hadoop, Fluentd, or something related data processing middleware
-- Monitoring by Prometheus, Zabbix, Elastic stack etc
- Constructing ETL pipeline
-- Workflow management by Digdag, Azkaban, Jenkins etc
- Constructing CI Pipeline(Jenkins)
- Coding skill in Java, Scala, Go, JavaScript, Python and Ruby
- Constructing system on AWS(Kinesis Family, Lambda, S3, EC2, ECS etc)
- Data management of various purpose analytics data