Engineered a data pipeline to enable monitoring of streaming data from worldwide network of NOAA weather sensors
Implemented the pipeline using Lambda Architecture to enable fault tolerant end-Âto-Âend data processing employing tools such as Kafka, Storm, HDFS (Hadoop), HBase, Flask and Hive.
Engineered a data pipeline to enable monitoring of streaming data from worldwide network of NOAA weather sensors
Implemented the pipeline using Lambda Architecture to enable fault tolerant end-Âto-Âend data processing employing tools such as Kafka, Storm, HDFS (Hadoop), HBase, Flask and Hive.