�ݺ�ߣ

Hadoop introduction

?Download as KEY, PDF?

18 likes?2,362 views

This document contains code to count unique users from log data. It splits each line on commas, extracts the user ID, initializes a hash to count IDs, increments the count for existing IDs or initializes a new count, then prints the total number of unique users.

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

#!/usr/bin/ruby

ARGF.each do |line|
line.chomp!
logs = line.split(/,/)
unless logs.empty?
printf("%s,1n", logs[0])
end
end

$#!/usr/bin/ruby h = Hash.new ARGF.each do |line| line.chomp! array = line.split(/,/) uid = array[0] c = array[1] count = 1 if h.key? uid count = h[uid].to_i + 1 end h.store uid, count end printf("#{h.length}")$

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

Hadoop introduction

More Related Content

Hadoop introduction

18. ?

42. #!/usr/bin/ruby ARGF.each do |line| line.chomp! logs = line.split(/,/) unless logs.empty? printf("%s,1n", logs[0]) end end

43. #!/usr/bin/ruby h = Hash.new ARGF.each do |line| line.chomp! array = line.split(/,/) uid = array[0] c = array[1] count = 1 if h.key? uid count = h[uid].to_i + 1 end h.store uid, count end printf("#{h.length}")

Editor's Notes

C++ &#x30E9;&#x30A4;&#x30D6;&#x30E9;&#x30EA;&#x3068;&#x3057;&#x3066; 2003 &#x5E74;&#x521D;&#x982D;&#x304B;&#x3089;&#x904B;&#x7528;&#x304C;&#x958B;&#x59CB;&#x3055;&#x308C;&#xFF0C;&#x8AD6;&#x6587;&#x304C;&#x57F7;&#x7B46;&#x3055;&#x308C;&#x305F; 2004 &#x5E74;&#x672B;&#x306E;&#x6642;&#x70B9;&#x3067;&#x540C;&#x30E9;&#x30A4;&#x30D6;&#x30E9;&#x30EA;&#x3092;&#x4F7F;&#x7528;&#x3059;&#x308B;&#x30D7;&#x30ED;&#x30B0;&#x30E9;&#x30E0;&#x306F; 900 &#x307B;&#x3069;&#x5B58;&#x5728;&#x3059;&#x308B;&#x3068;&#x8A18;&#x3055;&#x308C;&#x3066;&#x3044;&#x308B;
Yahoo! &#x6700;&#x5927;&#x306E;&#x5C0E;&#x5165;&#x4F8B; . 4,000&#x30CE;&#x30FC;&#x30C9;&#x4EE5;&#x4E0A;&#x3067;&#x691C;&#x7D22;&#x30A8;&#x30F3;&#x30B8;&#x30F3;&#x306E;&#x30E9;&#x30F3;&#x30AD;&#x30F3;&#x30B0;&#x90E8;&#x5206;&#x306E;&#x51E6;&#x7406;&#x306B;Hadoop&#x3092;&#x4F7F;&#x7528;&#x3002; Facebook : &#x30ED;&#x30B0;&#x89E3;&#x6790;&#x3068;&#x6A5F;&#x68B0;&#x5B66;&#x7FD2;&#x306B;&#x5229;&#x7528; , 4,800&#x30B3;&#x30A2;&#x306E;600&#x30CE;&#x30FC;&#x30C9;&#x898F;&#x6A21;The New York Times : Amazon EC2&#x4E0A;&#x3067;Hadoop&#x3092;&#x5229;&#x7528;&#x3057;4TB&#x5206;&#x306E;&#x30C7;&#x30FC;&#x30BF;&#x3092;OCR&#x3057;&#x3001;80&#x4E07;&#x679A;&#x306E;PNG&#x306B;36&#x6642;&#x9593;&#x3067;&#x5909;&#x63DB;
Yahoo&#x306F;128MB&#x306B;&#x3057;&#x3066;&#x308B;&#x307F;&#x305F;&#x3044;