Batch processing in rails
Download as KEY, PDF0 likes578 views
際際滷s for my talk on railsclub.ru 2011'04.
![亠亠仂亞亠仆仆仂
return unless RUBY_PLATFORM =~ /mswin/
Dir[File.join(work_catalog,"page*.pdf")]](https://image.slidesharecdn.com/batchprocessinginrails-110430042713-phpapp02/85/Batch-processing-in-rails-12-320.jpg)
![亟亳
https://gist.github.com/949049#鍖le_book.rb
https://github.com/collectiveidea/acts_as_audited
acts_as_audited :except => [:name, :file_name]
https://gist.github.com/949049#鍖le_production.rake
desc "Loads files into Production line"
task :process_batch => :environment do
Audit.as_user("rake:process_batch") do
Book.getFromBatch unless running?("process_batch")
end
end
https://gist.github.com/949049#鍖le_books_controller.rb
def restart
if @book.restartable?
Audit.as_user current_user do
@book.restart_production!
end
flash[:notice] = '弍舒弍仂从舒 仗亠亠亰舒仗亠仆舒.'
else
flash[:error] = '亠亠亰舒仗从 仆亠于仂亰仄仂亢亠仆.'
end
redirect_to request.referer
end](https://image.slidesharecdn.com/batchprocessinginrails-110430042713-phpapp02/85/Batch-processing-in-rails-13-320.jpg)
![namespace :munin do
task :config do
puts <<-CONFIG
graph_title Produced pages in last 5 minutes
graph_args -l 0
graph_vlabel pages amount
graph_category App
graph_info This graph shows amount of pages produced
texts.label Text files
docs.label Doc files
views.label View files
quotes.label Quote files
CONFIG
exit 0
end
task :run => :environment do
res = ActiveRecord::Base.connection.execute("select count(nullif(text_ready_time>(now()-'5
minutes'::interval),false)) as c0,count(nullif(doc_ready_time>(now()-'5 minutes'::interval),false)) as
c1,count(nullif(view_ready_time>(now()-'5 minutes'::interval),false)) as
c2,count(nullif(quote_ready_time>(now()-'5 minutes'::interval),false)) as c3 from pages where updated_at >
(now()-'5 minutes'::interval);")
if res
puts "texts.value #{res[0]['c0']}"
puts "docs.value #{res[0]['c1']}"
puts "views.value #{res[0]['c2']}"
puts "quotes.value #{res[0]['c3']}"
end
exit 0
end
end https://gist.github.com/949049#鍖le_munin.rake](https://image.slidesharecdn.com/batchprocessinginrails-110430042713-phpapp02/85/Batch-processing-in-rails-15-320.jpg)
![http://www.nagios.org/
namespace :nagios do
task :abbyy_activity, [:warn, :crit] => :environment do |t, args|
if args.warn and args.crit
states_list = ["loaded", "in_abbyy", "p2f_queue"]
warn_level = args.warn.to_i
crit_level = args.crit.to_i
warn_events = Audit.find(:all, :conditions=>["auditable_type = 'Book' and (username is null or username
ilike 'rake:%') and action = 'update' and created_at > ?", warn_level.minutes.ago])
crit_events = Audit.find(:all, :conditions=>["auditable_type = 'Book' and (username is null or username
ilike 'rake:%') and action = 'update' and created_at > ?", crit_level.minutes.ago])
if (crit_count = crit_events.select{|a| a['changes']['state'] and (a['changes']['state'] &
states_list).size > 1 }).empty?
puts "CRITICAL No state changes at abbyy for #{crit_level} minutes"
exit 2
end
if (warn_count = warn_events.select{|a| a['changes']['state'] and (a['changes']['state'] &
states_list).size > 1 }).empty?
puts "WARNING No state changes at abbyy for #{warn_level} minutes"
exit 1
end
puts "OK Abbyy: state changes #{warn_count.size} for #{warn_level} minutes; state changes
#{crit_count.size} for #{crit_level} minutes."
exit 0
else
exit 3
end
end
https://gist.github.com/949049#鍖le_nagios.rake](https://image.slidesharecdn.com/batchprocessinginrails-110430042713-phpapp02/85/Batch-processing-in-rails-16-320.jpg)
More Related Content
What's hot (20)
Viewers also liked (14)
![VASA CONCEPT - To Expand The Boundaries of Centre of Mass [COM]](https://cdn.slidesharecdn.com/ss_thumbnails/brainstrokes-illustrationpowerpoint-1-120927074809-phpapp02-thumbnail.jpg?width=560&fit=bounds)
Similar to Batch processing in rails (20)
Batch processing in rails
- 1. Batch processing on RoR http://slidesha.re/k6zrSL @SergeyMoiseev moiseev.sergey@gmail.com
- 2. 亠弍亠 http://moiseev--sergey.moikrug.ru/ 仗亳 仆舒 Ruby 2007 亞仂亟舒.
- 3. 舒亟舒舒 亠仆亠舒亳 从仂仆亠仆舒 (从仆亳亞) 亟仍 舒亶舒. 仂亟仆仂亶 仂仄舒: PDF. 仂亟仆仂亶 仂仄舒: SWF. 亠仆亠舒仂: print2鍖ash. 仆仂于仆仂亶 仗亳仂亳亠: 从仂仂 仂弍舒弍仂从亳 (从仂仍亳亠于仂 仗弍仍亳从亠仄 从仆亳亞 于 仄亠).
- 4. ﾐ夷術 仆亳亞亳 仗仂仗舒ﾑ 舒亰仆仂亞仂 从舒亠于舒, 舒 亳亰 仆亳 亠弍亠 仄仆仂亞仂从舒仆仂亶 仗亠亠舒弍仂从亳. Print2鍖ash 仄仂亢亠 仗亠舒舒 仆亠 弍仂仍亠亠 仂亟仆仂亞仂 亰舒亟舒仆亳 亰舒 舒亰 于 仗亠亟亠仍舒 仄舒亳仆. 丐亠弍亠 windows 仂从亢亠仆亳.
- 5. 亳亠从舒 仆仂亢亠于亠仆仆亠 亳仆舒仍仍亳亳 Rails 仗亳仍仂亢亠仆亳. 弍舒 弍舒亰舒. 仂仆亠仆亶 舒于仂仄舒 亟仍 从仂仆仂仍 仂仂礌亳 亰舒亟舒仆亳. 亟亠仍仆亠 仂仗亠舒亳亳 - rake 舒从亳 亰舒仗从舒亠仄亠 仗仂 从仂仆 亳仍亳 仗仍舒仆亳仂于亳从 亰舒亟舒.
- 6. 仂仆亳亞舒亳
- 9. https://github.com/rubyist/aasm include AASM aasm_column :state aasm_initial_state :loaded aasm_state :loaded, :enter => :reset_retry_count, :exit=>:apply_total_pages aasm_state :in_abbyy, :enter => :copy_to_abbyy aasm_state :p2f_queue, :enter=>:apply_pages_count aasm_state :in_p2fline, :enter => :copy_to_p2fline aasm_state :p2f_printing, :enter => :p2f_print aasm_state :print_failed, :enter => :free_p2fline aasm_state :wait_for_confirm, :enter => :free_p2fline aasm_state :confirmed aasm_state :confirmed_non_full aasm_state :on_server aasm_state :on_server_non_full aasm_state :published aasm_state :published_non_full aasm_state :hold aasm_state :mycop aasm_state :restarting, :after_enter => :check_avail_pdf aasm_state :restarting_full, :exit=>:restart_full 弌仂仂礌亳 从仂仆亠仆仂亞仂 舒于仂仄舒舒
- 10. 弌从舒 仄仂亟亠仍仆仂亞仂 仍仂
- 11. 仂亠仄 仆亠 仂亠亠亟 丐舒从 从舒亰舒仍仂 仗仂亠. 仍 从舒亢亟仂亞仂 亰舒亟舒仆亳 仄仂亢仆仂 仂亟仆舒亰仆舒仆仂 从舒亰舒 亠亞仂 舒. 亟亳仆亶 从舒舒仍仂亞 仂 于亠仄 亞仂仂于仄 仆舒 亠从亳亶 仄仂仄亠仆 从仂仆亠仆仂仄.
- 12. 亠亠仂亞亠仆仆仂 return unless RUBY_PLATFORM =~ /mswin/ Dir[File.join(work_catalog,"page*.pdf")]
- 13. 亟亳 https://gist.github.com/949049#鍖le_book.rb https://github.com/collectiveidea/acts_as_audited acts_as_audited :except => [:name, :file_name] https://gist.github.com/949049#鍖le_production.rake desc "Loads files into Production line" task :process_batch => :environment do Audit.as_user("rake:process_batch") do Book.getFromBatch unless running?("process_batch") end end https://gist.github.com/949049#鍖le_books_controller.rb def restart if @book.restartable? Audit.as_user current_user do @book.restart_production! end flash[:notice] = '弍舒弍仂从舒 仗亠亠亰舒仗亠仆舒.' else flash[:error] = '亠亠亰舒仗从 仆亠于仂亰仄仂亢亠仆.' end redirect_to request.referer end
- 15. namespace :munin do task :config do puts <<-CONFIG graph_title Produced pages in last 5 minutes graph_args -l 0 graph_vlabel pages amount graph_category App graph_info This graph shows amount of pages produced texts.label Text files docs.label Doc files views.label View files quotes.label Quote files CONFIG exit 0 end task :run => :environment do res = ActiveRecord::Base.connection.execute("select count(nullif(text_ready_time>(now()-'5 minutes'::interval),false)) as c0,count(nullif(doc_ready_time>(now()-'5 minutes'::interval),false)) as c1,count(nullif(view_ready_time>(now()-'5 minutes'::interval),false)) as c2,count(nullif(quote_ready_time>(now()-'5 minutes'::interval),false)) as c3 from pages where updated_at > (now()-'5 minutes'::interval);") if res puts "texts.value #{res[0]['c0']}" puts "docs.value #{res[0]['c1']}" puts "views.value #{res[0]['c2']}" puts "quotes.value #{res[0]['c3']}" end exit 0 end end https://gist.github.com/949049#鍖le_munin.rake
- 16. http://www.nagios.org/ namespace :nagios do task :abbyy_activity, [:warn, :crit] => :environment do |t, args| if args.warn and args.crit states_list = ["loaded", "in_abbyy", "p2f_queue"] warn_level = args.warn.to_i crit_level = args.crit.to_i warn_events = Audit.find(:all, :conditions=>["auditable_type = 'Book' and (username is null or username ilike 'rake:%') and action = 'update' and created_at > ?", warn_level.minutes.ago]) crit_events = Audit.find(:all, :conditions=>["auditable_type = 'Book' and (username is null or username ilike 'rake:%') and action = 'update' and created_at > ?", crit_level.minutes.ago]) if (crit_count = crit_events.select{|a| a['changes']['state'] and (a['changes']['state'] & states_list).size > 1 }).empty? puts "CRITICAL No state changes at abbyy for #{crit_level} minutes" exit 2 end if (warn_count = warn_events.select{|a| a['changes']['state'] and (a['changes']['state'] & states_list).size > 1 }).empty? puts "WARNING No state changes at abbyy for #{warn_level} minutes" exit 1 end puts "OK Abbyy: state changes #{warn_count.size} for #{warn_level} minutes; state changes #{crit_count.size} for #{crit_level} minutes." exit 0 else exit 3 end end https://gist.github.com/949049#鍖le_nagios.rake