chazmeyers.com/blog

Double escaping backslashes in ruby.

Posted in ruby by chazmeyers on the July 11th, 2007

If you have a string that looks like:
\

and you want it to look like:
\\

in ruby, you have to do the following:

Code (ruby)
  1.  
  2. irb(main):070:0> str = "\\"
  3. => "\\"
  4. irb(main):071:0> puts str
  5. \
  6. => nil
  7. irb(main):073:0> puts str.gsub("\\", "\\\\\\\\")
  8. \\
  9. => nil
  10.  

In Ruby, you can use perl-style regular expression numbered group references in replacement strings (ie \\1 = the first captured group of the regexp). So, to make a literal backslash in gsub, you need “\\\\”. And to make the second one, you need “\\\\\\\\”.

0 Comments

Slightly better YAMLization of Ruby Exceptions.

Posted in Uncategorized, ruby by chazmeyers on the July 10th, 2007

Consider the following irb session:

Code (ruby)
  1.  
  2. irb(main):001:0> e = Exception.new("Jerk!")
  3. => #<Exception: Jerk!>
  4. irb(main):002:0> e.message
  5. => "Jerk!"
  6. irb(main):003:0> require ‘yaml’
  7. => true
  8. irb(main):004:0> YAML.load(e.to_yaml).message
  9. => "Exception"
  10.  

That sucks. Where did the “Jerk!” go? YAML ate it. If you include this code, you can keep your “Jerk!”:

Code (ruby)
  1.  
  2. cpm@juno:~/helpticket-dev/trunk$ cat lib/better_exception_yaml.rb
  3. require ‘yaml’
  4.  
  5. class Exception
  6.   def Exception.yaml_new( klass, tag, val )
  7.     o = YAML.object_maker( klass, {})
  8.     val.each_pair do |k,v|
  9.       o.instance_variable_set("@#{k}", v)
  10.     end
  11.     o.exception(val["message"])
  12.   end
  13. end
  14.  
  15. cpm@juno:~/helpticket-dev/trunk$ irb
  16. irb(main):001:0> require ‘lib/better_exception_yaml’
  17. => true
  18. irb(main):002:0> YAML.load(Exception.new("JERK").to_yaml).message
  19. => "JERK"
  20.  

It still sucks because the backtrace is not preserved, but that’s because Exception#to_yaml doesn’t serialize that information. YAML was storing the message, but by default it stores it into a @mesg instance variable instead. Quite odd.

I wasn’t inclined enough to read up on the right way to yamlize new data. Maybe later I’ll add backtracing.

0 Comments

Installing eventmachine on older FreeBSD’s.

Posted in Uncategorized, ruby, RubyOnRails by chazmeyers on the July 5th, 2007

I’m replacing some backgroundrb workers that do long, slow TCP connections with async eventmachine code in one of my Rails webapps. I ran into some problems installing eventmachine 0.7.2 on FreeBSD 4.8-STABLE with no root access, so I’m documenting how I got around these problems. I’m certain this isn’t the best way to fix this problem, but it worked for me.

First of all, “gem install eventmachine” fails because on FreeBSD, gcc expects “-pthread” when using the pthreads library. Linux gcc normally uses “-lpthread”. Instead, download and unpack the .tar.gz.

You’ll notice that “ruby setup.rb config” fails with the same error as “gem install eventmachine”. Open ext/extconf.rb in the editor of your choice and search for

Code (ruby)
  1.  
  2. unless have_library(‘pthread’)
  3.   exit
  4. end
  5.  

Comment this entire block of code out. It is dead to us. Now when you run “ruby setup.rb config”, a Makefile will be generated. Huzzah! Now, open ext/Makefile and look for a place to add -pthread. I added it to the LIBS environment variable.

Now, you may or may not be able to run “ruby setup.rb setup && ruby setup.rb install” without problems.
If so, great!
If not, I have nothing else to share with you. Best of luck with your problems.

0 Comments

6 < 4.8?

Posted in ruby, General Programming Topics by chazmeyers on the February 28th, 2007

Like any good developer, I write code on a development server and then push the code to the production server. (Yay, SVN.) While testing out something, I noticed an odd inconsistency between the two.

Consider the following:

Code (ruby)
  1. sock = TCPSocket.new( ip, port )

Fairly simple. When I run it on my test server, I got this result:

Code (ruby)
  1. Errno::EINVAL: Invalid argument - connect(2)

When I see something like that, I presume that I made a blunder. Perhaps ip was an odd string, or port was a negative number. Who knows? I double checked myself. The ip and port were both valid.

Then I tried it out on our production server, just for the heck of it. I got this back:

Code (ruby)
  1. Errno::ECONNREFUSED: Connection refused - connect(2)

Turned out the server I was connecting to wasn’t up. A few minutes later, the server is back up and I am able to create sockets from both machines. What?

One possibility that crossed my mind was perhaps I was working with two different versions of Ruby. Check out the results from ruby -v:
dev: ruby 1.8.4 (2005-12-24) [i386-freebsd6]
production: ruby 1.8.4 (2005-12-24) [i386-freebsd4.8]

The only difference is the version of freebsd. I can only guess that freebsd 6’s standard library gives less specific error messages than freebsd 4.8. Either that, or our host upgraded the standard library without bumping the freebsd version number.

How peculiar.

0 Comments

Leaky Abstractions.

Posted in RubyOnRails, General Programming Topics by chazmeyers on the February 6th, 2007

You ever have a programming “Doh!” moment? I had one the other day. You could say I fell face first into a leaky abstraction.

For those of you who are unfamiliar with the phrase “leaky abstraction”, Joel Spolsky coined it in his classic essay titled “The Law Of Leaky Abstractions“. Go read it. Just open a new tab. I’ll still be here.

This week at work, I was writing a prototype for an algorithm in Ruby. Once everything was working in memory, I had to see how well things would work when the algorithm iteratively stored it’s results into a database. I am a lazy man, so I just took my existing classes and made them into ActiveRecords.

Consider the following:

Code (ruby)
  1.  
  2. class Student < ActiveRecord::Base
  3.   def number_of_days_available_between(start_date, end_date)
  4.     start_date = start_date.at_beginning_of_day
  5.     end_date = end_date.to_end_of_day
  6.  
  7.     count = (start_date .. end_date).inject(0) do |sum, date|
  8.       params = { :start => date.at_beginning_of_day, :endd => date.to_end_of_day }
  9.       sum += 1 unless self.vacations.find( :first, :conditions => ["start_date >= :start AND end_date ,= :endd", params ] )
  10.       sum
  11.     end
  12.   end
  13.  
  14.   def probability_for_clinic
  15.     available_days = self.number_of_days_available_between(start_date, end_date)
  16.  
  17.     # if student has no days left, there’s no chance! return negative infinity
  18.     return -1/0.0 if available_days == 0
  19.  
  20.     assignment_count = Assignment.count(:conditions => ["student_id = :me AND clinic_detail_id = :clinic", {:me => self.id, :clinic => clinic.id}] )
  21.  
  22.     clinic_days_left = ( clinic.duty_length - assignment_count ).to_f
  23.     clinic_days_left / available_days
  24.   end
  25. end
  26.  
  27. students = Student.find(:all)
  28. student_probabilities = students.inject({}) do |hsh, student|
  29.   hsh[student] = student.probability_for_clinic( clinic, start_date, end_date)
  30.   hsh
  31. end
  32.  
  33. students = students.sort {|s1, s2| student_probabilities[s2] <=> student_probabilities[s1] }

I started it up and waited for what felt like an eternity. Much frustration and a ^C later, I realized I went wrong somewhere.

That’s when I remembered that ActiveRecord could be asked to write everything it was doing to STDOUT. Boy was I shocked!

I restarted the program to be greeted by a sea of “SELECT * FROM Vacactions” statements. As previously written, my script was generating about 90! selects to the vacations table for each student. Even with just over 1000 students, this took a silly ridiculous amount of time. My poor little script was in dire need of caching.

My new version isn’t as pretty to read and it could still use a bit more work, but it is much quicker:

Code (ruby)
  1. sql = "clinic_detail_id = :clinic AND student_id IN (:students) AND day >= :start_date AND day <= :end_date"
  2. args = { :students => students, :clinic => clinic.id, :start_date => start_date, :end_date => end_date }
  3. cached_assignments = Assignment.find( :all, :conditions => [ sql, args ] )
  4.  
  5. sql = "student_id IN (:students) AND start_date >= :start_date AND end_date <= :end_date"
  6. cached_vacations = Vacation.find( :all, :conditions => [ sql, args ] )
  7.   students = Student.find(:all)
  8.   student_probabilities = students.inject({}) do |hsh, student|
  9.   # find the number of days student will be at school in semester.
  10.   available_days = (start_date .. end_date).inject(0) do |sum, date|
  11.     sum += 1 unless cached_vacations.detect { |v| v.student_id == student.id && ( v.start_date .. v.end_date ).include?( date ) }
  12.   end
  13.  
  14.   # if there are no days left, there is no chance.
  15.   if available_days == 0
  16.     hsh[student] = -1.0/0.0
  17.   else
  18.     assignments_served = cached_assignments.select { |a| a.student_id == student.id && ( start_date .. end_date ).include?( a.day ) }.size
  19.     hsh[student] = ( clinic.duty_length - assignments_served ).to_f / available_days
  20.   end
  21.   hsh
  22. end
  23.  
  24. s = students.sort { |s1, s2| student_probabilities[s2] <=> student_probabilities[s1] }

Do note that if you squint hard enough, these two algorithms look about the same in terms of “big O”.

Sometimes the devil really is in the details. The devil in this case was hiding a 90! constant under an abstraction. Jerk!

Abstractions lie. Be prepared to deal with it.
Or, in the oft spoken words of Tim Gunn, “Make it work.”

0 Comments