Speed up Ruby-on-Rails with memcached

Hello there! If you are new here, you might want to subscribe to the RSS feed for updates on this topic.

RubyOnRails Today I learned about memcached, which I’d heard of before, but never really investigated. From the project’s site, ”memcached is a high-performance, distributed memory object caching system, generic in nature, but intended for use in speeding up dynamic web applications by alleviating database load.” So, even though I don’t have a huge amount of traffic, I still have dynamic sites, and I’m always looking at ways to speed up my Typo blog (~~this site~~ not anymore). So, using memcached, you can get a big performance boost in databases calls, which sold me on giving it a go. I read two posts today, one about howto set this up in Freebsd, along with howto modify the source code for a boost over the default setting, and how to make Ruby-on-Rails take advantage of it. Below are steps compiled from both sites, and used on my FreeBSD 6.0 server, but most of the steps should work as well in Linux. Read more for the steps.

First let’s get memcached installed

cd /usr/ports/databases/memcached/

We only want it to get past the configure step before we modify code

make configure

Now it’s time to modify the code (NOTE: the howto linked to above was specific to a FreeBSD issue, if using Linux you may not need to make this modification)

vi work/memcached-1.1.12/memcached.c

Find this line

#include "memcached.h"

Add the undef line below it and save

#include "memcached.h"
#undef TCP_NOPUSH

Now we want it to compile and install

make install

Once that’s complete, we want to enable memcached in rc.conf

echo "memcached_enable="YES"" >> /etc/rc.conf

Then we’ll start memcached

/usr/local/etc/rc.d/memcached.sh start

Next we’ll install the ruby-memcache client

cd ../ruby-memcache/
make install

Finally we’ll modify our Ruby-on-Rails app’s environment to use memcache as its session store (make a backup first!)

cp config/environment.rb config/environment.rb.dist
vi config/environment.rb

Find the line that tells session_store to use the database instead of the file system

#config.action_controller.session_store = :active_record_store

Modify it so it tells it to use memcached, and save

config.action_controller.session_store = :mem_cache_store

Stop Typo, and then manually clear the cache

rake sweep_cache

Now restart your Typo server, and you’re done! It should now be storing all session data via memcached instead of your database.

This entry was posted on Thursday, May 11th, 2006 at 6:46 pm and is filed under Uncategorized and tagged with bsd, hacker, howto. You can follow any responses to this entry through the RSS 2.0 feed.

View Comments to “Speed up Ruby-on-Rails with memcached”

fak3r says:
June 20, 2006 at 9:46 pm
Today I read and artcle on RailsExpress.blog about a new Ruby memcache client that provides better performance than the one I installed above. From the site:
Using memcached for Ruby on Rails session storage
Posted by Stefan Kaes on Tuesday, January 24, 2006
A few days ago Eric Hodel announced the availability of a new pure Ruby memcached client implementation (memcache-client-1.0.3) with performance improvements over the older Ruby-Memcache-0.4 Roll your own SQL session store). implementation. I had measured the old version previously, for use as a Ruby on Rails fragment cache storage container, but found its performance to be abysmal and completely unusable for my purposes. memcache-client-1.0.3 provides much better performance: much faster than either the old implementation, pstore or ActiveRecordStore, but also faster than my optimized SQLSessionStore using MysqlSession
So I uninstalled memcache-client (it was version 1.0.3) then installed the newer client, Ruby-Memcache (it was version 0.4 – but it is found under databases/rubygem-memcache-client in the FreeBSD ports) and all seemed to be fine, if it’s faster or not I can’t tell just by myself, but if you want to ‘edit’ a post -or- submit a comment to a post it throws the following error:
Application error (Apache)
Change this error message for exceptions thrown outside of an action (like in Dispatcher setups or broken Ruby code) in public/500.html
I had to uninstall the newer memcache client and go back to the older client just to post this! I’m going to post this on the Typo list to see if it’s Typo, or Rails related. Where is Apache getting thrown into the mix? I use it to do the mod_proxy to ip:3000 so it hits Typo, but I’ve never gotten an error in Typo that is Apache based (afaik).
fak3r says:
June 20, 2006 at 9:46 pm
I’ve come across other articles that deal with this memcache issue in FreeBSD / OS X along with other comments on scaling with Rails. I’m still searching for an answer as to why Ruby-Memcache-0.4 works, but memcache-client-1.0.3 doesn’t. More good reading her: Memcache Mysteries, memcached performance on Mac OS 10.4,It’s boring to scale with Ruby on Rails (I like that one), [Rails] cached_model and memcache-client slowness
fak3r says:
June 20, 2006 at 9:47 pm
A little update, I got the same error:
Application error (Apache)
Change this error message for exceptions thrown outside of an action (like in Dispatcher setups or broken Ruby code) in public/500.html
On a new server…that doesn’t have Apache installed! Me thinks that error is a red herring. More digging (!) is needed on this one.
jj says:
June 29, 2006 at 8:31 am
This worked perfectly, thanks for the how to. After clearing my filesystem cache and rerunning the app, I never got any more files written in, but the site felt faster. ThankS!
fak3r says:
December 6, 2006 at 10:25 am
That rocks, I will write another memcached article soon, this one using multiple servers on the same network for better performance.
links for 2006-11-30 at The International House of Nathos says:
December 25, 2006 at 5:20 am
[...] Speed up Ruby-on-Rails with memcached just like it says (tags: ruby rails database performance) [...]
Michael Johnston says:
April 23, 2007 at 2:58 am
Is there any way to clear memcached? I have not been able to figure this out. Killing and restarting it is not an option as I have limited abilities on the server.
fak3r says:
May 3, 2007 at 12:00 pm
I’m seeing some ideas:
http://www.jsw4.net/info/listserv_archives/cgiapp/06-06/msg00031.html
http://cvs.drupal.org/viewcvs/drupal/contributions/modules/memcache/memcache.inc?rev=1.4
Which both basically deal with creating a cgi or php page to handle the manual clearing of the cache. If you had access to cron, or any type of scheduling agent, you could set curl or wget to access this page daily to run the clear.
VeeKay says:
June 13, 2008 at 8:50 am
Hi,
Is there are way we can clear cache in memcached for windows and rails?
Thanks in Advance,
Veekay
ok says:
September 25, 2008 at 1:29 am
good site aczlix
Loan Modification leads says:
May 27, 2009 at 12:06 am
nice post
skintreatment says:
October 5, 2009 at 3:47 am
website for non profits
i like to your blogs and your blog picture
thanks
gachies says:
October 24, 2009 at 4:25 am
You look great now…I also thought about posting a shot of myself…but will wait, because now I
realize that my weight and stress of it has caused a medical condition I have to take care of…website for non profits
gachies says:
October 24, 2009 at 4:29 am
you
have been inspiring to me with the post and all!
Beauty Solutions
pestcontrolsaintgeorge says:
November 17, 2009 at 4:46 am
that's really a fantastic post ! ! added to my favourite blogs list..Pest control Austin
pestcontrolsaintgeorge says:
November 18, 2009 at 12:22 am
If you use Mysql, you should make sure to use a MyISAM table for sessions. It is faster than InnoDB, and transactions are not required.Pest control Austin
nikki says:
November 18, 2009 at 6:22 am
If you use Mysql, you should make sure to use a MyISAM table for sessions. It is faster than InnoDB, and transactions are not required.Pest control Austin
iñigo says:
February 10, 2010 at 5:57 am
You can simply use flush_memcached.
iñigo says:
February 10, 2010 at 11:57 am
You can simply use flush_memcached.