Which Portals Scale the Best?

I’ve been working with a client using Epicentric to develop portal sites lately. I’ve worked on portals for other customers in the past and have lately started wondering what the most efficient way of developing these sorts of web applications would be. The Epicentric product is Java-based and relies on a fairly huge stack of software above the web server including a JDK, JDBC, a JSP server, and a Java servlet engine such as Jrun or Tomcat. Epicentric is a commercial portal app. Other (free) portal apps such as slash use the mod_perl approach – basically a Perl app combined with Perl DBI. Zope is Python-based (which I’m assuming would be slower unless there’s a Python equivalent to mod_perl?). And then there’s mod_virgule which is written in C but has no database interface (yet).

The question that I really haven’t found a satisfactory answer for is the speed/scalability issue. Which approach handles transactions faster and which scales to very large sites best? I’ve been unable to find any type of benchmarks or even anecdotal comparison of systems like these. I’m thinking about coding a simple benchmark program that simulates typical portal site operations in both mod_perl/DBI and Java/JDBC and comparing the speed and scalability using the same hardware, OS, database, and webserver. Has anyone done anything along these lines before? If so, I’d love to hear about it.

Turtles, Perl Monks, and Fidonet

Susan and I spent the afternoon at Fair Park the other day and shot a lot of photos of turtles. Susan got creative and scanned one of the pictures and wrote a short essay about turtles.

Someone on Advogato mentioned a new Perl site called Perl Monks. They have a much more elaborate trust/skill metric system than Advogato. I’m an Initiate (everyone starts out at this level and gains points through peer recognition over time). There are ten levels with amusing titles like acolyte, friar, pontiff, and eventually saint.

I got several replies from other old fidonet folks after my last news item, so there do appear to be others out there who remember the good ol’ days.

I ran across an interesting news story on Yahoo. Seems some French scientists have successfully used gene therapy to restore normal functioning of the immune system in two boys suffering from SCID (the disorder forces them to live in a sealed environment because they have no resistance to infection). The doctors made the gene modification by extracting bone marrow, inserting the missing genes, and then replacing the bone marrow in the body. Pretty cool.

DOS Progrmming

It looks like we’re about to start a new embedded project for a customer. They have a system running on a DOS-extender and DOS-based realtime kernel. I’m going to try to talk them into replacing it with one of the embedded Linux options that are becoming more popular. If they don’t go for that, I’ll need to brush up on ancient history – it’s been a while since I’ve done any DOS programming.

I also have more Perl coding coming up. I’ll be able to release this one under GPL. I’m going to be integrating Cybercash and iTransact support into a re-write of a Perl shopping cart/ecommerce package. It’s going to be a very small, minimal program compared to minivend and the other currently available shopping carts.

Advogato First Post

Assuming my patches to newslog and to mod_virgule work, this will be my first post to go to both my home page and to my advogato.org diary simultaneously. If nothing blows up, I’ll probably post a freshmeat announcement later tonight in case anyone else wants to sync up news/diary entries on their personal home pages to their advogato.org diary.

Discovering Advogato

I’ve been reading an open source news portal called Advogato fairly regularly and decided to sign up for an account. I’m usually just a spectator at these things – I don’t even have a slashdot account. But Advogato is fairly interesting in that it uses a group trust metric system to rate each member and assign privileges such as news posting. The theory is that this will make for a better signal to noise ratio and avoid slashdot-type posts about hot grits and Natalie Portman. Anyway, as a side effect, I’ve been working on a new version of newslog that will be able to post these news entries to my diary on advogato as well as here.

Programming the Perl DBI

I’ve been working on more Perl DBI stuff today. When I got back from lunch and checked my mail (postal mail, that is), I found that my copy of Programming the Perl DBI by Alligator Descartes & Tim Bunce had arrived. I’ve been waiting for O’Reilly to get this book out the door for a while and it came at just the right time. It’s full of useful examples of DBI, SQL, and ODBC stuff. Highly recommended.