A Good Imagination and a Pile of Junk

I just don’t have the heart to post this to my cigar blog. It just seems wrong.

Cigar Monster is a website that has hourly deals.  Great hourly deals.  But I don’t want to spend my days checking it, peeking over at five minutes after every hour.

What I want is to enter in to “something” a list of cigar brands and names I’m interested then have that something keep track for me and send me an email if I get a hit.  Then I can go look and see if the deal is worth hitting.

This is going to be a particularly important feature after my job starts next Wednesday (w00t!)

For about a month I was running Ubuntu on this box as it just seemed the right thing to keep my chops up, etc.

So I banged the script out in perl.  Took a couple more hours than I thought since my perl chops had atrophied a bit.  The code won’t win any awards, but it’s about 150 lines of relatively tight (yet still comprehensible) perl source.

Along the way I hit a snag.  Sending email through smtp on gmail is problematic because they use a TLS layer underneath smtp.  But between CPAN and linux, this error went away quickly.  Net::SMTP::TLS FTW!

And it was all happy nice nice.  The script just ran, checked every once in a while, sent me a message if there was a deal on PH 681s, Ashtons, and a couple other things. (The other interesting side effect is that it’s been accruing all the Cigar Monster deals for a few weeks which is actually an interesting table of data to look at.)

There are just too many things linux is a righteous pain in the ass about.  Filenames, music and media, etc.  So once I got the job offer I switched back, unplugging one SATA drive and plugging in the vista one.

That’s all fine and good since cygwin offers a “linux enough” environment for running my scripts generally.

The nice thing about the script was that it dumped data to a network repository (fancy way of csv file on a network attached drive) so when I switched back it ran in place.

Except, apparently, for the way perl library management works.  I just couldn’t get the TLS library to install under cygwin, so I tried going to ActiveState (the happy nice-nice native windows perl distro.)  Still… no go.

So I ended up rewriting the thing in python this morning (mostly.  Still have repository de-duping management to deal with.  Not exactly computer science, I just needed a break.)

I was hoping to use it as an inital ruby project, but I couldn’t find a clear answer on whether TLS was supported on an out of the box ruby install, so I bailed on it.  I may yet reconvert the thing.

SO yeah, there’s that.

Between screen-scraping the internet, watching for patterns, sending personal alerts (and having an engine for people to submit things they may be interested in) the resulting code is actually something I’ve found myself doing over and over again, so it’s time to start distilling it down to something consistent.  I’m not quite sure what will come out of it, but if I keep the refactoring clean and manage the code base such that it’s all in the same place, I should start seeing some interesting emerging libraries pretty quickly.

The trick for me is to not attempt to anticipate what form those things are going to take then try and over-engineer it.

It’s nice to be excited about software development again.

I need that opening clip of Samir in Office Space, screaming at his steering wheel having what anyone who has ever sat in traffic knows is a perfectly fucking reasonable temper tantrum.

I’ve just spent the better part of 2 hours banging my head against a desk and playing indiscretely with large sharp objects while trying to get xmlrpc to hit this site.

I’ve done a lot of xmlrpc programming. I know it’s not magic. Google docs works beautifully.

The python code is dead simple. Set about four fields and flip the switch.

I was getting 301s. Of all fucking errors, 301s. “moved permanently.” Checked the logs, nothing.

While LOOKING at the logs, I said “ooh, someone’s banging on my site, can’t have that.” So I blocked the ip address from getting here.

Well…

GUESS WHOSE FUCKING IP ADDRESS I BLOCKED!

That’s right, Freak Boy Wonder managed to lock himself out of his own site. That’s some fine police work there Lou.

I was able to log into the wifi network of an unsuspecting neighbor and fix that particular stroke of brilliance.

I spent 45 minutes following threads of php code through the server side interface (which supports Blogger, metaWeblog, Movable Type, and everyotherdamnthing.)

Pulled down the wordpresslib library, thinking that might exist because of some bizarre peculiarity in the wp host code.

Same thing.

*twitch*

Then I had that moment, that one thought that I can almost rely on when things have gone from black to darker.

“Wouldn’t it be stupid if I needed a trailing forward slash on the filename?”

Now, a file path (on a real OS or online) is “blahblah.com/directory/directory/directory/file” The existence of a “/” means that the preceding is a path. If you’re specifying a file, you don’t need one on the end.

*sigh*

UnLESS you’re calling an xmlrpc server (in wordpress only?)

So yes. It’s all fixeded now.

But I don’t feel any better.

Now on to the FTP code.

Lately I’m finding myself doing an awful lot of large scripting projects lately in a variety of languages. PHP, Perl, Python and a smidge of Ruby as I try to figure out WTF the deal is.

I’m generally an XEmacs based programmer but I’ve got to say, I’m becoming spoiled by a lot of the advanced integrated features in modern compiled-language IDEs. The funky searching, code folding, refactoring, plug-in …err… ’stuff’ that’s in Eclipse, Visual Studio, Borland’s IDEs, IntelliJ, etc.

Any ideas? I might try and re-evaluate the Komodo IDE.

But maybe there are enough Eclipse plugins to make that worth trying. I don’t know though, eclipse is a bit big to wrap my head around casually.

Good christ this stuff is a headache. Perl has this wonderful module that allows you to build simple xmlrpc clients and servers very easily.

It looks at the structure of your request and figures out by the data type how to map it in to xml by playing data type guessing games.

Unless you pass it a date, which it treats as a string.

Now, xmlrpc has an explicit date type. So if you’re using XMLRPC::Lite to call an api method (for instance metaweblog.newPost) and pass it a date in the request structure (say, in the ‘dateCreated’ or ‘date_created_gmt’ fields), what the server gets isn’t the date field, it’s a string field, even though the contents are the same.

How to force it to call the thing a date I have no idea.
Currently I’m looking at rewriting the damn client in python.

But my eyes keep sliding over to my old (but pretty damn robust) c++ xmlrpc libraries. I could use that to generate a request and, if I was feeling lazy, just pipe the thing into curl or wget.