Beemer (dr_tectonic) wrote,

Moving with the tao

Taken with the inspiration of the moment (and driven by the need to put off a thing I don't want to deal with until tomorrow), I decided that today I would write code to plot test data from the 40-70 terabytes of data that we're going to be checking before long.

And I did. I started with something vaguely similar, and I modded it to work with properly-formatted data, and I was able to write it in a really general-purpose way, and I believe (still have to test it, but I believe) that I now have something that will handle 35 of the 49 variables that we have to check, with only a trivial amount of tweaking, and with some polish, I could probably even get that to work on the command line. So suddenly, in an afternoon, we're like 70% able to deal with the avalanche of data that's going to come cascading down on us.

Shortly after I finished, my boss came to chat with me and talk and get some situation reports. "Hey," I was able to say, "speaking of all that data checking, behold the progress that has been made!"

Sometimes the universe just aligns.

  • Whoops!

    Just discovered that my Dreamwidth posts haven't been crossposting to LJ since shortly after the pandemic started because I forgot to update my…

  • Milestones

    On Tuesday two weeks ago, I gave the talk that I was scheduled to give a year ago before the conference I was giving it at was cancelled. It's still…

  • Snowpocalypse 21

    It was cloudy and snizzling most of the day Saturday, but the snow didn't really start until Saturday night, and then it kept going all day Sunday.…

  • Post a new comment


    Anonymous comments are disabled in this journal

    default userpic

    Your reply will be screened

    Your IP address will be recorded 

  • 1 comment