Beemer (dr_tectonic) wrote,


So my job. I am a data manager. Other people run regional climate models, I collect up the data and make it all pretty and share it with users.

Part of that process is quality-checking the data to make sure it doesn't have anything weird going on in it that needs to be fixed. Like this:


This is an air temperature field. The swirly colorful stuff is all values in the 200-300 ish range. The stripe of obviously wrong? The red is 1e+38, and the blue is -1e+38. Yeah, I'm gonna have to throw that bit out.

And then you occasionally find things like this:

This is three separate vertical layers of v-wind. I have no idea how we managed to get a big geometric blob of glitch values like that. My best guess is that it was stored on tape, that the layout on tape matches the layout in memory, and we're seeing some kind of physical flaw in the storage medium. (But the important thing is, it's probably not a problem with the model -- the model would have crashed and died if it managed to produce values like this -- so all I have to do to fix it is delete the bad values.)


  • The Dependency Principle and the Litany Against Fear

    Two thoughts on COVID-19: First, from Iain M. Banks' Excession: There was only one problem with the Land of Infinite Fun, and that was that if…

  • Ultravision

    I fell out of the habit of posting while work was so busy last fall, and now I've been feeling like I need to Say Something Important about my life…

  • Holiday Recovery

    I think, maybe, I am finally recovered from the end of 2019, which was exhausting. Basically, a bunch of work deadlines all converged, most of which…

  • Post a new comment


    Anonymous comments are disabled in this journal

    default userpic

    Your reply will be screened

    Your IP address will be recorded