Setting up script to automatically download HRRR rainfall forecast

Introduction

This sample shows how to setup a scheduled task to download real-time hourly spatial rainfall forecast for the next 18 hours from the NOAA HRRR site. NOAA uploads the forecast for the next 18 hours every hour consisting of 18 files. This enhanced version will run every 15 minutes to make sure all the 18 files are downloaded for each hour. If you don’t need to continuously download the data, you can manually run the script without setting up a scheduled task.

  • A server that you can setup a scheduled task
  • The bounding box of the area for the rainfall data
  • Create the folders for the scripts and the downloaded files
  • (Optional) for automated modeling, setup a scheduled task to run the script every 15 minutes
  • Setup the spatial database for loading the HRRR data
  • (Optional) Setup the data loader to load the downloaded data into the system every 30 minutes

Install the script

The script only uses PowerShell script and batch files, any windows computer should support it.

  1. Create a script folder, and data folder. In this example, both under the sample folder
  1. Copy hrrr.bat and hrrr.ps1 to the script folder
  1. Edit hrrr.bat as shown below
  2. Setup the bounding box, you can get it in Google Maps by right click on the map, make sure there is no space before and after the “=” sign
  1. Update the folder where the hrrr files will be downloaded, make sure there are two slashes at the end
  1. Run the *.bat file, you should see files starts to download in the data folder
  1. Check the log file, as shown below, it shows the files that are successfully downloaded, and the one that are not downloaded yet
  1. Setup a task scheduler

Load the HRRR files into a TSDB

  1. Define the projection in GeoPlan
  1. Verify the projection using Google Maps
  1. Zoom to the extent for the rainfall (if you only need to load the rainfall for part of the downloaded HRRR files.)
  2. Create a spatial time series database
  1. Setup the TSDB
  1. Give it a name
  2. Depending how far into the future you need to run the model, maximum is 18.
  3. Select a sample file from the data folder
  4. HRRR uses UTC time
  5. Select the projection of the model network
  6. If you need to crop the data, check this option, and the easiest way to do it is to zoom to the area in the GeoPlan, TSDB will automatically pick up the coordinates.
  7. The conversion for imperial unit, and time interval is 1hr
  8. If you are using dataloader, setup the update schedule. It depends on how often you run the forecast simulation.
  1. Review the results
  2. Open the network
  3. Turn on the radar cell
  1. Drag the TSDB into the GeoPlan
  2. Graph the data to get some sense of the rainfall events.
  1. Review the rainfall event
  1. Select a forecast
  2. Use arrow key to move through the forecast
  3. See the rainfall in the GeoPlan

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store