How to download archived NEXRAD rainfall data into ICM
source: Innovyze Support Portal
Many Cities around the United States have access to freely available high resolution radar rainfall data. In this article, we’ll have a step by step example on downloading a few months worth of radar rainfall data and see them playing in ICM.
Locate the station
ICM supports the DPR product (Instantaneous Precipitation Rate), the first thing is to find the nearest station with that data. Use the map below, we can see all the NEXRAD stations.
Radar Data Map | GIS Maps | National Centers for Environmental Information (NCEI)
Level-II and Level-III NEXRAD data include three meteorological base data quantities: reflectivity, mean radial…
- search the location of interest
- check only Level III
- click on the wrench icon
- enable the identify tool
Click on the red square to get the station information,
Make sure the station has DPR.
Order the data
To download the data for station KOKX, go to the NEXRAD data inventory page below.
NEXRAD Data Inventory Search | National Centers for Environmental Information
The National Centers for Environmental Information (NCEI) archives all of the National Weather Service Radar Data from…
click “Select by County, City, Zip Code.
select Level III rainfall data for New Jersey
Add KOKX to cart.
Go to your cart,
Unless you only need to download the data for a day or two, the bulk order option is a better choice, the simple folder structure makes it easy to automate the data processing. With this option you download all the data as one file for each day, then we can run a script to extract only the rainfall data out of the compressed file.
specify a date range and click continue.
Enter your email address so that when the data are ready for download, you will get an email with the FTP link.
Click the submit order button and wait for the email when download is ready.
Download the data
It is recommended to use a FTP client for downloading the data due to its large size and number of files. You can install WinSCP, an open source free FTP client for this task.
Copy the ftp url from the email notification of order complete
Start WinSCP, in a new session,
- paste the url into the host name box
- check the “Anonymous login”
- click Login
Open the local folder where the files will be downloaded,
in the FTP window, hit ctrl+A to select all files, then right click and download.
It will take a while to download.
Extracting DPR files
We only need the DPR files for the NEXRAD rainfall data, we will use the 7zip in command line to extract files by matching a pattern. 7zip is an open source and free file archiver tool.
Open a command window.
Win+R, then type cmd
Go to the folder where all the files are downloaded,
Then extract all the *.gz files: “C:\Program Files\7-Zip\7z.exe” x *.gz
Next we need to figure out what the DPR files look like, use 7zip to open the extracted *.gz file, then study the file name patterns, you can see, the 3rd part of the name indicates the product “DPR”.
Now we can use 7zip to extract only the files with the prefix KOKX_SDUS81_DPR* to the DPR folder, the command below extract all the files in the current folder to a folder on D drive with a prefix with DPR in it.
“C:\Program Files\7-Zip\7z.exe” x “NWS_NEXRAD_NXL3_KOKX_*.tar” -o”C:\temp\kokx\dpr” “KOKX_SDUS81_DPR*”
You should have all the files in the dpr folder now.
Setup the TSDB
Next we will load all the DPR files into a TSDB.
First, create a spatial TSDB in ICM.
As shown below, give it a name and choose a template file. You need to change the file type to (*.*) for the files to show up.
Set it up as shown below, you need to check your model’s projection and extent to setup the projection and crop coordinate bounds.
Now we can update the TSDB from the processed files.
Review the Radar Data
Click on the graph button will show a sample time series of the rainfall.
Take a note of the time of a few storms, we can then look into in the GeoPlan.
To review the radar rainfall on a map, we need to open a network. If you already have a model, just open the network. Make sure your model and your radar data are in the same projection. If they are different, make sure you set the projection conversion correctly in the TSDB settings.
To set the project of the map,
- open the network in GeoPlan
- set the coordinate system
Then we can drag the nexrad TSDB to the GeoPlan, the database window should popup and the title bar will change with the TSDB name added.
In order to view the radar data, it is helpful to turn on the radar cell boundary.
Now we should see the cell boundaries. To see the storm moving in the map,
- graph the data
- zoom in one event
- go to that date
- use cursor to move up from the row of the start of the storm, you’ll see an animation in the GeoPlan