Appendix I: User Manual of Program to Extract daily rainfall data

from Satellite and GFAS

I. Requirement

- Require software: Anaconda for python 3.

- Package require in python 3:
o “Numpy” for matrix manipulation (https://numpy.org/)
o “Pandas” for spreadsheet manipulation (https://pandas.pydata.org/)
o “netcdf4” for netcdf file manipulation
(https://anaconda.org/anaconda/netcdf4)
o “GDAL” for raster file manipulation (https://gdal.org/)

II. Program Installation

Install Python 3
Just install only “Anaconda python 3”, most of packages will be installed automatically.
- Search for “Anaconda python 3” in google (make sure your PC is connected to
Internet) or go to the link.
(https://www.anaconda.com/products/individual#windows).
- Download the installer file for your system
- Double click on the installer file and install the file as simple software.

Or follow the link below to install Anaconda python 3 for window.

https://docs.anaconda.com/anaconda/install/windows/

Install package in python

To install “netcdf4”, it is very simple. Just connect your computer to the Internet and run a
command on anaconda command prompt which is run as administrator. The command
to install the package can be searched in Google by just, for example, typing “install
netcdf4 in anaconda”, then the list of websites related to anaconda will appear in the

1
searching list. Then just go to that website, there will be command line to install the
package (e.g., https://anaconda.org/anaconda/netcdf4).
To run Anaconda command prompt as administrator and install “netcdf4”, follow the steps
below:
- Click on start manu and search for “Anaconda3” as in Figure 1a.
- Click on “Anaconda3”, it will drop down the option as appear the window in
Figure 1b.
- Ctrl + right click on “Anaconda Powershell Prompt (Anaconda3)”, and then
choose run as administrator as in red box in Figure 1b. Then the window of
command prompt will appear Figure 2.
- Then type the following command “conda install -c anaconda netcdf4”. The
program will look for the package in the Internet to install in computer. After it
finds the package, program will ask to confirm on the installation. We need to
type “Y” and Enter to approve the installation of the package in the computer.

a b
) )

Figure 1: Illustration on how to run “anaconda command prompt” as administrative.

2
 Figure 2: Command window as a result from running “anaconda command prompt” as
administrative.

Install GDAL in python

To install GDAL in python program, please follow the steps below:
- Run Anaconda command prompt as administrator, the command window as in
Figure 2 will appear.
- Type the command “conda create -n CFGRIB -c conda-forge python=3.7 cfgrib
xarray requests xlrd matplotlib gdal pyproj xlwt” and enter. The program will
look for the package in the Internet to install in computer. After it finds the package,
program will ask to confirm on the installation. We need to type “Y” and Enter to
approve the installation of the package in the computer.
- Check if the program is installed properly by typing command “cfgrib selfcheck”,
then the version cfgrib will show in anaconda command prompt (e.g., Found:
ecCodes v2.17.0.), then your system is ready.

3
III. Preparation of Station Information

The station information is required for the program to extract the rainfall data on the
location of each station (Figure 3). The required input station information includes station
ID: “ID”, station name: “NAME”, and station location: “LON” and “LAT”. Note that the
header of the station information table must follow the name as in Figure 3. The file name
of this station information must be named as “rainfall_stations.xls” and put it in the same
directory of this program code.

Figure 3: Format of station information for the input to the program.

4
IV. Input on options for data extraction

User need to provide the order to the program on (1) today date, and (2) number of days
back. To do this, please open file “input.txt” with any text editor, and change the options
to your intended (see Figure 4). Note that the number at the beginning of each input (i.e.,
“1.”, and “2.”) is very import for the program, please don’t change them.
(1) The desired today date is used by the program to identify the date to extract the satellite
estimation data and the date to extract the GFAS data, and then combine these data into a
continuous timeseries (see the illustration of data connection in Figure 4 as example). The
date format is as follow “dd/mm/yyyy”, two digits of day, two digits of month, and four
digits of year as seen in Figure 5. If today date is given as “None”, the program will obtain
the today date from the current date of the computer.
(2) The number of days back is the input for the program to perform data extraction based
on the number of days back as requested by user. See Figure 4 to understand this input
option. To change this option, please change the it as in Figure 5.

Figure 4: Example of the data connection between SRE and GFAS.

Figure 5: Format of input to order the program on (1) today date, (2) number of days back.

5
V. Running the code
The program needs to be run in Anaconda command prompt. Follow the steps below to
run the program in Anaconda command prompt:
- Click on start manu and search for “Anaconda3” (Figure 6a).
- Click on “Anaconda3”, it will drop down the option as appear the window in
Figure 6b.

a b
) )

Figure 6: How to start Anaconda command prompt in window.

- Click on “Anaconda Powershell Prompt (Anaconda3)”, the command window

will appear as in Figure 7.

Figure 7: Anaconda command prompt in window for running python script.

6
 - Change the directory to your script folder by type command as follow:
“cd path/to/your folder”
How to get “path/to/your folder” of your script:
o Open your script folder
o Click on the path of the folder as Figure 8 and ctl + c (to copy the path).
o Paste the “path” after the word “cd ” in the above command and then enter

Figure 8: How to copy the path of your script folder.

- Run the code by just typing “python run_code.py” and enter

- Check your output data in folder “Output”.

VI. Results from the Program

The outputs from the program will be daily rainfall data in an excel file with format ready
for conversion to dss format for inputting to HEC-HMS. See Figure 9 for the sample of the
output data. The filename of this output data is as “rainfall_sre_gfas.xls” and it is saved
in folder “Output”.

7
Figure 9: Sample of output excel sheet from the program.

8
VII. Convert rainfall data in excel format to dss format using “HEC-DSSVue 2.0.1”

After obtaining the rainfall data in excel format above, we need to convert the data to dss
format for inputting to HEC-HMS and/or HEC-RAS models. To convert the above excel
sheet (Figure 9) to dss file, please follow the steps below:
- Open the HEC-DSSVue 2.0.1 software, then the window of the software will
appear as in Figure 10.

Figure 10: The starting window of HEC-DSSVue 2.0.1 software after opening.

- Next, click on “File” and then “New”, then the software will direct you to a
directory for creating the dss file (Figure 11). The Change directory to the place
where you want to store your dss file. Type the file name for the dss file as in Figure
12. After that click “create” to create an empty dss file for storing data (red box in
Figure 12), and then click “OK” to confirm.

9
Figure 11: The starting window of HEC-DSSVue 2.0.1 when selecting “File” and “New”.

Figure 12: The window after clicking “File” and “new”.

10
- Click on “Data Entry”, then “Import”, then “Excel” as in Figure 13. Next, direct
import file to directory of excel file of the rainfall data (Figure 14), then click
“Open”. Then, the window as in Figure 15 will appear.

Figure 13: The window for clicking “Data Entry”, then “Import”, then “Excel”.

Figure 14: The window showing the way to import excel file of rainfall data.

11
 Figure 15: The window showing the way to import excel file of
rainfall data.

- Right click on row “Part A” [put cursor on number 1 (row #1) at the left-hand side],
“Pathname Part Row”, then select “Part A” as in Figure 16a.
- Repeat the above process for other Part (i.e., B, C, F…). Make sure to put the cursor
on row number at left of each Part (row #) before right-click.
- For row units (row number 5), right-click on number 5, and then choose “Units
Row” as in Figure 16b.

12
 a b
) )

Figure 16: The window showing how to select Parts (a) and unit row (b) of the data.

- Next, select date and time column by right-clicking on date column of the data
(Figure 17a). Make sure to put the cursor on the header of the column which is “A”
(red box in Figure 17a). Then select “Date-Time Column” + “Date and Time
Column”.
- Select all columns of station data by right-clicking on the white-space cell at the
corner of the window (red box at the corner in Figure 17b), then select “Select All
Data Columns” after which all the station data column will be selected. The click
“Import” to import the data to the software.

13
 a b
) )

Figure 17: The window showing how to select date and time column (a) and station columns (b).

- After importing the data to the software, the window as in Figure 18a will popup.
Next, change the data type to “PER-CUM” (red box in Figure 18a) which means
incremental precipitation (see Table 1). Then click “Import” as in Figure 18b.
- After finish importing the data, the message to close the window, then just close it.
Then the result window as in Figure 19 will appear. Finally, the dss file is ready to
used in the folder you save.

14
 Table 1: The data type input in dss file.

a
)

b
)

Figure 18: The window showing how to import date and other all the data columns.

15
Figure 19: The window showing result after importing the data to dss.

16