Difference between revisions of "3.15 Reporting"
(Created page with "Category:3.0 Model Design This section describes the various reports generated by the model run. These reports can be used assess model performance, and can inform model...") |
|||
| (One intermediate revision by the same user not shown) | |||
| Line 1: | Line 1: | ||
[[Category:3.0 Model Design]] | [[Category:3.0 Model Design]] | ||
| − | This section describes the various reports generated by the model run. These reports can be used assess model performance | + | This section describes the various reports generated by the model run. These reports can be used to assess model performance and can inform model calibration and validation, as well as other analyses. All these reports are generated by the procedures in the '''Reports and Summaries''' group of the full model procedure sequence. The log file from the full model run is also copied to the output folder for future reference. The log file contains important information such as auxiliary model summaries, convergence statistics, and Visum-generated messages and warnings. |
<h2>DaySim</h2> | <h2>DaySim</h2> | ||
| − | The DaySim run produces multiple outputs in “DaySim” within the scenario output directory. The primary outputs are | + | The DaySim run produces multiple outputs in “DaySim” within the scenario output directory (\Output\DaySim). The primary outputs are |
*_household.tsv | *_household.tsv | ||
| Line 14: | Line 14: | ||
*_trip.tsv | *_trip.tsv | ||
| − | These files contain information about the various activities, tours, and trips generated by the Daysim activity-based model components. To make the information more interpretable by the user and also to help in the validation of the activity-based model, these outputs are summarized in a set of Excel spreadsheets. R scripts are available that run the summary as a post-process each time the model is run and update the excel spreadsheets. The | + | These files contain information about the various activities, tours, and trips generated by the Daysim activity-based model components. To make the information more interpretable by the user and also to help in the validation of the activity-based model, these outputs are summarized in a set of Excel spreadsheets. R scripts are available that run the summary as a post-process each time the model is run and update the excel spreadsheets. The '''''generate_daysim_report.py''''' Python script generates these Excel spreadsheets in the Output\DaySim\Reporting sub-directory of the scenarios folder. |
| − | The process consists of just two steps. The first creates an R script that sets the paths of various inputs required. In the second step, R is called in the batch mode | + | The process consists of just two steps. The first creates an R script that sets the paths of various inputs required. In the second step, R is called in the batch mode to run the summary script created in the first step. The output files are a set of Excel spreadsheets that have tables and charts summarizing various model simulation results. This process is described in further detail in Section 4.7 |. |
<h2>Highway Assignment</h2> | <h2>Highway Assignment</h2> | ||
| Line 22: | Line 22: | ||
Highway evaluation and analysis conducted by post-processing the loaded assignment networks is a valuable tool for modelers. Traditionally in Florida, this type of analysis has been conducted with the use of the FSUTMS HEVAL and RMSE programs. Vehicle-miles-traveled (VMT), vehicle-hours-traveled (VHT), and vehicle-hours of delay are some of the most common measures. | Highway evaluation and analysis conducted by post-processing the loaded assignment networks is a valuable tool for modelers. Traditionally in Florida, this type of analysis has been conducted with the use of the FSUTMS HEVAL and RMSE programs. Vehicle-miles-traveled (VMT), vehicle-hours-traveled (VHT), and vehicle-hours of delay are some of the most common measures. | ||
| − | A | + | A highway validation report is generated in HTML format. Highway validation statistics in HTML format are particularly easy to look at. Statistics include overall measures such as V\C ratios, VMTs and VHTs by facility types, etc. In addition, validation statistics are output at the screenline level. |
<h2>Transit Assignment</h2> | <h2>Transit Assignment</h2> | ||
| − | + | Boardings and alightings by route as well as station-level summaries are stored in their respective databases. The user can simply load the ''List layout files (.llax)'' in the '''/listings''' sub-directory to generate boarding summaries. | |
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
Latest revision as of 01:53, 13 March 2023
This section describes the various reports generated by the model run. These reports can be used to assess model performance and can inform model calibration and validation, as well as other analyses. All these reports are generated by the procedures in the Reports and Summaries group of the full model procedure sequence. The log file from the full model run is also copied to the output folder for future reference. The log file contains important information such as auxiliary model summaries, convergence statistics, and Visum-generated messages and warnings.
DaySim
The DaySim run produces multiple outputs in “DaySim” within the scenario output directory (\Output\DaySim). The primary outputs are
- _household.tsv
- _household_day.tsv
- _person.tsv
- _person_day.tsv
- _tour.tsv
- _trip.tsv
These files contain information about the various activities, tours, and trips generated by the Daysim activity-based model components. To make the information more interpretable by the user and also to help in the validation of the activity-based model, these outputs are summarized in a set of Excel spreadsheets. R scripts are available that run the summary as a post-process each time the model is run and update the excel spreadsheets. The generate_daysim_report.py Python script generates these Excel spreadsheets in the Output\DaySim\Reporting sub-directory of the scenarios folder.
The process consists of just two steps. The first creates an R script that sets the paths of various inputs required. In the second step, R is called in the batch mode to run the summary script created in the first step. The output files are a set of Excel spreadsheets that have tables and charts summarizing various model simulation results. This process is described in further detail in Section 4.7 |.
Highway Assignment
Highway evaluation and analysis conducted by post-processing the loaded assignment networks is a valuable tool for modelers. Traditionally in Florida, this type of analysis has been conducted with the use of the FSUTMS HEVAL and RMSE programs. Vehicle-miles-traveled (VMT), vehicle-hours-traveled (VHT), and vehicle-hours of delay are some of the most common measures.
A highway validation report is generated in HTML format. Highway validation statistics in HTML format are particularly easy to look at. Statistics include overall measures such as V\C ratios, VMTs and VHTs by facility types, etc. In addition, validation statistics are output at the screenline level.
Transit Assignment
Boardings and alightings by route as well as station-level summaries are stored in their respective databases. The user can simply load the List layout files (.llax) in the /listings sub-directory to generate boarding summaries.
