RRG applications are evaluated against the two following criteria: Research Methods and Resource Management and Computational Expertise.
Research Methods (70%)
This criterion evaluates the methods proposed to achieve the objectives of the computational project and the appropriateness of the resources requested. It focuses more on assessing what research will be done with the resources requested and on the technical justification provided, than on why the research is important.
Considerations for the evaluation of this criterion include the following:
- The research problem is clearly presented.
- The overall goal and objectives of the project are well-defined and clear, and they state what the computational project is ultimately expected to achieve.
- The application presents anticipated outcomes and indicates the means by which these will be measured.
- The proposed computational project outputs (i.e., the anticipated results of the project) and impact are clearly described, are aligned to the objectives, are of relevance and are realistic and attainable.
- The proposed computational research project is likely to lead to advances in the research area.
Progress Over the Past Year
- The application shows achievements, outcomes and/or evidence of progress resulting from the utilization of resources provided by the Federation over the past year.
- The application describes appropriate tools, methods and approaches for addressing the research objectives. These methodologies may be community codes or models, data analysis methods, algorithmic formulations expressed in user-developed scripts or tools, as well as trials or test implementations.
Resource Request Justification
- When applicable, a justification for low utilization (or lack thereof) of an existing allocation is provided and deemed reasonable.
- The amount of resources requested is deemed appropriate to achieve the project objectives, and the technical justification provided is excellent.
- The application describes necessary and sufficient computational experiments to answer the research questions posed.
Resource Management and Computational Expertise (30%)
This criterion evaluates the capacity of the research team as a whole to manage the project and make efficient use of the resources requested. It also assesses the overall feasibility of the computational project based on the research and computational expertise of the team.
The team includes the Principal Investigator (PI) and, if applicable, Co-PIs and any Highly Qualified Personnel (HQP) actively participating in the computational project.
HQP includes all research personnel involved in the applicant’s computational project, whether from academia, government or industry. The number of HQP using resources provided by the Federation directly is expected to be appropriate to the scope of the project.
The nature, breadth and depth of the applicants’ (PI and, if applicable, Co-PIs) experiences and contributions should be assessed in the context of their career stages. Committee members must not impart, refer to or consider information about the applicants that does not appear in the application and the provided Canadian Common CV (CCV).
It is not mandatory that an application includes Co-PIs or HQP to obtain the full Resource Management score. However, the proposed research must be achievable by the listed team members, particularly if it is only one PI and/or if there is no funding available. It is expected that applications asking for large amounts of resources will have funding to justify the request.
The level of detail needed to get a high score for the Resource Management criterion is a function of team size and resource ask.
Considerations of this review criterion include the following:
- Funding is available for the research project to justify the request for computational resources; when funding is not available, a reasonable explanation for how the compute resources will be utilized is provided.
Computational Expertise of the Team
- The team shows sufficient computational expertise or a training plan to make effective and efficient use of the computational resources requested.
- Information about each team member (PI, Co-PIs and HQP, when applicable) and their requested computational resources are clearly described.
- The roles and responsibilities of the PI and Co-PIs, if applicable, are clearly described with respect to making efficient use of the resources requested and are linked to the objectives of the computational project (Co-PIs contribute to the Resource Management score in accordance with their involvement).
The team demonstrates the combined expertise and experience needed to execute the computational project, i.e., deliver the proposed outputs as well as achieve the proposed contribution(s).
Return to table of contents