List of criteria to assess network participation

ERA-LEARN presents a global list of criteria for network assessment based on review of international policy reports; review of international academic literature; analysis of national involvement; and analysis of agency involvement in a core set of shared ERA-NETs. Defining these criteria and testing the initial model necessitated the construction of a Questionnaire to Programme Managers for use in interviews with network project staff and a set of Instructions To the Strategic Person within the Agency in how to use the model (available for download below).

The criteria have been divided into two categories:

  • NETWORK encompassing complementarity to other funding instruments; potential national added value; the long-term perspective; financial commitment; consortium composition and the running of Joint Calls.
  • OUTPUT covering Joint Call outputs; other joint activities in the network; the learning effects and the cost-benefit ratio.

Questions

NETWORK

  • Is the network complementary to other transnational funding instruments?
  • Consider other ERA-NET (Cofund), JPI, H2020, JTI, EUREKA, EUROSTARS
  • Consider national, regional, bilateral instruments
  • Consider the goals/objectives of this initiative
  • Consider the most appropriate programme for this initiative and its time frame as a transnational activity
  • Does the network demonstrate added value?
  • Consider how the participation of the agency came about and what was the original motivation for participation
  • Consider the need for an international network
  • Consider the national strategic relevance of (thematic) focus
  • Consider the critical mass of potential clients (size, structure, dynamics dep. on topic and preferred countries for cooperation)
  • Consider if the existing national programme allows for international activities
  • Is the consortium adequate?
  • Consider if the appropriate countries are included (in sense of competence, competition or collaboration)
  • Consider if the appropriate programmes are available (if applicable)
  • Consider the governance and management structure efficiency
  • Consider the quality of consortium leadership and the cooperation between the funding agency and the coordinator / secretariat
  • Consider any difficulties or structural deficits within the consortium (composition of partners, financial)
  • Is the national implementation of the network efficient?
  • Consider if the appropriate agency is involved at national level
  • Consider how the commitment for participation was secured
  • Consider the internal workflow within the agency and the external workflow (coop with ministry)
  • Consider the resources allocated and the integration of any external resources
  • Is there adequate/ sufficient financial commitment by your organisation?
  • Is there adequate/ sufficient financial commitment by programmes in other countries ?
  • Are the joint calls operating efficiently?
    Consider the adequacy and balance of the planned budget(s) for the Call(s) (own versus partners)
  • Consider the number of funded projects and number of rejected proposals (with national participation)
  • Consider the alignment of internal programme procedures with the transnational initiative (criteria, calls, decision making, etc)
  • Consider acceptance of joint call procedures at national level
  • Consider coverage of the internationalisation aspects you want to support (projects would not have been funded nationally?)
  • Consider the efficiency of workflow, time to contract, total overhead compared to similar national or international projects
  • Consider clients' satisfaction with calls
  • Consider the transparency of the selection process
  • Is there a long-term perspective for the network ?
  • Consider the maturity of the network, its coordination (overall performance) and sustainability
  • Consider what would happen if this network was terminated

OUTPUT

  • Are the joint calls effective?
  • Consider the response of the target group
  • Consider the quality of the projects compared to the national programme
  • Are other activities launched by the network?
  • Consider impact measurement strategy, partner search facilities, trainings, technology transfer, other support measures
  • Consider own and users' satisfaction with activities
  • Is the network having an impact on national programmes and generating learning effects?
  • Consider impact on national programme design, implementation and/or international cooperation
  • Is the overall cost/benefit ratio positive?
  • Consider the results as a return from effort by staff (time and money) to run the instrument

To be included as document tiles: