Benchmarking

Benchmarking is a means of comparing the University's performance or standards, or both, with those of its peers.Ìý

Benchmarking aims to:

  • monitor relative performance
  • identify gaps
  • seek fresh approaches to bring about improvements
  • set goals
  • establish priorities for change and resource allocation, and
  • follow through with change processes based on empirical evidence

It can be about broad University-wide issues or specific matters affecting only one area; it can be:

  • strategic (addressing priority issues), or
  • cyclical (addressing a number of areas on a regular basis), or
  • ad hoc (taking advantage of an opportunity)

Benchmarking projects can be as simple as a desktop survey of relevant websites, or may involve a formal request for information and/or an agreement with another institution.

Whatever its scope or subject matter, benchmarking is an important element of the University's quality assurance cycle.

Benchmarking attempts to answer the following questions:

  • How do the standards we have set ourselves compare to our peers?
  • How does our performance measure against the outcomes of national and comparator institutions?
  • How can we adapt good practice examples from other institutions to our own organisation?

  • Why benchmark?

    Benchmarking allows the University to:

    • identify and monitor standards and performance in order to improve University outcomes, processes and practices
    • discover new ideas for achieving the University's 'core objectives' as outlined in itsÌýStrategic Plan
    • provide an evidence-based framework for change and improvement
    • inform planning and goal setting
    • improve decision-making through referencing comparative data
    • bring an external focus to internal activities

The University encourages benchmarking with comparator institutions within Australia and overseas as a method of improving performance and assuring standards.

While there is no prescribed methodology for conducting benchmarking exercises, the University expects staff to comply with the following benchmarking principles and code of conduct.

  • Core principles

    Benchmarking projects undertaken by Faculties and Divisions of the University will:

    • support the University's mission, values and strategic priorities
    • be characterised by a commitment to: learning from best practice; implementation of potential improvements arising from the findings of benchmarking projects; and sharing of good practices once projects are completed
    • be balanced in terms of the value received compared to costs involved in undertaking the projects
    • have the approval of the relevant manager or unit head

  • Code of conduct

    The following should be taken into account when undertaking benchmarking projects where a request for information is involved:

    Confidentiality: All benchmarking exchanges should be treated as confidential and publication and external communication of findings should not proceed without the permission of all partners involved in the project.

    Use: Benchmarking information should not be used for other than the express purpose for which it was obtained, prior consent should be obtained from all participating partner.

    Exchange: The type or level of information exchanged should be comparable between the benchmarking partners.

    Agreement:ÌýIf a benchmarking agreement is entered into, issues about confidentiality, use and the type and level of information to be exchanged should be included in the agreement.

  • Authorities and responsibilities
    • Approvals and management responsibilities should be assigned in accordance with the normal University organisation structure and reporting relationships
    • Routine management practices must apply to any significant project undertaken

  • Project initiation
    • The benchmarking reports repositoryÌýmust be checked prior to commencing a project to ascertain whether similar projects have or are already being undertaken.
    • Benchmarking projects involving a formal request for information from another institution must be approved by the relevant manager or unit head. This can be a Head of School, a General Manager/Director, an Executive Dean, a Deputy Vice-Chancellor or Vice-President, or, in the case of any large-scale University-wide benchmarking, may be the Vice-Chancellor.
    • If the scope of the project affects more than one area, then consultation and agreement between the areas impacted are essential prior to the project’s commencement.
    • Special care must be undertaken when projects require that the University's corporate data be shared with other institutions: in this case the relevant data custodian must be contacted and it will be his/her responsibility to ensure that appropriate approvals for the data transfer are obtained from senior management.

  • Project management
    • The responsibility for running the project will be with the unit manager under whose authority the project was approved or his/her delegate.
    • Contact with partner organisations will normally be through the unit manager taking responsibility for the project, unless delegated by him/her. When institutional support is needed for a project to proceed with particular partners, then the responsible manager must contact the relevant Deputy Vice-Chancellor or Vice-President.
    • Written agreements with other institutions and organisations with which projects are undertaken must be entered into in line with theÌýcontract management frameworkÌýand signed in accordance with the formal delegations of the University.
    • The University expects that benchmarking projects will be funded by the area that initiates, manages and accepts responsibility for the project. If central funds are required such as might be the case for large projects, then a submission must be made through the planning and budgeting process. If a case for special funding is appropriate and the timeframe does not permit submissions through the planning and budgeting process, then the unit manager must approach the relevant Deputy Vice-Chancellor or Vice-President in the first instance.
    • When confidentiality considerations allow, benchmarking project reports should be lodged with the Learning and Quality Support Unit as soon as possible after the completion of the project so that they can be recorded in theÌýbenchmarking reports repository
    • Each year, a summary report on the benchmarking projects undertaken by the Faculties must be submitted to the Deputy Vice-Chancellor and Vice-President (Academic) as part of the Faculty Performance Report.

  • Integration with QA systems
    • Benchmarking projects are most successful when they are integrated with other initiatives and processes designed to improve outcomes within the University.
    • The University expects that projects, findings and implementation plans will be embedded into Divisional and Faculty operational and business plans.

  • Framework oversight
    • Overall authority for the maintenance of the Benchmarking Framework rests with the Deputy Vice-Chancellor and Vice-President (Academic).
    • However management accountability for the framework is with the Pro-Vice Chancellor (Student Learning).
    • Responsibility for all operational tasks related to the framework rests with Learning and Quality Support.

The University encourages benchmarking not only with comparator institutions within Australia but also with institutions overseas.

  • Selection criteria for international benchmarking partners

    The current criteria for selection of the University's international benchmarking partners are as follows:

    • Universities with which the University of 911±¬ÁÏÍø has a Memorandum of Understanding (MOU) or other agreement, preferably including a reference to benchmarking
    • Universities which have English as a primary language
    • Universities which are research intensive
    • Universities which are comprehensive, preferably including medicine
    • Universities which are of comparable size to the University of 911±¬ÁÏÍø

  • International benchmarking partners

    In July 2008, the University of 911±¬ÁÏÍø and the University of Canterbury (New Zealand) entered into a Memorandum of Understanding to facilitate collaboration between the two universities. This included agreement to engage in an ongoing benchmarking relationship and an initial series of benchmarking projects were agreed.

    The University sees the relationship that has been developed with the University of Canterbury as a pilot of an international benchmarking approach for the University, with the emphasis being a qualitative one. A series of projects have been initiated around:

    • student experience
    • performance reporting
    • sustainability, and
    • Faculty of Sciences assessment practices

    These projects are seen as pilots, providing a template for application to collaborations with other disciplines and other universities and are all ongoing, with continuing communications between relevant staff.

    During 2011, the Quality Enhancement Committee agreed to a broad approach which includes active initiation of informal benchmarking opportunities and reporting best practice, and the development of specific benchmarking guidelines to facilitate an increase in faculty and school benchmarking initiatives.

    It was also agreed that a second benchmarking partnership be initiated with one of the Universities identified by the Quality Enhancement Committee for this purpose.

International benchmarking measures

The tables below show the indicators, measures and associated data definitions for research, learning and teaching, and financial performance.

  • Research
    Indicator Measure Data definition
    Research Refereed journal articles per Academic Staff FTE per broad discipline The number of refereed journal articles per Academic Staff full-time equivalent, broken down by the following fields (these fields are used in the Shanghai Jiao Tong University (SJTU) rankings):
    • Natural Sciences and Mathematics
    • Engineering/Technology and Computer Sciences
    • Life and Agricultural Sciences
    • Clinical Medicine and Pharmacy
    • Social Sciences
    Research Activity Ratio of research revenue to total Income from research activities as a % of total activities (excluding controlled entities).
    Research Training Activity Ratio of the number of higher degree by research students to total Number of higher degree by research (PhD and Masters) enrolments as a % of total higher education level student enrolment numbers.

  • Learning and teaching
    Indicator Measure Data definition
    Graduate Satisfaction %Ìýof graduates satisfied with their course experience Percentage of graduates satisfied with their course experience overall (equivalent for each partner of the Graduate Careers Australia Course Experience Questionnaire).
    Employer Satisfaction %Ìýof graduates employed Percentage of graduates employed of those available for work in the year after graduation (equivalent for each partner of the Graduate Careers Australia Graduate Destination Survey).
    Learning Performance Undergraduate retention rates The number of undergraduate students retained as a % of the total from the previous year less the students that have completed.

  • Financial performance
    Indicator Measure Data definition
    Research and Teaching Support % of expenditure on the library collection Expenditure on the library collection (excluding salaries and infrastructure) as a percentage of total expenditure, excluding controlled entities.
    Salary Expenditure % of expenditure on all salaries Expenditure on all salaries as a percentage of total expenditure, excluding controlled entities.
    Government Support % of revenue from Government sources Income from all Government sources as a percentage of total expenditure, excluding controlled entities.
    Financial Health Operating Margin Operating result as a percentage of total operating revenue, excluding controlled entities.
    Financial Health Current ratio Ratio of the value of current assets to current liabilities, excluding controlled entities.
    Knowledge Transfer % of revenue from Intellectual Property (IP) The value of revenue generated from IP (including licences and patents), including controlled entities.

Although the University does not prescribe any particular approach to benchmarking, faculties and divisions must be aware of the management arrangements that apply as described inÌýmanaging benchmarking.

The benchmarking process suggested by the University follows the University's Quality AssuranceÌýPlanning and Budgeting, Implementation, ReviewÌý²¹²Ô»åÌýImprovementÌý(PIRI) system.

  • Types of benchmarking

    The University employs a number of different types of benchmarking to support its goal of continuous improvement:

    Strategic
    Ìý    		 Used to improve overall performance by examining the long-term strategies and general approaches of institutions that have succeeded in areas of strategic priority for the University.
    Performance Used to compare and monitor the performance of the University with its peers using a range of metrics including financial, research, and learning and teaching performance indicators.
    Functional Used to compare and improve functional areas in the organisation such as Human Resources or Finance.
    Process Used when the focus is on improving specific critical processes and operations.

    Benchmarking partners are sought from best practice organisations that perform similar work or deliver similar service.
    Internal Involves comparing practices and processes with other units in the University.

    The adva