Mission

Provide a forum for the discussion and debate of psychometric issues in medical assessment of undergraduates and postgraduates.

Aim

Improve understanding of the importance of psychometric analysis in the planning, setting and interpretation of medical assessment processes, including both entry into medical school and progression through postgraduate education and training.

Vision

  • Promoting excellence in the application of assessment theory and practice in medical education
  • Advancing understanding and application of psychometric techniques in assessment
  • Create a programme of dissemination and collaborative research across institutions, disciplines and programmes
  • Provide a network to promote Continuing Professional Development for those closely involved in assessment psychometrics, and share best practice

History

The Psychometrics Special Interest Group was launched a number of years ago to help focus on quality, measurement and innovation in assessment. Whilst popularly termed the ‘psychometrics’ SIG it has a much broader remit of looking at assessment policy, practice, theory and innovation – as well as psychometric/’edumetric’ methods, analysis and interpretation.

The group has grown slowly and steadily to roughly 100 members who come from a wide range of backgrounds and disciplines and involvement in assessment across a range of fields, both under- and postgraduate. The breadth of the group allows a lively mix of debate and discussion, opinion and evidence in a friendly, respectful atmosphere. For whatever question/problem is posed, there is usually someone who will answer (and an engaging discussion).

We run both face to face and online activities. The online activities run via a JISCmail discussion board, highlighting new/interesting papers and developments and broader topics of interest – and we are comfortable with members being active contributors or ‘listeners’. Face to face meetings explore a range of topics, from methods (e.g. conducting a G study, measuring and reconciling variance), topics (adaptive assessment) to newer areas of assessment (e.g. UK MLA).

How the SIG works

Overview

Name of this SIG?

Psychometrics.

What is its purpose?

To improve understanding and application of the importance of psychometric analysis in medical education, assessment innovation and quality measurement.

What events and activities does it organise?

  • A meeting 2-3 times a year
  • An online discussion group (via JISCmail)
  • The SIG intermittently runs workshops at the ASME ASM

How many members does it have?

95.

Constitution

Who Leads the SIG?

Prof Richard Fuller and Prof John Cookson.

How is the Lead decided?

Informal process.

How long do they hold this position?

Variable.

How is the SIG organised?

No formal structure – members are encouraged to contribute to the SIG where they feel comfortable – suggesting meeting topics, supporting events, discussion board activities.

How do I join this SIG?

Through Richard Fuller who is the owner of the email JISC list. Login to your individual membership account and update your interest group preferences, and email the SIG lead on psychometrics@asme.org.uk.

Is there a cap on how many people can join?

 No.

Being a member of this SIG

What can I expect from the SIG if I join?

Ability to join in online and face-to-face discussions, and post questions for others to answer. An opportunity to draw on the expertise and experience of the wider membership, network and discuss assessment problems and solutions.

What will the SIG expect from me if I join?

Treat the online discussions as confidential and respect other views.

Will it cost anything to join this SIG?

No, your ASME membership allows you to join as many SIGs as you wish. The only charge incurred is travel to the face-to–face meetings (one meeting per year is in/around London, otherwise across the country). We are trying to encourage meaningful videoconferencing to help offset costs and carbon.

What do I do if I no longer wish to be a member of this SIG?

Login to your individual membership account and update your interest group preferences, and email the SIG lead on psychometrics@asme.org.uk