Editorial

European Examination in Core Cardiology (APSC Exit Examination)

Disclosure: JWCT is on the Editorial Board of the Journal of Asian Pacific Society of Cardiology; this did not influence peer review. JWCT has received honoraria from AstraZeneca, Bayer, Amgen, Medtronic, Abbott Vascular, Biosensors, Alvimedica, Boehringer Ingelheim and Pfizer; research and educational grants from Medtronic, Biosensors, Biotronik, Philips, Amgen, AstraZeneca, Roche, Otsuka, Terumo and Abbott Vascular; and consulting fees from Elixir, CSL Behring and Radcliffe Publishing. JY is an Associate Editor of the Journal of Asian Pacific Society of Cardiology; this did not influence peer review. KKY is Editor-in-Chief of the Journal of Asian Pacific Society of Cardiology; this did not influence peer review. KKY has received institutional research funding from Medtronic, Boston Scientific, Amgen, AstraZeneca and Shockwave Medical; consulting or honoraria fees from Medtronic, Boston Scientific, Abbott Vascular, Amgen, Bayer and Novartis; and speaker or proctor fees from Abbott Vascular, Boston Scientific, Medtronic, Philips, Shockwave Medical, Alvimedica, Menarini, AstraZeneca, Amgen and Bayer. DPC is a Deputy Editor of the Journal of Asian Pacific Society of Cardiology; this did not influence peer review. DPC has received consulting fees from the Asian Pacific Society of Cardiology (APSC); support for travel to meetings for the study or otherwise from the APSC; grants/grants pending from Roche Diagnostics and AstraZeneca; and payment for the development of educational presentations, including service on speakers’ bureaus, from AstraZeneca. AYYF is an Associate Editor and NNQ and WAM are on the Editorial Board of the Journal of Asian Pacific Society of Cardiology; this did not influence peer review. All other authors have no conflicts of interest to declare.

Received:

Accepted:

Published online:

Acknowledgements: The authors thank Ivan Olegario for medical writing support.

Correspondence Details: Jack Wei Chieh Tan, Department of Cardiology, National Heart Centre, 5 Hospital Drive, Singapore 169609. E: jack.tan.w.c@singhealth.com.sg

Open Access:

This work is open access under the CC-BY-NC 4.0 License which allows users to copy, redistribute and make derivative works for non-commercial purposes, provided the original work is cited correctly.

The European Examination in Core Cardiology (EECC), known as the European Examination in General Cardiology prior to 2020, is a joint venture between the European Society of Cardiology (ESC), the Union of European Medical Specialists Cardiology Section and participating national cardiac societies. The EECC is also supported by independent academic oversight.1

In 2012, the ESC launched the first pilot examination with 80 volunteers from Ireland, the Netherlands, Portugal, Spain and UK; since 2013, there have been annual sittings of the European Examination in General Cardiology/EECC with the participation of the ESC National Cardiac Societies network.

The purpose of the examination is to provide a broad, balanced and up-to-date test of the core knowledge required by cardiology specialty trainees for independent practice.1

The examination assesses knowledge from current evidence-based guidelines and published research, and has recently been aligned with the ESC Core Curriculum for the Cardiologist, published in 2020.2 The examination is intended to complement workplace-based assessments as part of a comprehensive cardiology training programme, as well as to facilitate progressive improvement and harmonisation of cardiology training and clinical practice.1 Participating cardiac national societies use the EECC in different ways to support the medical education of cardiology trainees in their country. Trainees are advised to take the EECC once they have completed core training, so that unsuccessful candidates may have the opportunity to re-sit the examination before the end of their overall training.1

The Asian Pacific Society of Cardiology (APSC) is an umbrella organisation representing 22 cardiology societies in the Asia–Pacific region.3 Due to the heterogeneity of the region, the completion of cardiology training and entry into continuous professional development varies across the region. There is no uniform cardiology subspecialty training, and no uniform exit examination to assess the core cardiology knowledge of trainees.

Gantt Chart of the Pilot European Examination in Core Cardiology (Asian Pacific Society of Cardiology Exit Examinations)

Article image

In 2020, the APSC approached the ESC to pilot the EECC, and to determine how the APSC could participate and support the deployment of the examination and its administration in the region for cardiac societies that are part of the APSC but may not be able to join the EECC on their own. Examinees from member countries of the APSC are nominated to take the same EECC examination as their Western counterparts. The examinees are advised to take the examination anytime within 6 months before to 6 months after their own country’s general cardiology exit examination.

In this article we describe the development and administration of the pilot EECC (APSC Exit Examination). The examination results of the APSC examinees over the first 3 years of implementation will be published in a future paper. This analysis is intended to benchmark the knowledge of cardiology trainees as part of the evaluation of the quality of training in the region and to guide future plans for the improvement and harmonisation of cardiology training.

Methodology

Examination Development

Every year, the writing of the EECC (APSC Exit Examination) starts with question writing meetings in August of the preceding year (August 2019 for the first pilot examination) and the following January (Figure 1). The examination questions are written and edited by groups of cardiologists representing their national cardiology societies and the APSC, all of whom come from all subspecialties within cardiology. The examination questions test knowledge that is mapped to the ESC core curriculum, in line with current guidelines and published clinical studies. The questions cover the following four sections:

  • imaging and valvular heart disease;
  • rhythm disorders;
  • coronary artery disease, acute cardiovascular care, prevention, rehabilitation and sports; and
  • heart failure and cardiac patients in other settings.

Each question comprises a short clinical scenario and a single multiple-choice question with five possible answers shown in alphabetical order (Table 1).4

A board meeting is held in January of the examination year to review the policies and procedures for the examination and, in February, cardiologists select 120 questions across all 62 topics of the core curriculum (30 questions from each examination section).4 Seventy per cent of the selected questions are text only and 30% contain a still image or short video clip.

After all 120 questions have been chosen, a standard-setting group reviews each question using a modified Angoff method to estimate the probability that a candidate who would just pass the examination will select the correct answer, and these assessments are used to inform the final pass mark.5 In May, all questions for the final examination are reviewed by the examination board chair and the chair of the standard-setting group to ensure that there are no errors before the examination is held in June.4

Examination Delivery and Pass Mark Determination

Countries participating in the EECC register in September in the year preceding the examination and need to start registering their candidates in November. The ESC manages all confirmations and instructions to the candidates up to the delivery, in June, of the 3-h online examination with remote proctoring.

After the examination, the performance of each question is reviewed. Questions where <30% or >90% of candidates answered correctly, or those where there was a negative correlation with candidates’ performance in the overall examination are reviewed by representatives of participating national societies. This is to ensure that the answer key was correct, that the question was not misleading and that the question tested an important point of cardiology knowledge.4 Any question that does not pass this assessment is excluded from the examination (historically, the number of questions excluded has been very low due to the robust quality assurance methods used in question development).

The marks are then given to the independent psychometrician and the EECC board to determine the pass mark. Using the Hofstee method, the pass mark is expected to fall in the rectangle formed on a graph of pass rate (percentage of candidates passing the examination) against pass mark (the percentage of questions answered correctly for a candidate to pass), bounded by the expected pass rates of 75–95%, and 2SDs around the mean expected pass mark determined by the standard-setting group.6 The final pass mark is the x-coordinate at the intersection between the diagonal across the rectangle and the plot of the candidates’ performance (Figure 2).

Example Question

Article image

Schematic Diagram of the Hofstee Method of Determining the Exit Examination Pass Mark

Article image

Conclusion

The APSC pilot with the EECC is an opportunity to evaluate the core cardiology knowledge of trainees as part of the evaluation of the quality of training in the Asia–Pacific region, and is a starting point in harmonising the practice of evidence-based clinical cardiology among APSC member countries. The EECC examination is conducted to international standards and established standard-setting methodologies to ensure the validity of results in testing core cardiology knowledge. The methodology described in this article may be used for reference by future examinees, as well as cardiology trainers in the Asia–Pacific region.

References

  1. European Society of Cardiology. European exam in core cardiology (EECC). 2020.
    https://www.escardio.org/Education/Career-Development/European-Exam-in-Core-Cardiology-(EECC) (accessed 22 February 2022).
  2. European Society of Cardiology. ESC curricula. 2020. https://www.escardio.org/Education/esc-and-subspecialty-core-curricula#:~:text=The%202020%20Core%20Curriculum%20for,Community%2C%20trainees%2C%20and%20patients (accessed 22 February 2022).
  3. Asian Pacific Society of Cardiology. About APSC. 2022. https://www.apscardio.org/about/index.html (accessed 22 February 2022).
  4. Plummer C, Bowater S, Hall J, et al. Behind the scenes of the European examination in general cardiology. Heart 2019;105:889–90.
    Crossref | PubMed
  5. Angoff WH. Scales, norms and equivalent scores. In: Thorndike RL, Angoff WH, Lindquist EF; American Council on Education, eds. Educational Measurement. 2nd ed. Washington, DC: American Council on Education; 1971;508–600.
  6. Hofstee WKB. The case for compromise in educational selection and grading. In: Anderson SB, Helmick JS, eds.
    On Educational Testing. Washington, DC: Jossey-Bass; 1983;109–2.
  7. Ibanez B, James S, Agewall S, et al. 2017 ESC guidelines for the management of acute myocardial infarction in patients presenting with ST-segment elevation: the Task Force for the Management of Acute Myocardial Infarction in Patients Presenting with ST-Segment Elevation of the European Society of Cardiology (ESC). Eur Heart J 2018;39:119–177.
    Crossref | PubMed