2017 PT Manual
2017 PT Manual
2017 PT Manual
o ci
encyTest
ingManual
Per
for
manceyoucanmeasur
e
Accur
acyyoucant
rust
Table of Contents
Proficiency Testing (PT) Manual
• Online Reports................................................... 16
1 Catalog Delivered
September: The catalog
2 Orders Completed
September–December:
3 Orders Processed
September–December:
is sent to your laboratory. Your laboratory places its order. Order quantities are reserved.
General Customer
Information
Order Confirmation
After your laboratory’s order is received, an order confirmation is sent that contains the
following information:
• Shipping address
• Billing address
• Telephone and fax number
• List of programs ordered
• List of agencies and/or consultants to whom you have requested copies of your
evaluation be sent
Review the confirmation document carefully. If you have changes, return the document
within two weeks of receipt to:
Mail: Customer Data Management
College of American Pathologists
325 Waukegan Road
Northfield, Illinois 60093-2750
Fax: 847-832-8168 (country code: 001)
Regulatory Reporting
The CAP will automatically forward results for analytes regulated for PT to the CMS for
laboratories that have provided a CLIA identification number.
To make changes to your laboratory’s analyte reporting selections (ARS), contact the CAP
at 800-323-4040 option 1 or access your report online at cap.org.
Documentation will be requested and may be faxed to 847-832-8168. An explanation of
regulatory reporting and current laboratory legislation is included in section 8.
Binders/Glossaries
To provide you with an easy way by which to store your Surveys program materials, for
every nine (9) eligible programs, one three-ring binder with tabs and custom labels will be
sent to you at no charge. There is no need to order the binders as they will be shipped
automatically upon placement of your order. Additional binders are available for purchase
through the online store.
Replacement Specimens
Kits may contain specimens for analysis. Check the contents against the kit instructions
upon receipt. If the kit is incomplete or contains broken or unlabeled specimens, contact
the CAP as soon as possible for a free replacement.
In the event that a replacement specimen is required, retain your original result form while
awaiting the arrival of the replacement specimens. The replacement specimens will be
sent in the same manner as your original specimens. When you receive the replacement
specimens, it is imperative that you complete testing as soon as possible to comply with
the original due date. Due to regulatory restrictions, a due date extension may not always
be possible. Occasionally, it may not be possible for the manufacturer to replace your
specimen(s) or kit. In this case, fill the exception code 33 bubble on the result form. A note
will appear on your evaluation report and you will not be penalized.
Because PT materials must be procured in advance of shipment, on occasion, additional
inventory is available for a nominal fee. Additional material may be purchased after the
close of the formal PT event.
To purchase these materials contact the CAP at 800-323-4040 option 1. All literature
associated with this product including the summary data will be provided. This option
does not replace routine PT.
These materials may be used for but not limited to:
• Competency assessment
• Instrument troubleshooting
• Training
• Education
• Research
PT Referral Information
Per CLIA, as published by the United States Federal Register, PT specimens must be
tested with the laboratory’s regular workload, using routine methods and testing the PT
specimens the same number of times it routinely tests patient specimens.
When handling PT specimens, laboratories must not communicate results nor share or
refer specimens for tests not on the laboratory’s menu. If referral for testing is routinely
performed for patient specimens, the practice cannot be followed for PT specimens.
Referral is considered to be movement of the
specimen from a laboratory with a CLIA identification number to another laboratory that
has a different CLIA identification number. Laboratories must ensure that personnel
do not share results or refer PT specimens for any reflex or testing outside their CLIA
identification number.
Corrections to Results
• Corrections to results can be made any time prior to the due date listed on the result
form; review your laboratory data carefully prior to submission. For results approved
online, corrections must also be made online. Faxed or mailed corrections will not be
accepted.
• To view the status of your results, go to ELSS via cap.org click on Result Form Data
Entry.
• For any testing that you do not routinely perform in your laboratory, leave all reporting
areas for that test blank, including method information. Exceptions are noted in the
Critical Reporting Information section of the kit instructions or on the result form. Note:
A penalty will not be applied for blank responses in the case of educational challenges,
challenges not formally graded, or the proper use of exception codes.
Evaluations
Evaluations are posted online and mailed approximately two to five weeks after the ship
date of the kit. This time is needed for processing data, establishing evaluation criteria, and
preparing the PS.
Customer Support
CAP Customer Contact Center Information
Regular Hours: Monday-Friday, 7:00 AM–5:30 PM CT
Extended Hours: Monday-Friday 9 PM-5:00 AM CT (email only)
In countries where the CAP has a designated distributor, directly contact your CAP
distributor if you have questions related to pricing or any other inquiry not listed above.
Your laboratory will be notified of kit shipment via CAPTRAKerSM and email. If you do not
receive your kit within 7–10 calendar days following the ship date, or if you receive an
incomplete or damaged shipment, please call the customer contact center. Requests for
replacements after the 10th calendar day cannot be accepted.
For document acknowledgment, include the appropriate email address on the first page of
your order form in the section titled “PT Shipping Contact.”
To choose not to participate in this program, participants can contact the CAP at
800-323-4040 option 1.
Program Certificates
After the completion of the program year, participating laboratories will receive a certificate
recognizing each institution’s participation in the CAP PT program and its commitment to
patient care. Certificates are signed by the CAP president and are suitable for framing.
Deficiency Response
The CAP does not require that you submit documentation for all PT deficiencies. However,
it is recommended that such documentation be retained in your laboratory. The CAP
Laboratory Accreditation Program issues a separate report, the “Proficiency Testing
Exception Summary,” that addresses deficiencies for CAP-accredited laboratories.
Instructions for response will be included with the report.
Laboratory Accidents
Incidents of personnel exposure to infectious specimens, through needle sticks,
contamination of the mucous membranes through splashes or aerosolization, or cuts from
containers, should be reported immediately to the CAP.
Limitations of PT
Due to the manufactured nature of the specimens and the logistics of shipping, PT does
not always correlate with the manner in which fresh, clinical specimens are handled. A
letter addressing these differences is included for general use by your laboratory.
Limitations of PT Letter
The College of American Pathologists (CAP) Surveys program is the largest external
quality assessment program in the world. As such, it provides an unparalleled selection
of challenges and offers the largest database in existence for interlaboratory comparison.
The CAP has accumulated significant experience in managing this type of program and is
knowledgeable in its uses and limitations.
The Surveys program, although outstanding, is not a perfect measuring device. A number
of factors limit this tool’s ability to measure laboratory accuracy. Specific limitations
include requisite use of matrix materials that may impact test systems differently than
patient specimens; the appropriateness of grouping responses according to methodology,
instrumentation, and test platforms; varying size of comparison groups with attendant
variability of statistical parameters; regulated limitations in sampling of laboratories’ testing
systems; difficulties in quantitation at the extremes of analyte concentration; and unsuitability
of certain federally-mandated evaluation limits.
Thus, a certain number of responses that are graded as unacceptable in Surveys will in
fact be acceptable, and a certain number of responses graded as acceptable will in fact be
unacceptable. Although unsuccessful or unsatisfactory Surveys performance may reflect
problems within a laboratory, it does not constitute proof of inadequate performance or an
inability to meet patient needs.
Sincerely,
Exception Codes
If your laboratory needs to report an analytical problem for an entire test or individual
specimens within a test, leave the result area blank and fill the appropriate two-digit
exception code bubble on the result form.
Exception Code Reason
11 Unable to analyze (documentation to be provided by laboratory).
22 Result is outside method/instrument reportable range.
33 Specimen determined to be unsatisfactory after contacting the CAP.
It is the laboratory’s responsibility to document the appropriate use of exception codes if
requested during a laboratory inspection. Refer to the kit instructions for more information.
Master Lists
Choose the appropriate method or instrument provided on the kit instructions or result
form.
Notify the CAP and the manufacturer if your method or instrument is not listed. If the
manufacturer of your method or instrument is not listed on the kit instructions or result
form, enter it in the “Use of Other” section at the end of the result form.
Identification master lists are provided for microbiology, blood cell identification, urine
sediment, clinical microscopy, and provider-performed microscopy. Select a code from the
appropriate master list and enter it on the result form.
For blood cell identification, urine sediment, clinical microscopy, and provider-performed
microscopy, all possible identifications are included on the master lists. Do not use the
code 010, “Other, Specify.” The use of this code will be evaluated as an unacceptable
response.
HTML Section
The CAP is implementing a more customer-friendly online interface for entering proficiency
testing (PT) results via e-LAB Solutions Suite. The enhancement provides online result
forms in an HTML format, replacing the PDF technology, but retains the design. The form
helps:
1. Reduce common clerical errors
2. Increase data accuracy
3. Approve online data efficiently
4. Search and navigate with ease
Logging In
Once you have established an online account, you will be prompted to enter your user
ID and password. This must be done every time you visit cap.org.Both members and
nonmembers utilize the same login functionality.
Opting In
When your laboratory first places an order, the laboratory director will receive an opt-in
email with a CAP Number and PIN #. The laboratory director must designate who will
be the laboratory’s site administrator. Your laboratory only has to opt in once. The opt-
in process establishes the laboratory’s online access to CAP programs through e-LAB
Solutions Suite and defines the site administrator’s responsibilities.
Requesting Access
Individualized accounts for laboratory users allow flexibility in determining access levels.
Because users are independent entities from the laboratory, users can be affiliated with
multiple laboratories and their security can be administered in a different manner at each
site.
To request access to a laboratory, go to cap.org, log in, and under the LOG IN drop-down
menu, click on e-LAB Solutions Suite. Under Quick Links, click on Request Access to
Laboratory Data and enter your laboratory’s CAP#.
Individual privileges can be accessed by clicking on My Lab Permissions.
Online Reports
When the result form due date has past, data are processed and graded according
to stringent governmental and committee criteria. Laboratory results and grading
interpretations are displayed in an individualized report accessible by clicking on
Evaluation Reports under Proficiency Testing/Quality Management. Using the filter options,
select the program and report.
The online evaluation allows the user to easily navigate the data analyte by analyte. Also,
users benefit by the inclusion of detailed images hyperlinked on the report. Laboratory
managers can access the All Analyte Scorecard, allowing them to customize the scorecard
data for their laboratory as a means of identifying deficiencies or trends in performance.
Other ancillary reports that accompany the evaluation are available online, as well, for
review and to download for future reference, including the PS, final critiques, and annual
summaries, which contain useful data and education that can be reviewed and accessed
by all users with appropriate security.
Quantitative Procedures/Rounding
All quantitative responses are evaluated based on a range of acceptability. This range is
determined using a target value and a limit. The limit will be either a fixed interval (eg, ±
5 mg/dL), a percentage of the mean (eg, ± 25%), an SD (eg, ± 3 SD), or a variable range
(eg, ± 6 mg/dL or 10%, whichever is greater). The PS included with your evaluations
the criteria used to evaluate your performance. The following sections provides specific
examples of how to calculate the range of acceptability depending upon the criteria used.
Benefit-of-the-doubt rounding is used to determine the range of acceptable results. The
upper limit of acceptability is obtained by rounding up to the next reportable result, while
the lower limit is determined by truncating.
Comparative Statistics
Quantitative Procedures
Your evaluation contains plots of the relative distance of your reported results as a
percentage of allowable deviation from the target value. The numeric digit indicates the
number of results at a plot location. The allowed deviation may be calculated as follows:
If your result is greater than the target mean:
Qualitative Procedures
For qualitative responses, consensus agreement of referee or participating laboratories is
used for evaluation. Generally, 80% agreement is required.
Continuing Education
(CME)
Continuing Medical Education (CME) Category 1
The CAP is accredited by the Accreditation Council for Continuing Medical Education
(ACCME) to provide continuing medical education for physicians.
The CAP designates these educational activities for a maximum of the stated number of
AMA PRA Category 1 Credits™. Physicians should only claim credits commensurate with
the extent of their participation in the activity.
The American Medical Association has determined that physicians not licensed in the US
who participate in these CME activities are eligible for AMA PRA Category 1 Credit™.
See the current Surveys and Anatomic Pathology Education Programs catalog for
available CME programs.
Surveys CE Programs
Discipline Maximum CE Credits
Chemistry
Coagulation
Hematology
The number of credits are
Histology (HistoQIP)
specific to the program mailing.
Immunology
Microbiology
Therapeutic Drug Monitoring/Endocrinology Go to cap.org for
up-to-date activity listings.
Toxicology
Transfusion Medicine
Reproductive Medicine
CE for Cytotechnologists
Cytotechnologists may apply the credits from the gynecologic and nongynecologic (FNA,
FNAG, NGC, and TICP) programs toward the required educational activities for the
American Society for Cytopathology (ASC) Continuing Education Credit Program.
Discipline-Specific Reporting
Information
Hematology
To report your blood cell identification, select the best identification code from the
Hematology Blood Cell Identification Master List provided in the kit instructions. For further
description of the Hematology Blood Cell Identification Master List choices, refer to the
Blood Cell Identification section of the current CAP Hematology and Clinical Microscopy
Glossary, which can be accessed at cap.org.
If results are reported for both blood cell identification and auto differentials, the blood cell
identification will be reported to CMS.
The Hematology Blood Cell Identification Master List choice, “Immature cell or abnormal
cell, would refer for identification,” must be reserved for cells you rarely encounter and are
unable to specifically identify. Grading of this response will follow the guidelines set forth in
the July 26, 1993, Federal Register Notice.
Coagulation
For plasma-based coagulation testing [prothrombin time (PT), activated partial
thromboplastin (APTT), Fibrinogen], an instrument and reagent code are required for
proper evaluation. Participants enrolled in whole blood testing for PT need only indicate an
instrument (if requested) and their results. For all prothrombin time modules, reporting of
international normalized ratio (INR) results is optional. Plasma-based and whole blood INR
are evaluated.
Urinalysis
There are separate urinalysis and specific gravity method and instrument master lists in
the kit instructions. To ensure an accurate peer group evaluation of your results, it is critical
to provide accurate method and instrument information.
A specific list of reporting options is provided for each urinalysis procedure. It is not
feasible to provide a list of reporting choices specific for every possible dipstick being
marketed to laboratories. Subsequently, the result ranges listed may not exactly correlate
with the ranges used with your instrument/dipstick. In these few cases, choose the range
that most closely matches your intended result.
Microbiology
Where appropriate, a clinical diagnosis, age, and source are listed to simulate a true
clinical situation and to allow laboratory personnel to select appropriate media or methods
for processing these specimens. However, as the pathogenic bacteria present in any of
these specimens may be isolated from multiple sources of the body, all participants should
attempt identification of the organisms present in all these specimens.
Per the Federal Register, a Survey must grade a laboratory’s ability to distinguish between
a pathogen and a contaminant. Culture challenges will be designated in the instructions
to be handled as “identify principal pathogen” or “identify all organisms” challenges.
Participants must report in this manner even when this differs from their laboratory’s
routine practice. For example, a urine specimen contains Klebsiella pneumoniae and
Staphylococcus epidermidis. If the instructions indicate to “Identify all organisms,” both
organisms should be reported. If the instructions indicate to “identify principal pathogen,”
only the Klebsiella pneumoniae should be reported. If the Staphylococcus epidermidis is
reported, it would be penalized.
Specimen results will be evaluated if 80% or more of the participant laboratories agree on
the identification of the test organism(s) to genus or to genus and species. In the absence
of participant consensus, referee laboratories will be used.
The CLIA regulations state that a laboratory must perform a minimum of five specimens in
each testing event for the subspecialty of bacteriology. The five challenges can include a
combination of the following specimens:
• Bacterial antigen detection
• Bacterial identification (culture)
• Gram stain
• Antimicrobial susceptibility
2017 Proficiency Testing Manual College of American Pathologists 22
Discipline-Specific Reporting Information
Procedures assayed with waived methodologies will not count toward the five-challenge
minimum. The laboratory is responsible for maintaining the five specimens per testing
event for its remaining nonwaived tests in the subspecialty when a test is waived by the
Food and Drug Administration midyear.
PS
In addition to your evaluation, each laboratory receives a PS for that mailing that lists
results from all participants for each analyte grouped by the methodology. This report
provides valuable information to the participant in the form of comparative data and
education activities.
Program Update
This section of the participant summary contains information about evaluation criteria
in use for that mailing. It also highlights important method, manufacturer, and specimen
information that pertains to that mailing.
Quantitative Data
The participant summary provides the statistical data needed to review your PT
results. The report lists the mean, SD, and CV for peer groups consisting of 10 or more
laboratories.
Qualitative Data
Qualitative data evaluation is based on consensus of participant and/or referee responses.
The PS lists the participant responses along with the percentage reporting that response.
Where available, referee data is also included. This practice provides higher-quality,
evaluated challenges to our participants.
Quantitative Results
If you perform a test and there are fewer than nine other laboratories reporting results for
that test, your result will not be evaluated. You can determine how well you performed
compared to all participants who reported results by using the “all instrument method” data
presented in the PS(if provided). For example, you perform hemoglobin analysis using
the Coulter LH500. There are an insufficient number of results to form a peer group (<10);
therefore, your results are not graded. Note that in the PS there is an all-instrument mean,
standard deviation, and coefficient of variation, which can be used as a reference value.
By applying the published CMS evaluation limits (±7%) to this mean, you can determine
how well you performed compared to this reference value. For example:
Your result: 13.8 g/dL
All Instrument Mean: 13.77 g/dL
Range of Acceptability: 12.8–14.8 g/dL
In this example, your result would be considered within range when compared to the all-
instrument mean. Document this self-assessment on your evaluation. When you perform
this self-assessment, any unacceptable result should be documented and investigated and
corrective action should be taken as would be done for formally evaluated results. This
same technique can be used when only a median, low, and high value are reported for an
analyte.
Qualitative Results
If a qualitative result is not evaluated due to lack of referee or participant consensus, you
can still evaluate how well your laboratory’s result agreed with the correct response by
using the data in the PS. For example, one of the Gram stain challenges could not be
graded due to lack of participant consensus (77% reported gram-negative, 23% reported
gram-positive). The PS indicates that the organism was Pseudomonas aeruginosa, a
gram-negative rod/bacilli. Compare your result with the correct result. Investigate and
document any corrective action taken. Review the educational critique accompanying the
result for helpful suggestions on laboratory technique.
PT specimens must be tested with the regular patient workload by personnel who routinely
perform testing. Your laboratory’s routine testing methods must be used. The individual
testing the specimens and the laboratory director must attest to the routine integration of
specimens using a form provided by the PT program. Laboratories that perform tests on
PT specimens must not engage in interlaboratory communications pertaining to the results
of PT specimen(s) until after the date by which the laboratory must report PT results to the
program for the testing event in which the specimens were sent. Laboratories with multiple
testing sites or separate locations must not participate in communications or discussions
concerning PT specimen results until after the date by which the laboratory must report PT
results to the program. Your laboratory must also maintain a copy of all records, including
the form used to record the PT results (including the attestation signatures), for a minimum
of two years.
Your laboratory must successfully participate in a PT program approved by CMS.
“Unsuccessful proficiency testing performance” is a “condition level” deficiency and may
result in laboratory sanctions such as suspension of the CLIA certificate and Medicare
payments for the specialty, subspecialty, and analyte involved. Failure to achieve a
satisfactory overall testing event performance for two consecutive testing events or two out
of three consecutive testing events is considered unsuccessful performance.
Procedures assayed with waived methodologies will not count toward the five-challenge
minimum.
Failure to attain an overall testing event score of at least 80% is unsatisfactory
performance for analytes in all specialties and subspecialties except ABO group, D(Rh)
typing, and compatibility testing for which 100% is required.
Failure to return PT results for a testing event is unsatisfactory performance and will result
in a score of “0.” For any unsatisfactory testing event for reasons other than failure to
participate, your laboratory must undertake appropriate training and employ the technical
assistance necessary to correct the problem. All remedial action must be documented
and such documentation kept for two years at your laboratory for possible reference
by inspection and accreditation teams. As part of these regulations, criteria have been
established by which a PT provider’s program may be evaluated for approval by HHS. The
CAP has made every effort to ensure that the Surveys program has met the requirements
set forth by the February 28, 1992, Final Rule.
If you have any questions regarding the automatic transfer of results to CMS or your
performance summaries, contact the CAP at 800-323-4040 option 1.
• Challenges were not graded, using reason codes that are not reported on the
scorecard
• The method reported for the analyte is waived by the CMS
• No results were reported
8. Cumulative Performance Interpretation: indicates successful (≥80%) or
unsuccessful (<80%) performance for each analyte and for the specialty/subspecialty.
For ABO group, D (Rho) type, and compatibility testing, a score of 100% is required. A
<1> symbol denotes that your performance is successful; however, because you had
less than 80% on the previous mailing, you are still at risk to be unsuccessful for the
next mailing. A <2> denotes you are currently successful but at risk for the next two
mailings as you were unsatisfactory for this mailing. These codes are applicable to
both the analyte and the overall specialty/subspecialty scores. A <3> denotes currently
unsuccessful performance. A <4> denotes that scorecard performance is pending a
future evaluation or may not be applicable due to discontinued testing or the use of a
waived method.