This article is also available as a podcast in more than 20 languages. Click the ⚙️ Settings icon on YouTube, then choose Audio Track and Subtitles to watch it in your preferred language.
Can we really trust the results from our microbiology lab?
It’s a question many lab managers ask themselves.
In theory, yes. In labs, we have many safeguards: positive controls, negative controls… everything to secure daily analyses.
But there is another tool, often underestimated and yet essential: interlaboratory comparison, and more specifically proficiency testing in microbiology.
To better understand how these tests work, we spoke with Abdelkader Boubetra, Scientific and Technical Manager at the BIPEA.
Spoiler: these tests are probably one of the best ways to check the reliability of your results… and to truly trust your lab.
Microbiology proficiency testing: what is it for and who is it for?
Hello Abdelkader, can you introduce yourself?
I’m Abdelkader Boubetra, Scientific and Technical Manager at the BIPEA for about ten years. I have a background in microbiology laboratories. I am also an evaluator for different standards, including ISO 17025, and I chair the technical committee for validation of alternative methods at AFNOR Certification.
We sometimes hear “interlaboratory comparison” and “proficiency testing”. Is it the same thing?
Yes, proficiency testing is a type of interlaboratory testing. Interlaboratory studies can have several goals: assign a value to a reference material, evaluate the performance of a method, or evaluate the performance of a laboratory. When we evaluate a laboratory, we call it proficiency testing.
What is proficiency testing?
It is a tool that allows a laboratory to check the validity of its results by comparing them with results from other laboratories, and with a reference value.
What is it used for?
It helps a laboratory know if it produces reliable results. It also allows the lab to compare itself with others and assess its performance.
Who is it for?
It is for all microbiology laboratories, whether accredited or not. This includes food, pharmaceutical, cosmetic, environmental and agronomy laboratories.
In fact, many participants are not accredited. They use these tests to compare themselves with others and to evaluate the reliability of their results.
How do proficiency testing work in microbiology?
In practice, what happens when you join a proficiency test?
First, the laboratory chooses a program based on its activities (matrix and micro-organism), usually for a yearly campaign.
Before sending anything, the organizer prepares the samples with a strong validation process:
- homogeneity: all laboratories must receive identical samples,
- stability: the micro-organism must remain at a constant level during the whole test, including transport.
The samples are then sent to all participating laboratories.
How are the analyses performed in the laboratory?
Once the samples are received, they must be analyzed exactly like routine samples, without any special treatment. This is a key point: the goal is to evaluate the real performance of the laboratory.
Labs usually have 2 to 3 weeks to perform the analyses. Depending on the program, it can be:
- quantitative tests (microbial counts),
- or qualitative tests (detected / not detected on several samples).
How are the results used?
After the analyses, results are entered into a web portal and processed statistically.
Each laboratory then receives a detailed report to see how it compares with other participants and with a reference value, and to identify any deviations.
What is the difference between qualitative and quantitative tests?
In quantitative testing, the lab reports a numerical result (for example a microbial count). A robust average is calculated from all participants’ results, and a z-score is assigned to each laboratory to evaluate performance.
In qualitative testing, the approach is different. Several samples are sent, some positive and some negative. The lab must answer “detected” or “not detected”. Performance is then evaluated through sensitivity, specificity, and overall accuracy.
Accreditation, best practices and tips to succeed in proficiency testing
What happens if the results are not compliant?
A non-compliant result does not automatically mean a loss of accreditation. It depends on the context.
If the laboratory is already accredited, the main point is to understand whether the deviation is isolated or recurrent. In this case, the lab should open an internal non-conformity and perform a root cause analysis (often using the 5M method).
The goal is to identify the source of the issue and implement corrective and preventive actions.
However, for an initial accreditation or an extension of scope, unsatisfactory proficiency testing results can delay or block the accreditation process.
Can laboratories exchange results before submission?
No, this is not allowed. Systems are in place to prevent collusion: participant anonymity, statistical checks, etc. In practice, this is very rare.
Are there proficiency tests for all microorganisms and all matrices?
Proficiency tests exist for most microorganisms of interest, especially those covered by accreditation standards and routine laboratory practices.
However, it is impossible to cover all matrices. Organizers therefore provide a wide range of representative matrices (meat, dairy products, juices, environmental samples, etc.), aiming to be as close as possible to real testing conditions.
The offer also evolves with laboratory needs and current issues, for example with the development of environmental monitoring tests or emerging topics such as cereulide toxin in milk powders.
What advice would you give to a laboratory starting proficiency testing?
The key point is to treat the sample exactly like a routine sample. Do not adapt or optimize the process specifically for the test. The goal is to reflect the real day-to-day performance of the laboratory.
We would like to thank Abdelkader Boubetra for answering all our questions.
If you have any questions about interlaboratory testing, feel free to ask in the comments. We will do our best to answer them.
BIPEA overview
The BIPEA is an association created in 1970. Today, it offers more than 220 interlaboratory testing programs across various fields: food, environment, cosmetics, beverages, and even pharmaceuticals.
With around 4,000 participating laboratories in over 120 countries, BIPEA is a major player in proficiency testing at the international level.
Hello,
Looking for a PT for our Microbial laboratory testing. We perform USP and AOAC analysis in food, OTC and dietary supplements.
Hello Javier,
Do not hesitate to contact BIPEA, they probably have a solution for you.