[en] The numeral unit spread assessment pedigree (NUSAP) system was implemented to evaluate
the quality of input parameters in a quantitative microbial risk assessment (QMRA) model
for Salmonella spp. in minced pork meat. The input parameters were grouped according to
four successive exposure pathways: (1) primary production (2) transport, holding, and slaughterhouse,
(3) postprocessing, distribution, and storage, and (4) preparation and consumption.
An inventory of 101 potential input parameters was used for building the QMRA model. The
characteristics of each parameter were defined using a standardized procedure to assess (1)
the source of information, (2) the sampling methodology and sample size, and (3) the distributional
properties of the estimate. Each parameter was scored by a panel of experts using
a pedigree matrix containing four criteria (proxy, empirical basis, method, and validation)
to assess the quality, and this was graphically represented by means of kite diagrams. The
parameters obtained significantly lower scores for the validation criterion as compared with
the other criteria. Overall strengths of parameters related to the primary production module
were significantly stronger compared to the other modules (the transport, holding, and
slaughterhouse module, the processing, distribution, and storage module, and the preparation
and consumption module). The pedigree assessment contributed to select 20 parameters,
which were subsequently introduced in the QMRA model. The NUSAP methodology
and kite diagrams are objective tools to discuss and visualize the quality of the parameters in
a structured way. These two tools can be used in the selection procedure of input parameters
for a QMRA, and can lead to a more transparent quality assurance in the QMRA.
Disciplines :
Food science
Author, co-author :
Boone, Ides
Van der Stede, Yves
Bollaerts, Kaatje
Dewulf, Jeroen
Messens, Winny
Daube, Georges ; Université de Liège - ULiège > Département de sciences des denrées alimentaires > Microbiologie des denrées alimentaires
Aerts, Marc
Mintiens, Koen
Language :
English
Title :
NUSAP Method for Evaluating the Data Quality in a Quantitative Microbial Risk Assessment Model for Salmonella in the Pork Production Chain
Publication date :
2009
Journal title :
Risk Analysis
ISSN :
0272-4332
eISSN :
1539-6924
Publisher :
Blackwell Publishing, Malden, United States - Massachusetts
Lindqvist R, Sylven S, Vagsholm I. Quantitative microbial risk assessment exemplified by Staphylococcus aureus in unripened cheese made from raw milk. International Journal of Food Microbiology, 2002 78 (1-2 155 170.
Nauta MJ. Separation of uncertainty and variability in quantitative microbial risk assessment models. International Journal of Food Microbiology, 2000 57 (1-2 9 18.
Nauta MJ, Litman S, Barker GC, Carlin F. A retail and consumer phase model for exposure assessment of Bacillus cereus. International Journal of Food Microbiology, 2003 83 (2 205 218.
Haas CN, Rose JB, Gerba CP. Quantitative Microbial Risk Assessment. New York : John Wiley & Sons, Inc., 1999.
Walls I. Role of quantitative risk assessment and food safety objectives in managing Listeria monocytogenes on ready-to-eat meats. Meat Science, 2006 74 : 66 75.
Codex Alimentarius Commission. Principles and Guidelines for the Conduct of Microbiological Risk Assessment. CAC/GL-30 Codex Alimentarius Commision (FAO/WHO). 1999. Available at : http://www.codexalimentarius.net/download/ standards/357/CXG-030e.pdf. Accessed February 20, 2008.
Lammerding AM, Fazil A. Hazard identification and exposure assessment for microbial food safety risk assessment. International Journal of Food Microbiology, 2000 58 (3 147 157.
Havelaar A. Recommendations for Addressing Quantitative Microbial Risk Assessment at the European Level. June 24, 2005. EFSA and RIVM, Bilthoven the Netherlands. Report. 2005. Available at : http://www.efsa.europa.eu/EFSA/ DocumentSet/af-qrma-16thmeet-en-3b1,0.pdf. Accessed February 20, 2008.
EFSA. Opinion of the Scientific Panel on Animal Health and Welfare on a self-mandate on the Framework for EFSA AHAW Risk Assessments. EFSA Journal, 2007 550 : 1 46.
Gardner IA. An epidemiologic critique of current microbial risk assessment practices: The importance of prevalence and test accuracy data. Journal of Food Protection, 2004 67 (9 2000 2007.
EIIP. Appendix F, EIIP Recommended Approach to Using the Data Attributing Rating System. EIIP, Volume VI. 1996. Available at : http://www.epa.gov/ttn/ chief/eiip/techreport/volume06/viapp-f.pdf. Accessed February 20, 2008.
Tielemans E, Marquart H, De Cock J, Groenewold M, Van Hemmen J. A proposal for evaluation of exposure data. Annals of Occupational Hygiene, 2002 46 (3 287 297.
Sanchez J, Dohoo IR, Christensen J, Rajic A. Factors influencing the prevalence of Salmonella spp. in swine farms: A meta-analysis approach. Preventive Veterinary Medicine, 2007 81 (1-3 148 177.
Funtowicz SO, Ravetz JR. Uncertainty and Quality in Science for Policy. Dordrecht : Kluwer, 1990.
van der Sluijs JP, Craye M, Funtowicz S, Kloprogge P, Ravetz J, Risbey J. Combining quantitative and qualitative measures of uncertainty in model-based environmental assessment: The NUSAP system. Risk Analysis, 2005 25 (2 481 492.
Craye M, Funtowicz S, van der Sluijs J. A reflexive approach to dealing with uncertainties in environmental health risk science and policy. International Journal of Risk Assessment and Management, 2005 5 (2 /3/4 216 236.
Krayer von Krauss MP, Casman EA, Small MJ. Elicitation of expert judgments of uncertainty in the risk assessment of herbicide-tolerant oilseed crops. Risk Analysis, 2004 24 (6 1515 1527.
Risbey J, van der Sluijs J, Ravetz J. A Protocol for Assessment of Uncertainty and Strength of Emissions Data. Department of Science, Technology and Society, Utrecht University. Report no. NW&S-E-2001-10. 2001. Available at : http://www.nusap.net.
van der Sluijs JP, Potting J, Risbey J, van Vuuren D, de Vries B, Beusen A, Heuberger P, Corral Quintana S, Funtowicz S, Kloprogge P, Nuijten D, Petersen AC, Ravetz J. Uncertainty Assessment of the IMAGE/TIMER B1 CO2 Emissions Scenario, Using the NUSAP Method. Bilthoven : Dutch National Research Program on Climate Change, Report no. 410 200 104, 2002. Available at : http://www.nusap.net. Accessed February 20, 2008.
Kloprogge P, van der Sluijs J, Petersen AC. A Method for the Analysis of Assumptions in Assessments, Exploring the Value-Ladenness of Two Indicators in the Fifth Dutch Environmental Outlook. Bilthoven : Netherlands Environmental Assessment Agency. Report no. 550002010/2005. 2005. Available at : http://www.mnp.nl/bibliotheek/rapporten/550002010.pdf.
Grijspeerdt K, Messens W, Bollaerts K, Van Dessel P, Delhalle L, Maes D, Boone I, Mintiens K. Quantitative risk assessment of human salmonellosis through consumption of pork in Belgium: A modular risk model. In Proceedings of the 7th International Conference on the Epidemiology and Control of Foodborne Pathogens in Pork, Safepork 2007. Verona, Italy, 2007.
Bollaerts K, Messens W, Delhalle L, Aerts M, Van Der Stede Y, Dewulf J, et al. METZOON: Development of a quantitative microbial risk assessment for human Salmonellosis through household consumption of fresh minced pork meat in Belgium. Risk Analysis, accepted.
Messens W, Bollaerts K, Delhalle L, Aerts M, Van Der Stede Y, Quoilin S, De Busser E, Dewulf J, Maes D, Boone I, Mintiens K, Grijspeerdt K. Development of a quantitative microbial risk assessment to evaluate zoonotic risks in Belgium: Human salmonellosis through household consumption of minced pork meat. In First Belgian Symposium on Salmonella Research and Control in Pigs, 23 May 2008, Gent, Belgium.
Bollaerts K, Aerts M, Faes C, Grijspeerdt K, Dewulf J, Mintiens K. Human salmonellosis: estimation of dose-illness from outbreak data. Risk Analysis, 2008 28 (2 427 440.
Delhalle L, De Sadeleer L, Farnir F, De Zutter L, Daube G. Exploring the risk factors for Salmonella in the ten biggest Belgian pig slaughterhouses. In Proceedings of the 7th International Conference on the Epidemiology and Control of Foodborne Pathogens in Pork, Safepork, 9-11 May 2007, Verona, Italy.
Bollaerts K, Messens W, Delhalle L, Aerts M, Dewulf J, Debusser E, Boone I, Grijspeerdt K. Development of a modular quantitative microbial risk assessment to evaluate zoonotic risks in Belgium: Salmonellosis through consumption of pork as an example. In Proceedings of the 10th Symposium on Statistical Methods for the Food Industry, UCL, 23-25 January 2008, Louvain-la-Neuve, Belgium.
van der Sluijs JP, Risbey JS, Ravetz J. Uncertainty assessment of VOC emissions from paint in the Netherlands using the NUSAP system. Environmental Monitoring and Assessment, 2005 105 : 229 259.
Lehmann EL. Nonparametrics: Statistical Methods Based on Ranks. San Francisco : Holden-Day, Inc., 1975.
van der Sluijs J. Nusap Kite Diagram Maker. Available at : http://www.jvds.nl/makekite410.php, 2007. Accessed February 8, 2007.
van der Sluijs J, Petersen AC, Janssen PHM, Risbey JS, Ravetz JR. Exploring the quality of evidence for complex and contested policy decisions. Environmental Research Letters, 2008 3 024008 9.
Janssen PH, Petersen AC, Van Der Sluijs JP, Risbey JS, Ravetz JR. A guidance for assessing and communicating uncertainties. Water Science and Technology, 2005 52 (6 125 131.
Krayer von Krauss MP. Uncertainty in policy relevant sciences. Ph.D. thesis, Institute of Environment & Resources DTU, Technical University of Denmark : Kongens Lyngby, 2005.
Krayer von Krauss MP, Kaiser M, Almaas V, van der Sluijs J, Kloprogge P. Diagnosing and prioritizing uncertainties according to their relevance for policy: The case of transgene silencing. Science of the Total Environment, 2008 390 (1 23 34.
Van der Fels-Klerx HJ, Cooke RM, Nauta MN, Goossens LH, Havelaar AH. A structured expert judgment study for a model of Campylobacter transmission during broiler-chicken processing. Risk Analysis, 2005 25 (1 109 124.
Cooke RM. Experts in Uncertainty. Opinion and Subjective Probability in Science. New York : Oxford University Press, 1991.
Boone I, Van der Stede Y, Bollaerts K, Messens W, Grijspeerdt K, Daube G, Mintiens K. A structured expert judgement study on Salmonella spp. in pork: Analyses of different weighting schemes. In Proceedings of the Annual Meeting of the Society for Veterinary Epidemiology and Preventive Veterinary Medicine, 26-28 March 2008, Liverpool, UK, pp. 98 114.
Anonymous. First report on the harmonisation of risk assessment procedures. The report of the Scientific Steering Committee's Working Group on harmonisation of risk assessment procedures in the scientific committees advising the European Commission in the area of human and environmental health, Part 2: Appendices. 26-27 October 2000. Available at : http://ec.europa.eu/food/ fs/sc/ssc/out83-en.pdf. Accessed February 20, 2008.
Klapwijk PM, Jouve JL, Stringer MF. Microbiological risk assessment in Europe: The next decade. International Journal of Food Microbiology, 2000 58 (3 223 230.
Delhalle L. Salmonella et germes indicateurs dans la filière de production et de distribution de viande de porc en Belgique. DEA en Sciences vétérinaires, Service de microbiologie des denrées alimentaires d'origine animale, Faculté de Médecine vétérinaire, Université de Liège, Belgique, 2006.
Alban L, Stark KD. Where should the effort be put to reduce the Salmonella prevalence in the slaughtered swine carcass effectively? Preventive Veterinary Medicine, 2005 68 (1 63 79.
van der Sluijs JP, Janssen PHM, Petersen AC, Kloprogge P, Risbey JS, Tuinstra W, Ravetz JR. RIVM/MNP Guidance for Uncertainty Assessment and Communication: Tool Catalogue for Uncertainty Assessment. Utrecht: Utrecht University and RIVM-MNP. Report no. NWS-E-2004-37. 2004. Available at : http://www.nusap.net/downloads/toolcatalogue.pdf. Accessed February 20, 2008.
De Busser E, Maes D, Dewulf J, Houf K, De Zutter L. Salmonella contamination rate along the slaughter line in 5 different Belgian slaughterhouses. In Proceedings of the 20th International Pig Veterinary Society Congress, 22-26 June 2008, Durban, South Africa.
Van Der Sluijs J, Craye M, Funtowicz S, Kloprogge P, Ravetz. J, Risbey J. Experiences with the NUSAP system for multidimensional uncertainty assessment. Water Science and Technology, 2005 25 (6 133 144.
Walls I. Framework for identification and collection of data useful for risk assessments of microbial foodborne or waterborne hazards: A report from the International Life Sciences Institute Research Foundation Advisory Committee on data collection for microbial risk assessment. Journal of Food Protection, 2007 70 (7 1744 1751.
Korsak N, Jacob B, Groven B, Etienne G, China B, Ghafir Y, Daube G. Salmonella contamination of pigs and pork in an integrated pig production system. Journal of Food Protection, 2003 66 (7 1126 1133.
EFSA. The community summary report on trends and sources of zoonoses, zoonotic agents, antimicrobial agents, antimicrobial resistance and foodborne outbreaks in the European Union in 2005. EFSA Journal, 2006 94 : 27 288.
FAVV. Activiteitenverslag 2005. Federaal Agentschap voor de Veiligheid van de Voedselketen. 2006. Available at : http://www.favv-afsca.fgov.be/home/ pub/doc/rapport/AV-05-Nl-S.pdf.
Hill A, England T, Snary EL, Cook A, Kelly LA, Evans SJ, Wooldridge M. A "Farm-to-Consumption Risk" Assessment for the Adverse Effect to Human Health of Salmonella typhimurium in Pigs. Weybridge : Veterinary Laboratories Agency, 2003.
METZOON. Activity Report METZOON project first working year. Development of a methodology for the quantitative assessment of zoonotic risks in Belgium applied to Salmonella in pigs. METZOON (R-04/003). University of Hasselt, University of Liège, Ghent University, Institute for Agricultural and Fisheries Research, Veterinary and Agrochemical Research Centre, Scientific Institute for Public Health, Brussels, Belgium : Unpublished report, April 2006.
Nollet N, Houf K, Dewulf J, De Kruif A, De Zutter L, Maes D. Salmonella in sows: A longitudinal study in farrow-to-finish pig herds. Veterinary Research, 2005 36 (4 645 656.
Animal Health Care (DGZ-Flanders). Report on Monitoring Animal Health Care, Pigs. 2005. Available at : http://www.dierengezondheidszorg.be/ ondersteuning/praktijk-advies-publikaties-varkens/rapport-va-2004.pdf.
Van Vlaenderen I, Biront P, Verleye A, Imberechts H, Stockmans A. Salmonella uitscheiding op varkensbedrijven - Screening 1998, unpublished report, CODA-CERVA, 1999.
Botteldoorn N, Heyndrickx M, Rijpens N, Grijspeerdt K, Herman L. Salmonella on pig carcasses: Positive pigs and cross contamination in the slaughterhouse. Journal of Applied Microbiology, 2003 95 : 891 903.
Beloeil PA, Chauvin C, Proux K, Rose N, Queguiner S, Eveno E, Houdayer C, Rose V, Fravalo P, Madec F. Longitudinal serological responses to Salmonella enterica of growing pigs in a subclinically infected herd. Preventive Veterinary Medicine, 2003 60 (3 207 226.
Huysmans K, Nollet N, Vandebroeck MKD, Henot D. Epidemiological research of Salmonella, Mycoplasma hyopneumoniae and Lawsonia intracellularis on Belgian pig farms. In Proceedings of the 10th Annual Meeting of the Flemish Society for Veterinary Epidemiology and Economics. Geers R, Laevens H, Vandenheede J (eds. February 6, 2003, Leuven. Belgium, 2003, pp. 47 56.
Korsak N, Daube G, Ghafir Y, Chahed A, Jolly S, Vindevogel H. An efficient sampling technique used to detect four foodborne pathogens on pork and beef carcasses in nine Belgian abattoirs. Journal of Food Protection, 1998 61 (5 535 541.
Ghafir Y, China B, Korsak N, Dierick K, Collard JM, Godard C, De Zutter L, Daube G. Belgian surveillance plans to assess changes in Salmonella prevalence in meat at different production stages. Journal of Food Protection, 2005 68 (11 2269 2277.
Kennedy J, Jackson V, Blair IS, McDowell DA, Cowan C, Bolton DJ. Food safety knowledge of consumers and the microbiological and temperature status of their refrigerators. Journal of Food Protection, 2005 68 (7 1421 1430.
Devriese S, Huybrechts I, Moreau M, Van Oyen H. De Belgische Voedselconsumptiepeiling 1 - 2004. Brussel : Wetenschappelijk Instituut Volksgezondheid, Afdeling Epidemiologie, IPH/EPI Report Nos. 2006-2016. 2006. Available at : http://www.iph.fgov.be/epidemio/epinl/foodnl/table04.htm.
Marklinder IM, Lindblad M, Eriksson LM, Finnson AM, Lindqvist R. Home storage temperatures and consumer handling of refrigerated foods in Sweden. Journal of Food Protection, 2004 67 (11 2570 2577.
WHO/FAO. Risk Assessments of Salmonella in Eggs and Broiler Chickens. In Microbiological Risk Assessment Series No. 2. Geneva : World Health Organization, 2002.
Van der Stede Y, Bollaerts K, Abrahantes KJC, Aerts M, Imberechts H, Mintiens K. Identification of Salmonella risk farms by serological surveillance of pre-harvest level: Mission impossible In Proceedings of the 4th Symposium VEEC, December 12-13, 2007. Wageningen, The Netherlands, pp. 65 70.
National Institute for Statistics, Fysische geografie-Klimaat. Federal Public Service Economy, SMEs, Self-employed and energy. Available at : http://statbel.fgov.be/figures/dlll-nl.asp. Accessed February 20, 2008.
National Institute for Statistics. Structuur van de bevolking. Available at : http://statbel.fgov.be/figures/dlll-nl.asp. Accessed February 20, 2008.
