How to Develop a National Formulary Based on the WHO Model Formulary - A Practical Guide: 8 EVALUATION: How to design the evaluation

How to Develop a National Formulary Based on the WHO Model Formulary - A Practical Guide
(2004; 45 pages)

Table des matières

Abbreviations
1 INTRODUCTION
	Objectives
	The need for formularies
	What is a formulary?
	The essential medicines concept
	The WHO model list of essential medicines and the WHO model formulary
2 OVERVIEW OF THE NATIONAL FORMULARY PROCESS
	Organization of the national formulary committee
		The editorial team
		The advisory group
	Agreement on purpose, content, structure and format
	Financing
	Selection of medicines to be included in the national formulary
	Development of the draft
	Reviewing and finalizing content
	Production, dissemination and implementation
	Evaluation and review
3 DEVELOPING THE PRELIMINARY INFORMATION SECTION
	Developing locally relevant introductory information
	General entries at the front of a national formulary
		Acknowledgements
		Introduction or preface
		Table of contents
		Abbreviations
		Units of measurement
	Additional information at the front of the national formulary
		Instructions on how to use the formulary
		Glossary
		Policies and procedures of the national formulary and national formulary committee
		National policies and regulations
		List of changes
	Adapting the “General advice to prescribers” section of the WHO model formulary
4 DEVELOPMENT OF THERAPEUTIC INFORMATION AND MONOGRAPHS USING THE WHO MODEL FORMULARY
	Adapting the therapeutic classification system of the WHO model formulary
	Options for adapting information from the WHO model formulary in the national formulary
	Addition of locally important, specific information to the WHO model formulary text
		Introductory text of therapeutic sections
		Monographs
		Brand name(s)
		Price
	Writing new material for the national formulary
	Language, style and presentation
	Technical copy-editing
5 ADDITIONAL SOURCES OF INFORMATION
	The evidence-based approach in formulary development
	Information retrieval
	Types of source
		Primary information sources
		Secondary information sources
		Tertiary information sources
		Manufacturer’s literature
	Searching for the best evidence
		Using tertiary sources
		Using secondary sources: evidence-based reviews and guidelines
		Searching the primary literature
	Accessibility
		Printed sources
		Electronic sources
	Critical appraisal
6 DEVELOPING SPECIFIC INFORMATION SECTIONS
	Creating locally important appendices
	Adopting appendices from the WHO model formulary
		Additions
		Deletions
	Working with a master document in Microsoft Word® to create a table of contents and index
		Creating the table of contents
		Creating the index
7 PRODUCTION, DISTRIBUTION AND IMPLEMENTATION
	Production of the paper-based formulary
	Final editing and layout of manuscript
	Utilizing the electronic version of the WHO model formulary
		Editing of final text
		Printing
		Distribution
	Electronic publishing and distribution of the national formulary
	Implementation to gain acceptance and credibility for the national formulary
8 EVALUATION
	Evaluation of the NF within the framework of existing monitoring and evaluation activities
	How to design the evaluation
	What to evaluate
		Policy, legal framework and management support
		Selection
		Procurement
		Distribution of formulary
		Rational use
9 REVIEW AND UPDATE
	Planning for review
	How frequently does the national formulary need to be reviewed?
	Review process
		Identification of areas in need of change
		Drafting of updated texts for areas where change is necessary
		Updating texts based on the WHO model formulary
		Updating texts containing locally added information
		Approval by the national formulary committee and expert advisers
REFERENCES

How to design the evaluation

Evaluation of the NF will require standards and processes similar to those for a research project. These include:

- defining the scope and questions to be answered by the evaluation;
- selecting or developing the appropriate methods and testing data collection instruments;
- collecting and analysing the data; and
- interpreting results and

Depending on the objective of the evaluation, the types of information collected may include:

• Descriptive information (specific information obtained from close-ended questions) e.g. Is there a national policy to endorse the regular production and dissemination of the NF, Yes or No):?

• Quantitative information (numbers): e.g. What percentage of prescribers in a health facility have a personal copy of the NF?

• Qualitative information (statements, opinions): e.g. Why do prescribers use (or not use) the NF regularly?

A valid evaluation requires the collection of the right amount of relevant information. Some practical hints on how to avoid common pitfalls of evaluations are offered in Table 8.1.

Table 8.1. Useful hints for planning and conducting an evaluation

Dos	Don'ts
Make sure to involve important partners in the design of the evaluation.	Do not treat evaluation as a trivial task after production of a NF.
Consider carefully the available resources when deciding on depth and complexity of evaluation.	Do not be over ambitious.
Ask important questions that matter for future production and measuring the impact of the NF.	Do not collect data unless they are needed to answer the questions identified.
Make sure that data collection tools and indicators are reliable, i.e. that they measure what they are intended to.	Do not try to gather information that is very difficult to obtain.
Make sure that results of the evaluation are disseminated to all relevant decision-makers to influence future strategies and plans.	Do not lock up results and forget about them.