What To Ask When Evaluating Any Treatment Procedure, Product or
Program
There is no single answer to any of the questions. Some
considerations are presented that may assist in the decision-making
process before using a treatment procedure, purchasing a product,
or attending an educational program.
Stated uses: What are the stated uses of the procedure,
product, or program?
Uses should be clearly specified and information
about reliability should be available. You need to know if you can
count on the procedure to work in a consistent way with repeated
use.
Population: To which client/patient population does it
apply? Is there documented evidence that it is valid for use with
a specified population?
The procedure should be used only with populations
where validity data exists.
Generalization: To which other populations does it claim
to generalize?
The nature of the applicable population should be
stated, and presented with validity data if available. Limits to
generalization with nonvalidated populations should be stated.
Outcomes: Are outcomes clearly stated?
The expected outcomes should be available with
supporting data to demonstrate benefit to the target
population.
Publications: Are there publications about this
procedure, product, or program? Is the information published in a
peer-reviewed professional journal? Is promotional material
(e.g., brochures, training manuals, newsletters, popular press)
the only published source of information?
Peer-reviewed research in a professional journal
has the most credibility. Claims made in promotional material
should be substantiated by available data.
Peer-Reviewed Research: Is there peer-reviewed research
that supports or contradicts the stated outcomes or
benefits?
Peer-reviewed research will assist in determining
the reliability and validity of a treatment procedure. The quality
of the research design (e.g., use of control groups, clear
specification of subject characteristics before and after
treatment, replication) and level of evidence should be considered.
The ideal is peer-reviewed research from a series of well-designed
studies that have been replicated and that demonstrate benefits to
the client.
Developers: What is the professional background of the
developers of the procedure/product/program? If a company, how
long has it been in existence? Have there been complaints to the
Better Business Bureau, governmental consumer offices, or
licensing boards about the company?
Although the credentials of the developers do not
necessarily determine the value of a procedure, product, or
program, the background and experience of the developer can give an
indication of the knowledge and expertise related to the procedure,
product, or program under consideration. Similarly, although a new
company may be able to develop a high quality procedure, product,
or program, a company in business for a long time may have more
credibility if a sound reputation is known based on evidence from
sources such as the Better Business Bureau or "word of
mouth."
Availability and Cost: Are there similar procedures,
products, or programs currently available? How do they compare in
performance and cost?
Costs may be a consideration if other less costly
procedures, products, or programs are available and if there is
comparability in terms of documented benefits.
Experience: Have you talked with others who have
experience with this procedure, product, or program? What was
their experience? Have you considered posting a query on
ASHA's interactive member forum on its Web site?
Others with experience may be able to provide
valuable insights into the actual use of the product from their
perspective.
Scope of Practice: Is it within my profession's Scope
of Practice? Is it within my personal scope of practice (i.e.,
personal training, competence, experience) to use this procedure,
product, or program?
It is mandatory for ASHA members to abide by
ASHA's Code of Ethics and only do what they are trained and
competent to do and only use procedures that benefit the
client.
Information/Policies: Have you checked to see if there
are any ASHA statements or guidelines on this topic?
Related background information and policy documents
may assist in making an informed decision.
Based on the factors listed above, is the cost reasonable
and justifiable?
Based on the factors listed in the questions above,
is the use justifiable?
Additional Questions for
Techniques/Procedures
- What are the potential risks/adverse consequences?
- What are the potential benefits?
- What is recommended as sufficient training to be considered a
qualified user of the technique/procedure?
Additional Questions For Products
- Is it FDA approved? Has the product or its application been
changed from its original design/intent as approved by the Food
and Drug Administration or Underwriter's Laboratory?
- What training and technical support are available?
- Is there a guarantee or return policy?
- Are there potential risks/harm associated with this
product?
- Are there contraindications for specific populations or
etiologies?
- What is recommended as sufficient training to be considered a
qualified user of the product?
Additional Questions for Programs
- Does the program offer CEUs?
- Does the time allotted seem appropriate for achieving the
stated outcomes?
- What is the target audience (i.e., professional background,
beginning vs. advanced)?
- What is the refund/cancellation policy?
- What instructional methods will be used? Will it be
interactive or give a hands-on experience?