Professional Documents
Culture Documents
Validitas Instrumen
Validitas Instrumen
php/jipi
Abstract
This study aims to develop an evaluation instrument CIPP (context, input, process, product)
model that suitable at implementation of performance assessment instrument to measure students'
science process skills of junior high school. Methods in this study are research and development (R &
D) which is adopted by model Borg & Gall model. This evaluation instrument used one of evaluation
CIPP model with context, input, process, and product components. The evaluation instrument is used
to determine the implementation of performance assessment instrument to measure junior high school
students' science process skills in excretion system topic. This development study involves some
experts to give validation of the development of feasibility products. Experts involved, they are two
lecturers of evaluation expert, two junior high school science teachers, and four peers. The validity of
evaluation instruments was analyzed using V'aiken formula. The results of this study are evaluation
instrument of CIPP model of the implementation of performance assessment to measure junior high
school students' science process skills of grade VIII in excretion system topic. The results of the
validity of this product indicates that this evaluation instruments are eligible in using with V'eiken
coefficient of 0.86. It indicates that the evaluation instruments are valid in substance, construction, and
language aspects.
Keywords: evaluation instrument, performance assessment, science process skills
How to Cite: Ramadani, M., Supahar, S., & Rosana, D. (2017). Validity of evaluation instrument on the
implementation of performance assessment to measure science process skills. Jurnal Inovasi Pendidikan IPA,
3(2), 180-188. doi:http://dx.doi.org/10.21831/jipi.v3i2.15534
Permalink/DOI: http://dx.doi.org/10.21831/jipi.v3i2.15534
__________________________________________________________________________________________
performance assessment to convey alternative (Ergül et al., 2011, p. 53). Science process skills
forms of assessment. Teacher include quality are used in real life as well as in science. Student
assessment in their instruction activities to are required to explain how real life event occur.
provide consistent guidance for planing and Science process skills involve creativity and
instruction. Student can participate from the critical thinking along with scientific thinking. It
very beginning of instruction by demonstrating is known that those who can think creatively and
their strengths through authentic performance critically are an important factor in the develop-
assessment. Through the use of pre-assessing ment of a country (Karsli & Şahin, 2009, p. 3).
with alternative assessment measures, students The development of performance assess-
can demonstrate their abilities, strenght, ment instrument is a learning program that the
knowledge, likes, and desires that can guide conducting of the programs need to be evaluated
classroom instruction (Oberg, 2011, p. 2). of its implementation. Evaluation of a program
Performance assessment can be concluded that is a method to determine the performance of a
performance assessment is an assessment which program by comparing with pre-determined
requires students to do a task that will be criteria or objectives to be achieved with the
assessed later by the teacher using rubric results that would be achieved. The results
(Pratama & Rosana, 2016, p. 103). achieved in the form of information used as a
One is main points of science is look at consideration for making a decision and decide
science as a process. In learning science, the the policy (Retnawati, 2013). In order to the
scientific approach can be applied to explore evaluation of this program runs systematically
students’ science process skills. Science process and knows actually of a success program, it is
skills are difened as the adaptation of the skills necessary to develop an evaluation instrument
used by scientists for composing knowledge, aimed to evaluate the implementation of perfor-
thinking of problems and making conclusions. mance assessment instruments that already exist.
Science process skills also defined as facilitating There are several models of evaluation that can
basic activities in regards to learning science, be used to evaluate a program, one of them is
gaining research method and techniques, helping CIPP evaluation model that is developed by
students to be active and to make learning Stufflebeam. This evaluation model based on
permanent. Science process skills are classified context, input, process, and product. Each aspect
as basic (observation, testing, classification, of the fourth aspect of this CIPP evaluation
relating number with space, and recording data), model has different criteria (Stufflebeam, 2001,
casual (prediction, determination of variables, pp. 280–282).
and drawing a conclusion) and experimental Specifically, the context evaluation com-
(making hypothesis, modeling, doing the experi- ponent of the Context, Input, Process, and Pro-
ment, changing and testing variables, and duct evaluation model can help identify service
making a decision) (Karsli & Şahin, 2009, p. 2). providers’ learning needs and the community’s
In teaching science concepts, teachers should need. The input evaluation component can help
train and teach students to use science process perscribe a responsive project that can best
skills that appropriate to the science material address the identified needs. Next, the process
that is taught (Goldston & Downey, 2013, p. evaluation component monitors the project
130). The science process is the number of skills process and potential procedural barriers, and
to examine a natural phenomenon with certain identifies needs for project adjusment. Finally
ways to acquire science knowledge. Thus, when the product component measures interprets, and
students understand science concepts using their judges project outcomes and interprets their
science process skills, so students can learn merit, worth, significance, and probity (Zhang et
science based on what the scientists did (Bundu, al., 2011, pp. 57–59). The CIPP model is the
2006, p. 12). In obtaining the science process most widely known and applied model that is
skills, it is considered as "learning how to learn" used by evaluator. This model was developed by
because students learn how to learn to think Stufflebeam. Stufflebeam stated that the core
critically and creatively using information concept of the CIPP model denoted by the CIPP
(Rauf, Rasul, Mansor, Othman, & Lyndon, acronym, which stands for the evaluation con-
2013, pp. 47–48). Basic science process skills of text, input, prrocess, and product. The CIPP
observing, comparing and classifying, conclud- evaluation model belongs in the improve-
ing, predicting, defining the operational, ment/accountability category, and is one of the
measuring, and creating charts and graphs most widely applied evaluation models. One of
the strenght of CIPP model is, especially, that is quality of the instrument, the higher also of the
a useful and simple tool for helping evaluators evaluation results (Arikunto & Jabar, 2009, pp.
produce questions of vital importance to be 92–94).
asked in an evaluation process (Divayana, An instrument is valid when it is measur-
Sanjaya, Marhaeni, & Sudirtha, 2017, p. 2). ing what is supposed to measure. In the other
The CIPP evaluation model is useful words, when an instrument accurately measures
framework for analyzing the interrelationship any prescribed variable it is considered a valid
between the four evaluation dimensions. These instrument for that particular variable. There are
four dimensions of evaluations also serve four types of validity, face validity, criterion
planning, structuring, implementing, and validity, content validity, or construct validity.
recycling decisions respectively. As such con- Face validity is looking at the concept of
text evaluation involves confirming the present whether the test looks valid or not on its surface.
objectives, to modify the existing objectives or Criterion valdity is a concept which will be
develop new ones. Input assess the strategies, demonstrated in the actual study as to establish
personnel, resources or procedures in achieving it needs a good knowledge of theory relating to
the program’s objectives. Process evaluation is the concept and a measure of the relationship
looking at everything related to the implemen- between our measure and those factors, whereas
tation of already selected design, strategies or content validity is looking at the content of
action plan. Product evaluation determines and items. Finally is the contruct validity, which
examines the spesific outcomes of the program measures the extent to which an instrument
(Abdullah, Wahab, Noh, Abdullah, & Ahmad, accurately measures a theoritical contruct that it
2016, pp. 5–6). It is consistent with the defini- is designed to measure. There is a relationship
tion of operational assessment in this study the between validity and reliability. Any instrument
evaluation process is a draw, collect, and can be reliable but not valid however, it cannot
provide useful information to choose alternative be valid if it s not reliable. In other words, if an
decisions for improvement. The level of context, instrument is valid, it must be reliable. And in
input, process, product can provide important general, checking for validity of an instrument is
strategies or action plans for the structuring of a more difficult than checking for reliability
more robust implementation of the performance because validity is measuring data related to
assessment to measure science process skills. knowledge whereas reliability only concerns
Aspects of evaluation context help in with the consistency of scores (Ghazali, 2016, p.
analyzing the needs to be achieved by the 80).
program that will be implemented so it can help
METHOD
in planning decisions. Input evaluation aspects
help to build the readiness of human resources This research is a development research
and the surrounding conditions. In this case, the that is developing an evaluation instrument on
input aspects of the three objectives are the the implementation of performance assessment
evaluation of students’ characteristics, teachers’ instruments to measure science process skills
competencies, and the availability of schools’ topic in the excretion system. The development
facilities and infrastructures. Process aspects model used in this research is to integrate 4D
help in implementing a program. Thus, in this model proposed by Thiagarajan with non-test
aspect, the evaluators observe the conducting of instrument of development model. 4D develop-
a program. In this case, it is the enforceability of ment model has steps such as define, design,
the implementation of assessment instruments. develop, and desseminate, while the develop-
Product aspects evaluate the result of applying a ment model of non-test instrument has 7 steps:
program (Stufflebeam, 2001, pp. 280–282). (1) disseminate the specifications of the instru-
Therefore, the aim of this study is to develop an ment, (2) write the instrument, (3) determine the
evaluation instrument with CIPP model on the scale of the instrument, (4) determine the
implementation of performance assessment scoring system, (5) comprehend the instruments,
instrument to measure the science process skills (6) validate the instrument, and (7) analyze the
students of grade VIII on the topic of the instrument.
excretion system. In each study, the instrument Development product in this study is
is something that has a very important position evaluation instrument CIPP model that consists
because the instrument will determine the of context, input, process, and product. From
quality of the data collection. The higher the each aspect of the CIPP model evaluate different
components. In context components, evaluators ments using observation sheets and question-
analyze the needs. In this case, the needs naire sheets. Observation sheets used to evaluate
analysis is intended to build up information the program of input, process, and product
about the importance of the implementation of component like observation items. It was used
performance assessment instrument related to questionnaire sheets to evaluate the program in
the demands of curriculum 2013. In input context component. Besides, questionnaire
component techniques, the evaluation focused sheets were also used of expert lecturers, science
on teachers’ competencies, students’ character- teachers, and peers to see the validity of the
istics, and the availability of schools’ facilities instrument. To determine the validity of this
and infrastructures. In evaluation process evaluation instrument CIPP model, data analysis
components, it is forced at the conducting in techniques were used is Aiken. Content validity
implementing of performance assessment instru- was gained from scores given by every aspect of
ment in science learning. In product component, the assessment. The assessment scores obtained
evaluation is focused on the results of the from seven validators. Then, content validity
implementation of performance assessment coefficient was calculated using Aiken formula.
instrument and students’ learning outcomes Each questionnaire validation item, it was
related to the science process skills. These are converted into qualitative data with V index
grilles of evaluation instrument CIPP model on ranges between 0 and 1. Score calculation
the implementation of performance assessment results of V compared with the table category of
instrument to measure the science process skills. V Aiken. According to Aiken for numbers of
assessment categories are 4 to 7 rater, limited V
Table 1. Grilles of evaluation instrument CIPP
number called good if ≥ 0.86 (Aiken, 1985, pp.
model on the implementation of performance
131–134).
assessment instrument to measure the science
process skills RESULTS AND DISCUSSION
Component Aspect Indicators This development research aims to pro-
Context needs analysis Teachers’ needs duce an evaluation instrument on the implemen-
Teachers’ Pedagogic, tation of performance assessment instrument to
competency professional, measure students' science process skills that
characteristic, and fulfill valid criteria. The product of this research
social
is evaluation instrument CIPP model that aims
Students’ Students’ interest
Input characteristic to evaluate the implementation of performance
Facilities and Laboratory assessment to measure science process skills.
infrastructures condition and the This evaluation instrument was developed based
availability of on 4D model and development model of non-
equipment and test instrument..
material
Planning Planning of the Define Stage
use of Define stage is a stage of preliminary
performance study that aimed at preparing the product to be
assessment
developed to collect information and analyze the
instrument
Process
Conducting The
factors that caused problems so it required
implementation of product development to solve those problems.
performance Step of analysis needs start from conducted
assessment interviews with several junior high school
instrument science teachers. These analysis needs were
Result of The accuracy of conducted to determine the needs for an eva-
performace using, skills luation of the conducting on the implementation
assessment improvement, and of performance assessment instrument to
Product
instrument the effectiveness measure the science process skills. The results
implementation of instrument
of the interview was obtained an information
implementation
that need to be evaluated toward the product that
This development study used several data
has developed. However, evaluation program
collection techniques such as used observation
activities will be more structured and obtain
and questionnaires so the data collection instru-
maximum results, it needs using evaluation
guidelines including evaluation instruments that and the availability of facility and infrastructure.
could be the basis of the evaluator in observing In process component, the main point of
and assessing the enforceability of the imple- evaluation is in planning and implementing the
mentation of the performance instruments. use of evaluation instruments in the learning
Based on the results of observation of the activities by teachers. In product component, the
application of the system of teacher assessment main point is on the results of the evaluation of
conducted during the learning process on the implementation of performance assessment
December 7, 2016 in SMP 3 Tempel (Junior instrument itself.
high school) obtained the fact that in science
Design Stage
learning aspect of the achievement of the results
of the study are rarely measured are aspects of The design stage is a stage of drafting or
skill. In addition, the current performance it can be called as early design product that will
assessment instruments developed to measure be developed. The first step is to choose the
skills in the process of science students on the form and format of an evaluation instrument.
material system excretion compiled by Deby Determination of shape and this format should
Kurnia Dewi with IPR (Intellectual Property be adapted to the evaluation model selected.
Right) number C22201604796 in 2016. Based Appropriate forms of evaluation instrument are
on the results of the research of Deby Kurnia observation and questionnaires. A questionnaire
Dewi, performance assessment instrument sheet is used to evaluate the components of
science process skills have been applied in context because the data was obtained based on
SMPN 15 Yogyakarta (Junior high school) but answers of science teacher. An observation sheet
the results, the effectiveness of the application is used to observe the implementation of the
of performance assessment instrument is not yet program especially on input, process, and pro-
known through the evaluation. In an evaluation duct components. The development of evalua-
of the activities, thing that is very important to tion instruments should also specify the format
the evaluation instrument is prepared. The that will be developed. The first format specified
instrument is the thing that has a very important is determining the title of the instrument. It is
position, because by using the instruments will "Evaluation instrument CIPP Model on The
determine the quality of the data collected. The Implementation of Performance Assessment
information gathered in the evaluation activities Instrument to Measure Students’ Science
are very useful in decision-making and follow- Process Skills". Next step is preparation of the
up of the program policies, because the instructions for use of performance assessment
evaluation of the results of the input evaluator that aims to make the observer to understand
can determine the follow-up of the programme how to use the evaluation instrument.
has been implemented, in this case is the The next stage is determining the design
application of performance assessment instru- of evaluation indicators of program implemen-
ments. There are four possibilities that policy tation. The arrangement of this indicator is
can be made based on the results of the imple- based on the analysis of each criterion of CIPP
mentation of a program, namely (1) terminate evaluation model components. After deter-
the programe, (2) revise the program, (3) mining the indicator, then the next step is to
continue the program, or (4) disseminating the make design of evaluation instrument that are
program. interpreted into statement items that suitable
Besides analyzing the needs, further ana- with the indicator. The next step is writing
lysis evaluation model that will be used in the evaluation instrument. This instrument is written
evaluation of the program. There are several based on design by considering the substance,
evaluation model developed by several evalua- construction, and language that make thi
tion experts. In this study, the researchers chose instrument easier to use directly.
to use an evaluation CIPP model that is The next design stage is determining the
developed by Stufflebeam. CIPP Model has four scale of evaluation instruments. The scale used
components which each evaluation of each in this evaluation instrument development is
component has a different criteria. In context rating scale with a scale of 1 to 5. Thus, the
components, main point of evaluation is on scoring system used in this study refers to a
analysis of the needs of teachers. In input scale of 1 to 4 based on the observation result of
component, the main point of evaluation is on appearance options that provide of each items.
teachers’ competency, students’ characteristic, To make observer easier in scoring, the
researchers arrange the rubric as a basis in of the research of Hasnida model CIPP
scoring. Rubric contains five possible conditions evaluation suitable to evaluate the assessment
that will arise. Then, it was compared with the instruments because the CIPP model is based on
ideal conditions that has determined by the the management-oriented evaluation approaches
researcher. that will help decision makers to plan,
implement, and evaluate programs. Evaluation
Develop Stage
of model CIPP involve decision makers, so that
Product development is done to produce all components of the CIPP model presents a
an evaluation sheet that is ready to be staple in the decision in the form of planning,
experimented. The early step in an evaluation structuring, implementation, and repeated in a
instrument development stage of CIPP model row processing where information obtained
are arrange early draft. Then, it validated by from each stage of the previous evaluation
expert lecturers, science teachers, and peers. The components [14]. A good evaluation instruments
preparation of these instruments is based on are instruments that meet certain conditions, can
grilles that obtained from the synthesis of provide accurate data, and only measure specific
literature review. Validation of evaluation behaviors samples. One of the conditions of
instrument CIPP model is viewed from several good evaluation instruments are valid.
aspects including substance, construction, and Instruments that are developed must be able to
language aspects. Then, the experts give a deci- measure what is measured.
sion of each item. Data results from validators Assessment is a vital component in
was analyzed descriptively by calculating the education. The interaction between assessment,
content validity coefficient using V Aiken curriculum and instruction is very important if
analysis later. Based on V Aiken formula, it can we were to improve the teaching and learning
be determined the feasibility of the product of process in school. Performance assessment is
evaluation instrument CIPP model. Rate of one of the main elements that contribute to this.
validation product of evaluation instrument Currently, the instrument to evaluate the
CIPP model using a scale of 4 with the 7 implementation of performance assessment to
rater.Th summary of V Aiken value can be seen measure science process skills. According to
of the Table 2. (Ghazali, 2016, p. 156) presenting the value of
Table 2. Results of V Aiken Analysis validity of an instrument is important so that
other researchers are confident with the quality
Evaluation Item of the data.
V value Description
Component Number
Context 1,2,3,4,5,6 0,90 Valid CONCLUSION
Input 1 - 17 0,95 Valid The results of this study are evaluation
Process 1,2,3,4 0,90 Valid
instrument of CIPP model of the implementation
Product 1,2,3,4 0,88 Valid
of performance assessment to measure junior
Based on Table 2, it can be seen that the
high school students' science process skills of
results of the validation of 7 V Aiken rater
grade VIII in excretion system lessons. The
shows the value of each evaluation component
results of the validity of this product indicates
ranges in the range of 0.86 to 1.00. Therefore,
that this evaluation instruments are eligible in
the calculation of Aiken of each item ≥ 0.86 so
using with V'eiken coefficient of 0.86. It
the whole instrument items are declared valid.
indicates that the evaluation instruments are
After finding the V value, then it analyzed the
valid in substance, construction, and language
decision of the experts whether evaluation
aspects.
instrument CIPP model is appropriate to use
without revision, appropriate to use with REFERENCES
according to suggestion, or inappropriate to use. Abdullah, N., Wahab, N. A., Noh, N. M.,
The result of the experts of evaluation instru- Abdullah, E. M., & Ahmad, A. (2016).
ment CIPP model completely is appropriate to The evaluation and effectiveness of
use with revision based on the suggestions. school based assessment among science
CIPP model evaluation instrument has teachers in Malaysia using CIPP Model.
been developed by Ghazali (2016). The CIPP International Journal of Advanced and
evaluation instruments used to evaluate School- Applied Sciences, 3(11), 1–7.
Based Assessment System. Based on the results https://doi.org/https://doi.org/10.21833/ija