0網路測驗 accountability article assessment assessments avaluacio data definition docimologia edu-theory education elearning formative norm objective organisation pba pm resources statistics subjective summative teaching tep492(ass3) thinking tradesinfo word

My tags:

From Wikipedia, the free encyclopedia

This article covers educational assessment including the work of institutional researchers.

Educational assessment is the process of documenting, usually in measurable terms, knowledge, skills, attitudes and beliefs. Assessment can focus on the individual learner, the learning community (class, workshop, or other organized group of learners), the institution, or the educational system as a whole. According to the Academic Exchange Quarterly: "Studies of a theoretical or empirical nature (including case studies, portfolio studies, exploratory, or experimental work) addressing the assessment of learner aptitude and preparation, motivation and learning styles, learning outcomes in achievement and satisfaction in different educational contexts are all welcome, as are studies addressing issues of measurable standards and benchmarks"^[1].

It is important to notice that the final purposes and assessment practices in education depends on the theoretical framework of the practitioners and researchers, their assumptions and beliefs about the nature of human mind, the origin of knowledge and the process of learning.

The following table summarizes the main theoretical frameworks behind almost all the theoretical and research work, and the instructional practices in education (one them being, of course, the practice of assessment). This different frameworks have given rise to interesting debates among scholars.

TOPICS	EMPIRICISM	RATIONALISM	SOCIOCULTURALISM
Philosophical orientation	Hume, British Empiricism	Kant, Descartes, Continental Rationalism	Hegel, Marx, Cultural Dialectic
Metaphorical Orientation	Mechanistic/Operation of a Machine or Computer	Organismic/Growth of a Plant	Contextualist/Examination of a Historical Event.
Leading Theorists	B. F. Skinner (behaviorism)/ Herb Simon, John Anderson, Robert Gagne (Cognitivism)	Jean Piaget/Robbie Case	Lev Vygotsky, Luria, Bruner/Alan Collins, Jim Greeno, Ann Brown, John Bransford
Nature of Mind	Initially blank device that detects patterns in the world and operates on them. Qualitatively identical to lower animals, but quantitatively superior.	Organ that evolved to acquire knowledge by making sense of the world. Uniquely human, qualitatively different from lower animals.	Unique among species for developing language, tools, and education.
Nature of Knowledge (epistemology)	Hierarchically organized associations that present an accurate but incomplete representation of the world. Assumes that the sum of the components of knowledge is the same as the whole. Because knowledge is accurately represented by components, one who demonstrates those components is presumed to know	General and/or specific cognitive and conceptual structures, constructed by the mind and according to rational criteria. Essentially these are the higher-level structures that are constructed to assimilate new info to existing structure and as the structures accommodate more new info. Knowledge is represented by ability to solve new problems.	Distributed across people, communities, and physical environment. Represents culture of community that continues to create it. To know means to be attuned to the constraints and affordances of systems in which activity occurs. Knowledge is represented in the regularities of successful activity.
Nature of Learning (the process by which knowledge is increased or modified)	Forming and strengthening cognitive or S-R associations. Generation of knowledge by (1) exposure to pattern, (2) efficiently recognizing and responding to pattern (3) recognizing patterns in other contexts.	Engaging in active process of making sense of (“rationalizing”) the environment. Mind applying existing structure to new experience to rationalize it. You don’t really learn the components, only structures needed to deal with those components later.	Increasing ability to participate in a particular community of practice. Initiation into the life of a group, strengthening ability to participate by becoming attuned to constraints and affordances.
Features of Authentic Assessment	Assess knowledge components. Focus on mastery of many components and fluency. Use psychometrics to standardize.	Assess extended performance on new problems. Credit varieties of excellence.	Assess participation in inquiry and social practices of learning (e.g. portfolios, observations) Students should participate in assessment process. Assessments should be integrated into larger environment

Contents 1 Alternate meanings 2 Types 2.1 Formative and summative 2.2 Objective and subjective 2.3 Bases of comparison 2.4 Informal and formal 2.5 Internal and external 3 Standards of quality 3.1 Reliability 3.2 Validity 3.3 Testing standards 3.4 Evaluation standards 4 Controversy 4.1 No Child Left Behind 4.2 High Stakes Testing Practices 4.3 21st Century Assessment 4.4 Assessment in a democratic school 5 Notes and references 6 See also 7 External links

[edit] Alternate meanings

According to the Merriam-Webster online dictionary the word assessment comes from the root word assess which is defined as:

1. to determine the rate or amount of (as a tax)
2. to impose (as a tax) according to an established rate b: to subject to a tax, charge, or levy
3. to make an official valuation of (property) for the purposes of taxation
4. to determine the importance, size, or value of (assess a problem)
5. to charge (a player or team) with a foul or penalty

Assessment in education is best described as an action "to determine the importance, size, or value of." ^[2]

[edit] Types

The term assessment is generally used to refer to all activities teachers use to help students learn and to gauge student progress. ^[3] Though the notion of assessment is generally more complicated than the following categories suggest, assessment is often divided for the sake of convenience using the following distinctions:

1. formative and summative
2. objective and subjective
3. referencing (criterion-referenced, norm-referenced, and ipsative)
4. informal and formal.

[edit] Formative and summative

Assessment is often divided into formative and summative categories for the purpose of considering different objectives for assessment practices.

• Summative assessment - Summative assessment is generally carried out at the end of a course or project. In an educational setting, summative assessments are typically used to assign students a course grade.
• Formative assessment - Formative assessment is generally carried out throughout a course or project. Formative assessment, also referred to as "educative assessment," is used to aid learning. In an educational setting, formative assessment might be a teacher (or peer) or the learner, providing feedback on a student's work, and would not necessarily be used for grading purposes.

Educational researcher Robert Stake explains the difference between formative and summative assessment with the following analogy:

“

When the cook tastes the soup, that's formative. When the guests taste the soup, that's summative.[4]

”

Summative and formative assessment are often referred to in a learning context as assessment of learning and assessment for learning respectively. Assessment of learning is generally summative in nature and intended to measure learning outcomes and report those outcomes to students, parents, and administrators. Assessment of learning generally occurs at the conclusion of a class, course, semester, or academic year. Assessment for learning is generally formative in nature and is used by teachers to consider approaches to teaching and next steps for individual learners and the class. ^[5]

A common form of formative assessment is diagnostic assessment. Diagnostic assessment measures a student's current knowledge and skills for the purpose of identifying a suitable program of learning. Self-assessment is a form of diagnostic assessment which involves students assessing themselves. Forward-looking assessment asks those being assessed to consider themselves in hypothetical future situations. ^[6]

Performance-based assessment is similar to summative assessment, as it focuses on achievement. It is often aligned with the standards-based education reform and outcomes-based education movement. Though ideally they are significantly different from a traditional multiple choice test, they are most commonly associated with standards-based assessment which use free-form responses to standard questions scored by human scorers on a standards-based scale, meeting, falling below, or exceeding a performance standard rather than being ranked on a curve. A well-defined task is identified and students are asked to create, produce, or do something, often in settings that involve real-world application of knowledge and skills. Proficiency is demonstrated by providing an extended response. Performance formats are further differentiated into products and performances. The performance may result in a product, such as a painting, portfolio, paper, or exhibition, or it may consist of a performance, such as a speech, athletic skill, musical recital, or reading.

[edit] Objective and subjective

Assessment (either summative or formative) is often categorized as either objective or subjective. Objective assessment is a form of questioning which has a single correct answer. Subjective assessment is a form of questioning which may have more than one correct answer (or more than one way of expressing the correct answer). There are various types of objective and subjective questions. Objective question types include true/false answers, multiple choice, multiple-response and matching questions. Subjective questions include extended-response questions and essays. Objective assessment is well suited to the increasingly popular computerized or online assessment format.

Some have argued that the distinction between objective and subjective assessments is neither useful nor accurate because, in reality, there is no such thing as "objective" assessment. In fact, all assessments are created with inherent biases built into decisions about relevant subject matter and content, as well as cultural (class, ethnic, and gender) biases. ^[7]

[edit] Bases of comparison

Test results can be compared against an established criterion, or against the performance of other students, or against previous performance:

Criterion-referenced assessment, typically using a criterion-referenced test, as the name implies, occurs when candidates are measured against defined (and objective) criteria. Criterion-referenced assessment is often, but not always, used to establish a person’s competence (whether s/he can do something). The best known example of criterion-referenced assessment is the driving test, when learner drivers are measured against a range of explicit criteria (such as “Not endangering other road users”).

Norm-referenced assessment (colloquially known as "grading on the curve"), typically using a norm-referenced test, is not measured against defined criteria. This type of assessment is relative to the student body undertaking the assessment. It is effectively a way of comparing students. The IQ test is the best known example of norm-referenced assessment. Many entrance tests (to prestigious schools or universities) are norm-referenced, permitting a fixed proportion of students to pass (“passing” in this context means being accepted into the school or university rather than an explicit level of ability). This means that standards may vary from year to year, depending on the quality of the cohort; criterion-referenced assessment does not vary from year to year (unless the criteria change).^[8]

Ipsative assessment is self comparison either in the same domain over time, or comparative to other domains within the same student.

[edit] Informal and formal

Assessment can be either formal or informal. Formal assessment usually implicates a written document, such as a test, quiz, or paper. A formal assessment is given a numerical score or grade based on student performance, whereas an informal assessment does not contribute to a student's final grade. An informal assessment usually occurs in a more casual manner and may include observation, inventories, checklists, rating scales, rubrics, performance and portfolio assessments, participation, peer and self evaluation, and discussion.^[9]

[edit] Internal and external

Internal assessment is set and marked by the school (i.e. teachers). Students get the mark and feedback regarding the assessment. External assessment is set by the governing body, and is marked by non-biased personnel. With external assessment, students only receive a mark. Therefore, they have no idea how they actually performed (i.e. what bits they answered correctly.)

[edit] Standards of quality

In general, high-quality assessments are considered those with a high level of reliability and validity. Approaches to reliability and validity vary, however.

[edit] Reliability

Reliability relates to the consistency of an assessment. A reliable assessment is one which consistently achieves the same results with the same (or similar) cohort of students. Various factors affect reliability – including ambiguous questions, too many options within a question paper, vague marking instructions and poorly trained markers. Traditionally, the reliability of an assessment is based on the following:

1. Temporal stability: Performance on a test is comparable on two or more separate occasions.
2. Form equivalence: Performance among examinees is equivalent on different forms of a test based on the same content.
3. Internal consistency: Responses on a test are consistent across questions. For example: In a survey that asks respondents to rate attitudes toward technology, consistency would be expected in responses to the following questions:

• "I feel very negative about computers in general."
• "I enjoy using computers."^[10]

[edit] Validity

A valid assessment is one which measures what it is intended to measure. For example, it would not be valid to assess driving skills through a written test alone. A more valid way of assessing driving skills would be through a combination of tests that help determine what a driver knows, such as through a written test of driving knowledge, and what a driver is able to do, such as through a performance assessment of actual driving. Teachers frequently complain that some examinations do not properly assess the syllabus upon which the examination is based; they are, effectively, questioning the validity of the exam.

Validity of an assessment is generally gauged through examination of evidence in the following categories:

1. Content--Does the content of the test measure stated objectives?
2. Criterion--Do scores correlate to an outside reference? (ex: Do high scores on a 4th grade reading test accurately predict reading skill in future grades?)
3. Construct--Does the assessment correspond to other significant variables? (ex: Do ESL students consistently perform differently on a writing exam than native English speakers?) ^[11]

A good assessment has both validity and reliability, plus the other quality attributes noted above for a specific context and purpose. In practice, an assessment is rarely totally valid or totally reliable. A ruler which is marked wrong will always give the same (wrong) measurements. It is very reliable, but not very valid. Asking random individuals to tell the time without looking at a clock or watch is sometimes used as an example of an assessment which is valid, but not reliable. The answers will vary between individuals, but the average answer is probably close to the actual time. In many fields, such as medical research, educational testing, and psychology, there will often be a trade-off between reliability and validity. A history test written for high validity will have many essay and fill-in-the-blank questions. It will be a good measure of mastery of the subject, but difficult to score completely accurately. A history test written for high reliability will be entirely multiple choice. It isn't as good at measuring knowledge of history, but can easily be scored with great precision. We may generalise from this. The more reliable is our estimate of what we purport to measure, the less certain we are that we are actually measuring that aspect of attainment. It is also important to note that there are at least thirteen sources of invalidity, which can be estimated for individual students in test situations. They never are. Perhaps this is because their social purpose demands the absence of any error, and validity errors are usually so high that they would destabilise the whole assessment industry.

It is well to distinguish between "subject-matter" validity and "predictive" validity. The former, used widely in education, predicts the score a student would get on a similar test but with different questions. The latter, used widely in the workplace, predicts performance. Thus, a subject-matter-valid test of knowledge of driving rules is appropriate while a predictively-valid test would assess whether the potential driver could follow those rules.

[edit] Testing standards

In the field of psychometrics, the Standards for Educational and Psychological Testing ^[12] place standards about validity and reliability, along with errors of measurement and related considerations under the general topic of test construction, evaluation and documentation. The second major topic covers standards related to fairness in testing, including fairness in testing and test use, the rights and responsibilities of test takers, testing individuals of diverse linguistic backgrounds, and testing individuals with disabilities. The third and final major topic covers standards related to testing applications, including the responsibilities of test users, psychological testing and assessment, educational testing and assessment, testing in employment and credentialing, plus testing in program evaluation and public policy.

[edit] Evaluation standards

In the field of evaluation, and in particular educational evaluation, the Joint Committee on Standards for Educational Evaluation ^[13] has published three sets of standards for evaluations. "The Personnel Evaluation Standards" ^[14] was published in 1988, The Program Evaluation Standards (2nd edition) ^[15] was published in 1994, and The Student Evaluation Standards ^[16] was published in 2003.

Each publication presents and elaborates a set of standards for use in a variety of educational settings. The standards provide guidelines for designing, implementing, assessing and improving the identified form of evaluation. Each of the standards has been placed in one of four fundamental categories to promote educational evaluations that are proper, useful, feasible, and accurate. In these sets of standards, validity and reliability considerations are covered under the accuracy topic. For example, the student accuracy standards help ensure that student evaluations will provide sound, accurate, and credible information about student learning and performance.

[edit] Controversy

Concerns over how best to apply assessment practices across public school systems have largely focused on questions about the use of high stakes testing and standardized tests, often used to gauge student progress, teacher quality, and school-, district-, or state-wide educational success.

[edit] No Child Left Behind

For most researchers and practitioners, the question is not whether tests should be administered at all--there is a general consensus that, when administered in useful ways, tests can offer useful information about student progress and curriculum implementation, as well as offering formative uses for learners. ^[17] The real issue, then, is whether testing practices as currently implemented can provide these services for educators and students.

In the U.S., the No Child Left Behind Act mandates standardized testing nationwide. These tests align with state curriculum and link teacher, student, district, and state accountability to the results of these tests. Proponents of NCLB argue that it offers a tangible method of gauging educational success, holding teachers and schools accountable for failing scores, and closing the achievement gap across class and ethnicity. ^[18]

Opponents of standardized testing dispute these claims, arguing that holding educators accountable for test results leads to the practice of "teaching to the test." Additionally, many argue that the focus on standardized testing encourages teachers to equip students with a narrow set of skills that enhance test performance without actually fostering a deeper understanding of subject matter or key principles within a knowledge domain. ^[19]

[edit] High Stakes Testing Practices

The assessments which have caused the most controversy in the US are the use of High school graduation examinations, which first appeared to support the defunct Certificate of Initial Mastery, which can be used to deny diplomas to students who do not meet high standards. They argue that one measure should not be the sole determinant of success or failure. Technical notes for standards based assessments such as Washington's WASL warn that such tests lack the reliability needed to use scores for individual decisions, yet the state legislature passed a law requiring that the WASL be used for just such a purpose. Others such as Washington State University's Don Orlich question the use of test items far beyond standard cognitive levels for testing ages, and the use of expensive, holistically graded tests to measure the quality of both the system and individuals for very large numbers of students.^[20]

High stakes tests, even when they do not invoke punishment, have been cited for causing sickness and anxiety in students and teachers, and narrowing the curriculum towards test preparation. In an exercise designed to make children comfortable about testing, a Spokane, Washington newspaper published a picture of a monster that feeds on fear when asked to draw a picture of what she thought of the state assessment. This, however is thought to be acceptable if it increases student learning outcomes.

Standardized multiple choice tests do not conform to the latest education standards. Nevertheless, they are much less expensive, less prone to disagreement between scorers, and can be scored quickly enough to be returned before the end of the school year. Legislation such as No Child Left Behind also define failure if a school does not show improvement from year to year, even if the school is already successful. The use of IQ tests has been banned in some states for educational decisions, and norm referenced tests have been criticized for bias against minorities. Yet the use of standards based assessments to make high stakes decisions, with greatest impact falling on low-scoring ethnic groups, is widely supported by education officials because they show the achievement gap which is promised to be closed merely by implementing standards based education reform. Many states are currently using testing practices which have been condemned by dissenting education experts such as Fairtest and Alfie Kohn.

[edit] 21st Century Assessment

It has been widely noted that with the emergence of social media and Web 2.0 technologies and mindsets, learning is increasingly collaborative and knowledge increasingly distributed across many members of a learning community. Traditional assessment practices, however, focus in large part on the individual and fail to account for knowledge-building and learning in context. As researchers in the field of assessment consider the cultural shifts that arise from the emergence of a more participatory culture, they will need to find new methods of applying assessments to learners. "^[21]

[edit] Assessment in a democratic school

Sudbury model of democratic education schools do not perform and do not offer assessments, evaluations, transcripts, or recommendations, asserting that they do not rate people, and that school is not a judge; comparing students to each other, or to some standard that has been set is for them a violation of the student's right to privacy and to self-determination. Students decide for themselves how to measure their progress as self-starting learners as a process of self-evaluation: real life-long learning and the proper educational assessment for the 21st Century, they adduce.^[22]

According to Sudbury schools, this policy does not cause harm to their students as they move on to life outside the school. However, they admit it makes the process more difficult, but that such hardship is part of the students learning to make their own way, set their own standards and meet their own goals.

The no-grading and no-rating policy helps to create an atmosphere free of competition among students or battles for adult approval, and encourages a positive co-operative environment amongst the student body.^[23]

The final stage of a Sudbury education, should the student choose to take it, is the graduation thesis. Each student writes on the topic of how they have prepared themselves for adulthood and entering the community at large. This thesis is submitted to the Assembly, who reviews it. The final stage of the thesis process is an oral defense given by the student in which they open the floor for questions, challenges and comments from all Assembly members. At the end, the Assembly votes by secret ballot on whether or not to award a diploma.^[24]

[edit] Notes and references

[edit] See also

• Confidence-Based Learning accurately measures a learner’s knowledge quality by measuring both the correctness of his or her knowledge and the person’s confidence in that knowledge.
• Evaluation is the process of looking at what is being assessed to make sure the right areas are being considered.
• Grading is the process of assigning a (possibly mutually exclusive) ranking to learners.
• Educational measurement is a process of assessment or an evaluation in which the objective is to quantify level of attainment or competence within a specified domain. See the Rasch model for measurement for elaboration on the conceptual requirements of such processes, including those pertaining to grading and use of raw scores from assessments.
• Educational evaluation deals specifically with evaluation as it applies to an educational setting. As an example it may be used in the No Child Left Behind (NCLB) government program instituted by the government of the USA.
• Educational psychology
• Electronic portfolio is a personal digital record containing information such as a collection of artifacts or evidence demonstrating what one knows and can do.
• Health Impact Assessment looks at the potential health impacts of policies, programs and projects.
• Program evaluation is essentially a set of philosophies and techniques to determine if a program 'works'.
• Psychometrics, the science of measuring psychological characteristics
• Social Impact Assessment looks at the possible social impacts of proposed new infrastructure projects, natural resource projects, or development activities.
• Standardized testing is any test that is used across a variety of schools or other situations.
• Standards-based assessment
• Rubrics for assessment
• Science, Technology, Society and Environment Education
• Computer aided assessment

[edit] External links

• Assessment in Higher Education web site.
• Edutopia: Assessment Overview A collection of media and articles on the topic of assessment from The George Lucas Educational Foundation
• The Standards for Educational and Psychological Testing
• Joint Committee on Standards for Educational Evaluation
• Creating Good MCQs A whitepaper by Focalworks