General Education Learning Outcomes Assessment

2008-2009: General Education Learning Outcomes Assessment – Cultural Awareness

G. Cultural Awareness Demonstrate an awareness, understanding and appreciation of the interconnectedness of cultures within and across local, regional, state, national and global communities.
Student will acquire an awareness of cultural differences and/or interconnections based upon multiple perspectives of either culture outside their own or the interconnections of cultures, languages and/or nations at various levels, including international. For grading rubric, click here.	Rubric: Pre-test and Post-test that assesses basic cultural knowledge or awareness	Students will achieve at least 70% performance on selected problems or given assessment. When general learning outcomes are compared by instructors, improvements in learning, if any, will be within a comparison range of 15% or less. For instance, if instructor’s X’s class achieves a 72% average score on post test, and instructor Y’s class achieves an average score of 52%, then Y will be notified and mentoring will occur as appropriate.	Summer 08/Fall 08: Pre-test and Post test were administered in selected sections of HUM sections in Summer 2008 terms and Fall 2008 (viz. HUM 2551 and HUM 2511) and results tallied. The post-test scores averaging 78% or better, with the exception of one section, where post test performance was actually lower than pre-test. (Also by implication the variance between learning outcomes in the one section and others was greater than 15 %.) This negative result (data gathered from one section of HUM 2551—Fall) appears to be an instructor specific problem to be addressed. Also: In case of HUM 2511, though the post-test result was positive as to learning achieved, the assessment or measurement tool needs to be revised, since the pre-test results and post test results indicated that the measurement is not reliable, e.g. the pre-test scores were as high as the post-test scores. This is a result of using course specific measurement tools for each course, rather than one general assessment.	1. Results were sent to IR for analysis and confirmation of statistical results was obtained. 2. Assessment of multiple courses has begun (Summer through Fall 08 term to include Spring 09), to increase sample, and in order to see if there is uniformity of results with different instructors. If not, then adjustments need to be made (e.g. in curriculum content, and/or methods of teaching). Specific instructor with the “negative results” from Fall 08 will be notified and mentoring or suggestions for improvement given early in Spring 09 term. 3. Discussion on whether and how to use one common test or assessment for diverse courses within HUM. Will ask expert on assessment for a ruling as to whether course specific test or one general test in appropriate or fitting. [Note: expert advised us the course specific assessment are good, given the common rubric—Feb 09, 2009.] 4. Post test only will be given in future assessments, once baseline data is firmly established. 4. As recommended by IR: Content “validity” of the test (or embedded questions) will need to be established. We argue that since over 50% of the concepts used within the tests (or embedded questions) are also found in “Cultural Literacy,” dictionaries or established encyclopedias, this constitutes content validity.
Student will demonstrate the ability to reflect upon cultural differences and/or interconnections, resulting in the formulation of their own responses to the culture or global issue and be able to relate such reflection through written or spoken contrast/ comparison and informed deliberation. Grading rubric: click here.	Rubric to be graded post-test via embedded final exam questions, on-line assessment, or portfolio. See rubric.	Given the rubric, a score of 16-20 will be considered an excellent result, that is, a result that shows general learning par excellence (see rubric). A score of 8-12, will be considered an average result. A score of 0-4 would be considered below average. Expectation: At least 80% of students will achieve 8 or higher. At least 20% will achieve 16 or higher. And, the average score for all students in each performance category will be 2 or higher.	Findings to be reported by February 09. For this particular bullet: test was given in a randomly selected section of HUM 2551 for Fall 08 term. Assessment results will be report by February 09.	To be reported during month of February.
Student will begin to develop greater tolerance and appreciation of cultural differences and/or interconnections and by extension begin to develop a global perspective, through the identification of positive elements in different cultures. Grading rubric: click here.	Rubric to be graded post-test via embedded final exam questions, on-line assessment, or portfolio. See rubric.	Given the rubric, a score of 12-15 would be considered an excellent result, that is, a result that shows general learning par excellence (see rubric). A score of 6-9, will be considered an average result. A score of 0-3 would be considered below average. Expectation: At least 80% of students will achieve 6 or higher. At least 20% will achieve 12 or higher. And, the average score for all students in each performance category will be 2 or higher.	Findings to be reported by June 09. For this particular bullet: Data will be gathered in selected HUM courses in the Spring 09 term and report of results given my June 09. (Originally, we expected to gather data in Fall 08 but this goal was not met.).	To be reported during month of June 09.

G. Cultural Awareness Demonstrate an awareness, understanding and appreciation of the interconnectedness of cultures within and across local, regional, state, national and global communities.

Gen Ed HUM courses: HUM, ARH, MUH, MUL, REL, PHI,

Learning Outcomes

Related Courses and Measurement

Performance Criteria/

Expected Results

Findings

Actions taken

Student will acquire an awareness of cultural differences and/or interconnections based upon multiple perspectives of either culture outside their own or the interconnections of cultures, languages and/or nations at various levels, including international.

For grading rubric, click here.

Rubric: Pre-test and Post-test that assesses basic cultural knowledge or awareness

Students will achieve at least 70% performance on selected problems or given assessment.

When general learning outcomes are compared by instructors, improvements in learning, if any, will be within a comparison range of 15% or less. For instance, if instructor’s X’s class achieves a 72% average score on post test, and instructor Y’s class achieves an average score of 52%, then Y will be notified and mentoring will occur as appropriate.

Summer 08/Fall 08: Pre-test and Post test were administered in selected sections of HUM sections in Summer 2008 terms and Fall 2008 (viz. HUM 2551 and HUM 2511) and results tallied. The post-test scores averaging 78% or better, with the exception of one section, where post test performance was actually lower than pre-test. (Also by implication the variance between learning outcomes in the one section and others was greater than 15 %.) This negative result (data gathered from one section of HUM 2551—Fall) appears to be an instructor specific problem to be addressed.

Also: In case of HUM 2511, though the post-test result was positive as to learning achieved, the assessment or measurement tool needs to be revised, since the pre-test results and post test results indicated that the measurement is not reliable, e.g. the pre-test scores were as high as the post-test scores. This is a result of using course specific measurement tools for each course, rather than one general assessment.

1. Results were sent to IR for analysis and confirmation of statistical results was obtained.

2. Assessment of multiple courses has begun (Summer through Fall 08 term to include Spring 09), to increase sample, and in order to see if there is uniformity of results with different instructors. If not, then adjustments need to be made (e.g. in curriculum content, and/or methods of teaching). Specific instructor with the “negative results” from Fall 08 will be notified and mentoring or suggestions for improvement given early in Spring 09 term.

3. Discussion on whether and how to use one common test or assessment for diverse courses within HUM. Will ask expert on assessment for a ruling as to whether course specific test or one general test in appropriate or fitting. [Note: expert advised us the course specific assessment are good, given the common rubric—Feb 09, 2009.]

4. Post test only will be given in future assessments, once baseline data is firmly established.

4. As recommended by IR: Content “validity” of the test (or embedded questions) will need to be established. We argue that since over 50% of the concepts used within the tests (or embedded questions) are also found in “Cultural

Literacy,” dictionaries or established encyclopedias, this constitutes content validity.

Student will demonstrate the ability to reflect upon cultural differences and/or interconnections, resulting in the formulation of their own responses to the culture or global issue and be able to relate such reflection through written or spoken contrast/ comparison and informed deliberation.

Grading rubric: click here.

Rubric to be graded post-test via embedded final exam questions, on-line assessment, or portfolio. See rubric.

Given the rubric, a score of 16-20 will be considered an excellent result, that is, a result that shows general learning par excellence (see rubric). A score of 8-12, will be considered an average result. A score of 0-4 would be considered below average.

Expectation: At least 80% of students will achieve 8 or higher. At least 20% will achieve 16 or higher. And, the average score for all students in each performance category will be 2 or higher.

Findings to be reported by February 09. For this particular bullet: test was given in a randomly selected section of HUM 2551 for Fall 08 term. Assessment results will be report by February 09.

To be reported during month of February.

Student will begin to develop greater tolerance and appreciation of cultural differences and/or interconnections and by extension begin to develop a global perspective, through the identification of positive elements in different cultures.

Grading rubric: click here.

Rubric to be graded post-test via embedded final exam questions, on-line assessment, or portfolio. See rubric.

Given the rubric, a score of 12-15 would be considered an excellent result, that is, a result that shows general learning par excellence (see rubric). A score of 6-9, will be considered an average result. A score of 0-3 would be considered below average.

Expectation: At least 80% of students will achieve 6 or higher. At least 20% will achieve 12 or higher. And, the average score for all students in each performance category will be 2 or higher.

Findings to be reported by June 09. For this particular bullet: Data will be gathered in selected HUM courses in the Spring 09 term and report of results given my June 09. (Originally, we expected to gather data in Fall 08 but this goal was not met.).

To be reported during month of June 09.