OC 2 assessment report - Spring 2014

PROGRAM INFORMATION

Date submitted: _May, 30th 2014__

 

Degree Program(s):

MS

Department:

Computer Science

Department Chair:

Jon Pearce

Phone:

4-5060

Report Prepared by:

Chris Tseng

Phone:

4-7227

Next Self-Study due :

June 2016

E-mail:

chris.tseng@sjsu.edu

Note: Assessment schedule is posted at here

 

 

 

 

ARCHIVAL INFORMATION

 

Location:

MH213

Person to Contact:

Chris Tseng

4-7255

 

 

MSCS.OC2: Depth of knowledge in an advanced topic in computer science

 

 

Initial Evidence of Student Learning:

On a survey sheet, every Thesis Committee member is asked “I feel that this student, who is completing their MS program in Computer Science, has demonstrated through their thesis work, good depth of knowledge in an advanced topic in computer science.” (10 Strongly Agree, 1 Strongly Disagree)”

On this question, overall students received average score of 12 to 15 for their written part and 8/10 for their oral part of their depth of knowledge in an advanced topic in computer science. There were very few verbal comments related to this part. Only one professor put some technical comments on the assessment survey form for this part.

Change(s) to Curriculum or Pedagogy:

Though it showed a small improvement over the years on this outcome, the trend is a bit fluctuating and more data is needed so a better pedagogy can be formulated. There were very few verbal comments on the survey form so it is not clear how the depth of knowledge of students can be improved. We propose to revise the format of the evaluation form. The verbal comments part is moved to the beginning of every assessed item. In so doing we expect to collect more written assessment feedback as instructors tend to skip that when the verbal input was placed at the end of the form in the past. An example of the revised assessment form will have a new look as follows.

II. Depth of Knowledge

Please rate and comment on the Depth of Knowledge part of his/her MS thesis. The rubric table below will give you a guideline on what scores to offer.

Oral Content: ______ (5: highest, 1: lowest)   

Written Content: ______ (5: highest, 1: lowest)

Subtotal for Depth of Knowledge (Oral Content and Written Content combined): ______

 

Your comment on his/her Depth of Knowledge:

 

 

Rubrics for Depth of Knowledge

 

Below Expectation

Satisfactory

Excellent

Oral Content (10)

Content is inaccurate or overly general, lacks technical and theoretical depth. (0-4)

Content is accurate, but incomplete. Audience may hear some facts but are unlikely to learn anything new. Work presented has sufficient technical and theoretical depth. (5-7)

Content is accurate and complete. Listeners are likely to gain new insight into the topic. Work presented has strong technical and theoretical depth. (8-10)

Written Content (15)

Shows minimal engagement with the topic, inadequate background and references, lacks technical and theoretical depth. (0-5)

Shows engagement with topic, not much elaboration. Offers basic observations, background, references, but few insights. Has sufficient technical and theoretical depth. (6-12)

Shows engagement with topic, presents and analyzes multiple methods, contains strong elaboration, technical and theoretical depth, offers significant insights. (13-15)

Evidence of Student Learning after Change:

 

The average scores appears to be quite consistent year after year, with perhaps a bit of improvement. However, due to the lack of verbal input on the assessment form it is difficult to identify areas where students did not achieve the depth of knowledge. We will propose a revised assessment form for future semester. Evidence of student learning with more written comment can be collected afterwards to show more clearly on evidence of student learning.

   

Average Depth of Knowledge

Semester

#

O/10

W/15

T/25

S 2011

40

8.37

12.86

21.23

F 2012

17

7.67

11.47

19.13

S 2013

29

7.70

11.78

19.48

F 2013

24

8.13

12.17

20.29

S 2014

58

8.43

12.84

21.28

F 2014

17

8.29

12.47

20.76

Average

 

8.10

12.26

20.36

(#: Total number of survey forms collected; O: Oral Part; W: Written Part; T: Total score)