Assessment

PLOs, ULGs, Map of PLOs

Academic Year 2016-2017

Department: Biological Sciences

Program: Master of Biotechnology

College: Science

Website: MBT Home Page

Contact Person: Sabine Rech, Ph.D., Sabine.rech@sjsu.edu

 X Check here. Your website addresses the University Learning Goals.

Program Acceditation: None

Date of Report: June 1, 2017

Part A

List of program learning outcomes (PLOs)

PLO1: The students will apply the five ACRL (Assoc. of College Research Librarians) standards.

The students formulate a research question, locate appropriate sources of information, evaluate information and its sources, summarize and synthesize information orally and in writing, apply ethical use of information. Students produce an NIH grant for evaluation of PLO1 outcomes.

Assessment: Instructor observation of student proficiency in writing an NIH grant proposal, term papers and presentations with the use of rubrics.

PLO2: The students will demonstrate advanced understanding of topics at the interface of biology and business central to the biotechnology industry.

Assessment: Instructor observation of satisfactory performance on written projects including an NIH research grant and a written business plan. The grant is written and refined during the first year of the program and graded by the director using the writing rubric developed by the Biological Sciences department. Also in the first year, students are required to complete worksheets in 205T that integrate hands-on laboratory biotechnology science and lab management tasks through worksheets. During the second year of the program students enter their idea into the Silicon Valley Innovation Challenge organized by the School of Business. In addition, students will complete a business plan as a team which is entered in the Business Plan competition of the School of Business. The students are also required to complete an internship in the biotechnology industry. At the end of the internship their supervisor completes an evaluation using a questionnaire provided by the director of the program.

PLO3: The students will demonstrate their ability to efficiently work in teams.

Assessment: Instructor evaluation of team projects including written papers and oral presentations. Students form teams at the beginning of the first semester and each of the core courses include multiple team projects. At the end of the first semester students assess their own as well as their team members’ ability to work in teams using questionnaires provided. The director evaluates the questionnaires. Team presentations are an integral part of all courses and are evaluated by every instructor.

PLO4: The students will demonstrate their ability to communicate effectively, verbally and written, to convey scientific and commercial ideas.

Assessment: Satisfactory completion of Biol 202TA and 202TB with a grade of B or better; instructor observation of oral presentations.

As part of the program planning, students will establish a portfolio of written assignments to allow them to assess their learning. This portfolio will include a scientific grant that is written and refined during the first year, a company analysis done as a team during the third semester and a final business plan completed during the last semester. In addition the students are required to write a final essay on their experiences during the program.

Map of PLOs to University Learning goals (ULGs)

ULG MBT PLO1 (Library skills) MBT PLO2 (Content) MBT PLO3 (Team work) MBT PLO4 (Communication)

1

X

X

 

X

      2.1

X

X

X

X

2.2

X

X

 

X

2.3

X

X

 

 

3.1

 

X

X

X

    3.2

X

X

X

X

4.1

X

X

X

X

 4.2

X

 

X

X

4.3

 

 

X

X

5.1

 

X

X

X

5.2

 

 

X

X

 

Alignment – Matrix of PLOs to Courses

 Course MBT PLO1 (Library Skills) MBT PLO2 (Content) MBT PLO3 (Team work) MBT PLO4 (Communication)

BIOL 202T

X

X

X

X

BIOL 221T

 

X

X

X

BIOL 205T

X

X

X

X

BUS 282A

X

X

X

X

BUS 282B

X

X

X

X

BIOL 285T

 

X

X

X

 

 

Planning – Assessment Schedule

Legend:

C: Data collected

I: Improvement implemented if necessary

Year PLO 1  PLO2  PLO3  PLO4  Exit Survey

2015-2016

C

 

IC

C

I

2016-2017

IC

C

 

IC

C

2017-2018

 

IC

C

 

I

2018-2019

 

 

IC

C

C

2019-2020

C

 

 

IC

I


Student Experience

Presently PLOs and ULGs are communicated to the students on the syllabi. The assessment is accessible on our website. Students are asked to write a culminating experience report (exit survey) during their last semester and the feedback presented utilized to improve the program.

Part B

Assessment Data and Results

Data for PLOs collected include reports, presentations, exams, questionnaires, grades, and assignments.  Table 1 represents the type of data that was collected this past year and used to evaluate student outcomes for the PLOs.

PLO and Outcome Measurement

PLO Outcome Measurement

PLO 1

Library Skills

  • NIH grant
  • Exit survey

PLO 2

Content

  • NIH grant
  • Business plan
  • 205T worksheets
  • Exit survey

PLO 3

Teamwork

  • Questionnaire
  • Class participation
  • Exit survey

PLO 4

Communication

  • Grade B or better in 202TA or 202TB
  • Exit survey

 

For the 2016-2017 academic year, data for PLO2 (content) was collected to demonstrate student outcomes (Table 4). Data for PLO1 and PLO4 was used to assess the changes implementation this past year.

Data for PLO2 was collected during the 2016-2017 academic year.  A cross course assessment was made for the PLO2 where students demonstrate their knowledge at the interface of business and science.  This PLO2 represents the core of the MBT program and is assessed with various assignment and projects over the year.  For first year MBT students PLO2 success was assessed using the final draft of the NIH grant which proposes a new biotech product and funding for its development. Success was determined by a grade of B or better and final presentation in the course.  Of the final grades, _____% achieved a B or better in the course. First year students also are required to take 205T Advanced Molecular Techniques which use worksheets to assess the successful completion of PLO2.  The worksheets integrate the business and biotechnology aspects of the program through evaluating the reliability and validity of scientific techniques, developing budgets for laboratory exercise, and understanding computing tools which support execution of laboratory protocols.  These worksheets integrate the industry laboratory requirements with the hands-on science of the course. Grades of a B or better on the worksheets indicates successful completion of PLO2. In 205T for 2017,  100% achieved a B or better.  In the second year, the business plan determines success for PLO2. Second year students submit ideas to the Silicon Innovation Challenge (SVIC) hosted by the College of Business.  This year 5 MBT groups submitted biotech business ideas and 5 groups were selected as finalist to present at the SVIC showcase.  These ideas are then used to produce business plans which serve as their culminating experience for the program.  The graduate advisor for the MBT program reviews all business plans and give credit for their successful completion.  This year _____% of the second year students completed the business plan.

PLO1 (Library skills) student outcomes were assessed by the completion of the NIH grant assignment and the grades in 202TA and 202TB for the 2015-2016 academic year and changes were implemented in the 2016-2017 academic year. PLO1 addresses library skills necessary for the biotechnology industry as it applies to patent research, scientific research, and product development. The NIH grant consists of a 3,000 word research proposal grant with reference section which meets the GWAR standards and is graded by the instructor. Comments are provided and a final draft is produced in the second semester of the 202T series. Successful completion of the grant as assessed by the instructor and reference section indicates student achievement of PLO1. For the 2016-2017 school year, the science librarian was asked to attend the first year students’ orientation and present a module on plagiarism. This was the only change made to ensure success of PLO1 for this academic year.

For PLO4, communication is demonstrated by the completion of the NIH grant assignment and three presentations in 202TA for the 2015-2016 academic year and changes were implemented in the 2016-2017 academic year.  Students in 202TA are required to present scientific information from three different perspectives in three different presentations.  Presentations for the NIH grant in 202TA demonstrates and trains the students to provide scientific and research focused information to an audience.  The intellectual properties part of the class requires students to present scientific information from a legal perspective while the third presentation for the course presents scientific information from a marketing perspective. Student achievement and competency is measured using the grades for both 202TA and 202TB courses which are available on MySJSU. A grade of a B or better demonstrates successful completion of PLO4. For the 2016-2017 school year no significant changes were implemented to the 202T series as all students successfully completed PLO4.

Exit surveys are given to the students during the final course of their final semester in 285T, Culminating Experience.  Students provide opinions, evaluations, and experiences based on all the coursework and projects from the program.  The professor of the course evaluates the written work and documents any criticisms, positive comments and general impressions of the program from the students.  Based on these comments, changes and future goals are developed for the future curriculum.  For the 2016-2017 academic year, the data was collected in the Spring of 2017 and will be evaluated for implementation in the 2017-2018 academic year. 

For the 2017-2018 school year, the program will be collecting information on PLO3 which demonstrates teamwork.  PLO3 (teamwork) is assessed using a student questionnaire, observations by the instructor in class participation and the exit survey.

Analysis

PLO1 and PLO4 assessments were performed for the 2015-2016 academic year and implementation of changes in 2016-2017.  Based on the professor’s assessments and grades for the NIH grants in 202TA and 202TB, all students achieved a B or better in both courses and successfully completed the NIH grant references.  At this time, PLO1 and PLO4 assignments and tasks adequately demonstrate and train students successfully in various communication approaches and library skills needed for the biotechnology industry. 

PLO2’s (content) implementation data was collected during the past academic year. Based on the resulting grades, students are successfully completing the content aspects of the MBT learning objective.

The exit survey from the 2016 class given in 285T revealed that the business professor was not effective in communicating specific ideas in the specific subject.  The professor teaching the course is assigned from the College of Business and after consultation with the College of Business, COB has provided a faculty member that aligns with the objectives of the MBT program and has begun teach in Spring 2017 for the program. Exit surveys will continue to be used to provide insight for the various courses offered and to adjust the curriculum as needed.

Proposed changes and goals

For the PLOs evaluated for this assessment, the data demonstrated student outcome success in PLO1 and PLO4.  Overall success for PLO2 has been demonstrated and minor adjustments to refine success for this outcome are being implemented. As new technology becomes available, 205T will continue to be updated to reflect advances in the industry and the worksheets in the 2017-2018 academic year will be updated including a new CRISPR module.  

The MBT program will continue to explore ways to include other approaches, tasks and supporting instruction for the skills in these PLOs.  As opportunities and resources become available, the program directors will evaluate additional guest speakers, supporting materials and support from library staff to support success of student outcomes.

Part C

Academic year 2016-2017

Proposed Changes and Goals Status Update

Teamwork module

Successful- increased teamwork

Teamwork survey

Provided necessary information for successful implementation

Guest speakers

Included new guest speakers to streamline 202TB

Changes to 205T worksheets

Developing new CRISPR module and corresponding worksheet for 2017-2018