2020-21 CAEP Standard 4.2 Impact and Outcome Measures

These measures relate to our programs accredited by the Council for the Accreditation of Educator Preparation.

 

We are currently preparing for our upcoming CAEP accreditation review. We will be updating this section as that process continues.

Responses to the MSU—Bozeman Teacher Preparation Program Spring 2023 Survey

Map with twenty-one markers across Montana and one in Salt Lake City

Locations where surveys were completed according to reported longitude and latitude data.

Please indicate the type of school which you currently lead.
Please select the option(s) which is most representative of your school.

N

N
Reply*

[no response]

 1 0

Elementary P/K-5

 11 6

Elementary P/K-5, Middle School 6-8, High School 9-12

 1 1

Elementary P/K-8

 6 5

Elementary P/K-8, Middle School 6-8

 1 1

Middle School 6-8

 6 4

Middle School 6-8, High School 9-12

 3 2

High School 9-12

 9 9

Full District P-12

 10 8

Totals

 48 36

 

Please identify grade band in which your teacher(s) is assigned.
Choose all that apply.

N

N
Reply*

[no response]

 1 0

Preschool P, Elementary K-5

 3 2

Preschool P, Elementary K-5, Middle School 6-8

 1 1

Elementary K-5

 17 10

Elementary K-5, Middle School 6-8

 5 5

Elementary K-5, Middle School 6-8, High School 9-12, K-12 Subject-specific

 1 1

Elementary K-5, High School 9-12

 1 1

Middle School 6-8

 4 2

Middle School 6-8, High School 9-12

 5 4

High School 9-12

 9 9

K-12 Subject-specific

 1 1

Totals

 48 36

*Surveys links were emailed to 133 school adminstrators known to have hired MSU graduates. Of those, 48 began the survey, while 36 completed the evaluative questions.

Nineteen items were evaluated on a scale from Very Satisfied (1) to Very Unsatisified (4). Note that lower scores indicate more satisfaction.

Seventeen respondents evaluated our graduates with a mean Very Satisfied (1.00 to 1.47) including five respondents evaluating our graduates with Very Satisfied on all nineteen items.  Eighteen respondents evaluated our graduates with a mean Somewhat Satisfied (1.53 to 2.39). One respondent evaluated our graduates with a mean Somewhat Unsatisfied (2.53).

The most common response from all respondents on all items was Very Satisfied.

1 Very Satisfied 340
2 Somewhat Satisfied 265
3 Somewhat Unsatisified 70
4 Very Unsatisfied 4

 

The overall mean from all respondents on all items was Somewhat Satisfied.

N Mean SD
679 1.61 0.69

 

The mean scores on each of the nineteen items were as follows:

Question N Mean SD

Design instruction based on learners’ development.

 36 1.58 0.69

Differentiate instruction effectively for English Learners (EL).

 34 1.91 0.75

Collaborate to meet the learning needs of all students.

 36 1.47 0.61

Actively engage students in learning.

 35 1.57 0.70

Respond productively to negative behavior.

 36 1.78 0.76

Purposefully use instructional technology.

 35 1.29 0.46

Demonstrate accurate content knowledge.

 36 1.39 0.60

Encourage critical thinking for problem solving.

 36 1.64 0.59

Analyze assessment data to improve the effectiveness of instruction.

 36 2.03 0.81

Plan instruction based on knowledge of students in their community context.

 36 1.83 0.74

Implement instruction aligned with Montana State Content Standards.

 36 1.36 0.49

Use a variety of instructional strategies.

 36 1.64 0.64

Participate in ongoing professional development opportunities.

 36 1.53 0.61

Reflect on how instructional choices affect students.

 36 1.75 0.73

Respect beliefs, norms, and expectations of families.

 35 1.54 0.74

Apply knowledge of the legal responsibilities of teachers.

 36 1.56 0.77

Initiate professional conversation with supervisors.

 36 1.61 0.60

Engage with colleagues in a professional manner.

 36 1.44 0.61

Accurately incorporate the 7 Essential Understandings of Indian Education for All.

 36 1.75 0.81

 

      

 

We are currently preparing for our upcoming CAEP accreditation review. We are be updating this section as that process continues.

We are currently preparing for our upcoming CAEP accreditation review. We are be updating this section as that process continues.

We are currently preparing for our upcoming CAEP accreditation review. We will be updating this section as that process continues.

The earlier version of this page follows.

  • Agricultural Education, Broadfield Teaching
  • Art: Art Education K-12 Broadfield
  • Biological Sciences: Teaching
  • Chemistry: Teaching
  • Elementary Education: K-8
  • English: Teaching
  • Family and Consumer Sciences: Teaching
  • Health and Human Development: Health Enhancement K-12
  • History: Teaching
  • Library Media Certificate
  • Master of Education - Curriculum & Instruction - Professional Educator with Library Media Core
  • Mathematics: Teaching
  • Modern Languages & Literatures
    • French Teaching
    • German Teaching
    • Spanish Teaching
  • Music Education: School Music K-12 Broadfield
  • Physics: Teaching
  • Principal Preparation
  • Secondary Education: General Science Broadfield
  • Secondary Education: Social Studies Broadfield
  • Superintendent Certificate, Superintendent Preparation
  • Technology Education: Broadfield Teaching

We are in the final stages of a case study investigating teachers’ perceptions and experiences of incorporating Montana Indian Education for All into instruction.

A. Participant Recruitment

Reservation Teachers – teaching within 50 miles of a reservation
Eleven teachers were identified as potential case study participants.Of those eleven:
  • 2 chose not to participate
  • 3 have been contacted but not responded
  • 6 agreed to participate
    • 4 have been interviewed or have returned a survey
    • 2 have been contacted several times since agreeing but have not responded
Non-reservation Teachers28 teachers were identified as potential participants from the list provided by OPI  - there was sufficient data to determine their school, grade and subject, if there was one.Of the 28 teachers:
  • 16 teachers of the 28 larger group were selected to contact about participation in this research. The 16 teachers were chosen to for a wide representation of grades, size of town and school, and geographic range across Montana.
A group of 11 was selected out of the 16 - for a similar number as the reservation teachers.Of the 11 Non-reservation teachers contacted:
  • 5 responded
    • 2 chose not to participate
    • 3 agreed to participate
      • 2 have been interviewed
      • 1 person has not decided on whether to interview or write her survey answers

B. Data Collection Summary, at this point

  • 3 recorded interviews and one written survey from reservation teachers.
  • 2 recorded interviews from non-reservation teachers.
  • Artifacts from most of those teachers and will collect the others.

C. Analysis

Code the interview/surveys in NVivo, using the survey questions as initial themes, and look for emerging themes from the interview data.

Indicator (mean scores reported in the aggregate, 1-3 scale/% pass rate)

InTASC / PEPPS (Montana State Standards Alignment)

 2016-2017 Completers 2017-2018 Completers 2018-2019
Completers		 2019-20 Completers
Signature Assignment 1 - Indian Education for All Lesson Plan 2 2.59
(95.9%)		 2.64
(95.5%)		 2.81
(97.1%)		 2.85
(96.5%)
Signature Assignment 2 - Development 1 2.95
(100%)		 2.90
(97.9%)		 2.91
(100%)		 2.95
(100%)
Signature Assignment 3 - Assessment 6 2.92
(98.3%)		 2.97
(100%)		  2.90
(98.9%)		 2.84
(97.1%)
Signature Assignment 4 -Relationships 10 2.97
(99.4%)		 2.97
(100%)		  2.95
(100%)		 2.92
(99.3%)
Signature Assignment 5 -Communication/Instructional Media  9 2.69
(97.5%)		 2.71
(98.0%)		 2.72
(98.8%)		 2.67
(96.2%)
Signature Assignment 6 - Planning 7 2.78
(97.5%)		 2.82
(95.8%)		 2.76
(96.9%) 		 2.68
(97.1%)
Signature Assignment 7 - Pedagogy 8 2.89
(98.8%)		 2.90
(98.1%)		  2.92
(99.4%)		 2.89
(97.7%)
Signature Assignment 8 -Reflection 9  2.85
(98.8%)		 2.88
(99.3%)		 2.88
(99.4%)		 2.83
(99.0%)
Reflective Educator Project 1-10 N/A N/A N/A   
Praxis II Exam
Mean % of MT Passing Score
(Licensable at 100% of MT Passing Score)		 4 107%
(86%)		 110%
(89%)		 109%
(88%)		 Data Coming Soon
Employer Survey* 1-10 N/A 89% Very/Somewhat Satisfied
11% Very/Somewhat Unsatisfied		    
Completer Survey* 1-10 N/A 17% Very Effective
13% Not Effective		    

*All Montana EPPs reported in the aggregate per MT statewide protocol agreement with CAEP.

Survey sent to Montana employers N=362

Responses included:

  • N=132 started (36.4%)
  • N=125 completed (34.5%)

Survey results are reported in the aggregate for all Montana EPP completers as per our statewide protocol agreement with CAEP.

Somewhat
+ Very
SATISFIED		 Somewhat
+ Very
UNSATISFIED		 Area of Professional Preparation
96% 4%   1. Design instruction based on learners’ development.
87% 13%   2. Differentiate instruction effectively for English Learners (EL).
94% 6%   3. Collaborate to meet the learning needs of all students. 
94% 6%   4. Actively engage students in learning.
82% 18%   5. Respond productively to negative behavior.
95% 5%   6. Purposefully use instructional technology.
95% 5%   7. Demonstrate accurate content knowledge.
89% 11%   8. Encourage critical thinking for problem solving.
80% 20%   9. Analyze assessment data to improve the effectiveness of instruction.
87% 13% 10. Plan instruction based on knowledge of students in their community context.
92% 8% 11. Implement instruction aligned with Montana State content standards.
90% 10% 12. Use a variety of instructional strategies.
96% 4% 13. Participate in ongoing professional development opportunities.
85% 15% 14. Reflect on how instructional choices affect students.
94% 6% 15. Respect beliefs, norms, and expectations of families.
86% 14% 16. Apply knowledge of the legal responsibilities of teachers.
87% 13% 17. Initiate professional conversation with supervisors.
90% 10% 18. Engage with colleagues in a professional manner.  
80% 20% 19. Accurately incorporate the 7 Essential Understandings of Indian Education for All.
89% 11% Average
20. Please share any additional comments regarding your satisfaction with the PREPARATION of your teacher for professional teaching responsibilities. (Redacted for anonymity.)

Survey sent to Montana State University completers: N=389 (2014-15; 2015-16; 2016-17)

  • N=104 started
  • N=90 completed (23% response rate)

Very
EFFECTIVE		 Not
EFFECTIVE		 Area of Professional Preparation
12% 6%   1. Design instruction based on learners’ development.
1% 43%   2. Differentiate instruction effectively for English Learners (EL).
12% 8%   3. Collaborate to meet the learning needs of all students. 
22% 4%   4. Actively engage students in learning.
7% 26%   5. Respond productively to negative behavior.
22% 8%   6. Purposefully use instructional technology.
33% 6%   7. Demonstrate accurate content knowledge.
14% 10%   8. Encourage critical thinking for problem solving.
13% 17%   9. Analyze assessment data to improve the effectiveness of instruction.
8% 13% 10. Plan instruction based on knowledge of students in their community context.
30% 6% 11. Implement instruction aligned with Montana State content standards.
27% 4% 12. Use a variety of instructional strategies.
28% 13% 13. Participate in ongoing professional development opportunities.
16% 6% 14. Reflect on how instructional choices affect students.
14% 13% 15. Respect beliefs, norms, and expectations of families.
10% 18% 16. Apply knowledge of the legal responsibilities of teachers.
11% 20% 17. Initiate professional conversation with supervisors.
19% 6% 18. Engage with colleagues in a professional manner.  
17% 18% 19. Accurately incorporate the 7 Essential Understandings of Indian Education for All.
13% 7% 20. How relevant was your preparation for the responsibility you confront on the job?
17% 13% Average

 

Level

Completers

Initial (undergraduate TEP and post-baccalaureate completers)

174

Advanced (added endorsement programs and K-12 Principal/K-12 Superintendent licensure)

100

Level

2018 Completers

2018 Institutional Recommendations for Initial Licensure or Endorsement

Percentage qualified

Initial

174

 

 

Advanced

100

 

 

The Montana Department of Labor and Industry has information and resources about the teacher job market, and the Montana Office of Public Instruction provides a job board. Prospective applicants can also contact school districts directly. Graduates intending to teach in states other than Montana should inquire with that state’s education and labor agencies

Gainful Employment Disclosures

Financial Aid

Montana State University’s loan default rate is 5.3% (2017, most recent information available). This can be confirmed by these steps:

  1. Go to the Federal Student Aid Default Management site.
  2. Click the Search Database button.
  3. Enter 002532 in the OPE-ID field.
  4. Click the Search button.
  5. On the search results page, click Montana State University Bozeman.