| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Back to Sections UTPA SACS Home | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Narrative: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| There is broad-based participation in assessment activities at The University of Texas-Pan American (UTPA). At the institutional level, planning and assessment is overseen by the Institutional Planning and Assessment Committee (IPAC) The purpose of IPAC is to establish, design, and coordinate an on-going strategic planning process and institutional assessment process at UTPA. The 27-member committee is comprised of representatives from each of the 6 academic colleges, undergraduate and graduate studies offices, 6 divisions, council of academic deans, library, faculty senate, staff senate, student organizations, alumni office, as well as ex officio members from the Office of Institutional Research and Effectiveness, Academic Assessment, and a faculty member who teaches outcome directed planning. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| In FY06, IPAC dealt with several assessment issues. To oversee UTPA’s planning process at the institutional level, the committee developed a Stewardship Model that requires a team of stakeholders for each of the University's six goals annually review annual action plans and assessment reports for their support of the University’s goals, for cross-institutional collaborative opportunities, to monitor budget requests, to monitor outcomes, and to suggest changes for improvement. Documentation of IPAC’s involvement in the Stewardship Plan Monitoring Process can be found in the meeting minutes for: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Also in FY06, IPAC dealt with assessing the UTPA Compact document (a plan required by the UT System from each component) for its completeness, appropriateness, and accuracy. They prepared and reviewed the results of an online survey of campus constituents, and prepared feedback from that survey to the appropriate vice presidents for improvement. Documentation of IPAC’s involvement in the review of the UTPA Compact can be found in meeting minutes for: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| The third assessment issue undertaken by IPAC in FY06 was oversight of a Task Force researching a quality initiative to be implemented at UTPA. The IPAC member who is chairing the quality recommendation Task Force, Dr. David Sturges, gave progress reports to IPAC to keep them informed, since the quality process, when identified and implemented, will be part of UTPA’s institutional effectiveness process. Documentation of IPAC’s involvement in the quality movement can be found in the meeting minutes for: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Participation in the assessment process is facilitated at the division level through the Planning and Assessment Representatives. These individuals help units prepare their outcome directed plans, annual action plans and assessment reports, and facilitate posting of these documents on the Institutional Effectiveness website. One member represents each of the six divisions: Office of the President, Academic Affairs, Business Affairs, Enrollment and Student Services, External Affairs, and Information Technology. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Broad-based participation in assessment activities at the unit level is demonstrated by the extent of involvement of faculty and staff in the development and evaluation of measurable outcomes. The outcomes developed for FY05, FY06, and FY07 Annual Action Plans, and monitored by FY05 and FY06 Annual Assessment Reports were developed in each unit by the entire staff/faculty of a small unit or a representative group of a large unit. The names and titles of those who participated in assessment activities in FY05 and FY06 are available. A summary of the number who participated by division is included on Table 1, below. The proportion of staff involved in assessment activities in the Division of Business Affairs is the least compared to the other divisions. This is because the majority of the staff are custodial, maintenance and yard workers. These individuals were represented by supervisory personnel in the planning and assessment processes. A majority of the supervisory, managerial and professional staff in Business Affairs are involved in planning and assessment activities. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 1. Participation in Assessment Activities: FY05 through FY06 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| The UT System Compact | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Expected outcomes (performance measures) are reported to the University of Texas System. Since Spring 2004, The University of Texas System has required that each of its component institutions submit a Compact each year. Each Compact covers the next two fiscal years (beginning September 1), and contains both short-term and long-term initiatives. A Compact is a succinct written agreement between the Chancellor and a component institution president that summarizes the institution’s major goals and priorities, strategic directions, and critical issues. It describes action plans necessary to achieve important goals, summarizes the institution’s progress and outcomes, and articulates the UT System Administration’s commitment of resources and time to support particular initiatives. The Compact is submitted to the UT System Board of Regents each February, and the performance measures are reviewed as part of the UT System Chancellor’s annual evaluation session with each university president. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| The Compact includes outcome measures for the initiatives included, which mirror UTPA’s six goals. In the past, these measures were developed by OIRE and approved by the Executive Committee. In early Spring 2006, the process was expanded to include a group of faculty and staff, chosen by their vice presidents/president, who developed performance measures for the six new institutional goals that were crafted and approved in Fall 2005. Part of the review included revisiting the performance measures from UTPA’s prior Compact documents, adding new measures, and considering the use of measures that are required for other State initiatives, such as Closing the Gaps, the State Accountability System or the Legislative Appropriation Requests. The titles of the members of the Performance Measures Work Group who reviewed, revised, and recommended the progress measures to be included in the FY2007-FY2008 Compact reflect the expertise brought to this project: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| The Work Group recommended to Executive Committee 83 performance measures for inclusion in UTPA’s Compact FY 2007-2008. In May 2006, the Executive Committee (President and Vice Presidents) approved the list of recommended measures. The number of measures per goal and a sample of those measures are included on Table 2, below. The complete set of measures can be found online in UTPA’s Compact at Compact FY2007-FY2008. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 2. UTPA‘s Compact FY2007-FY2008 Performance Measures Summary | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| During the development of FY07 Annual Action Plans, units included the Compact outcome measures and supporting strategies to achieve them in their plans. Examples of this inclusion are listed here by division:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| State Higher Education Accountability System | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Expected outcomes/performance measures are reported to the State of Texas through the State Higher Education Accountability System. On January 22, 2004, Governor Perry issued Executive Order RP 31 requiring the Coordinating Board and each institution and system work together to provide “the information necessary to determine the effectiveness and quality of the education students receive at individual institutions” which will serve as “… the basis to evaluate the institutions’ use of state resources.” UTPA’s latest report was submitted to the State in December 2005. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Included in the Accountability System are outcome measure targets developed annually by institutional representatives with the Texas Higher Education Coordinating Board (THECB) staff. UTPA’s Executive Director for Institutional Research and Effectiveness is the THECB liaison. The targets are set for sets of institutions according to mission: research, doctoral, comprehensive, master’s, baccalaureate. UTPA is in the comprehensive category. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| This Accountability System is populated by data from required reports submitted by higher education institutions to the Texas Higher Education Coordinating Board and a few variables submitted by the institution, such as the number of endowed professorships and chairs, members of national academies, number of faculty with external grants, and total dollar value of the endowment. The Accountability System is maintained by the Coordinating Board. It is used by UT System officials to track progress against targets. It is used by legislators during the biennial legislative appropriations cycle to answer their questions about public 4-year higher education institutions. It is used by members of the public to increase their awareness of the performance of the institutions for which they pay taxes. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| One example of an outcome measure with a comprehensive group target is the federal research expenditures per fulltime equivalent faculty. The target for the group is a 10% increase from FY2004 to FY2007. Table 3, below, displays a sample from the Accountability System showing UTPA’s FY2004 baseline of $7,364, which would increase to $8,101 by FY2007 to meet the group target. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 3. UTPA Sample Posting from the State Accountability System | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 4 displays the complete list of the measures monitored by the State of Texas in the Higher Education Accountability System. There are 53 measures in the areas of student participation and success, academic excellence, institutional research productivity, and institutional efficiency and effectiveness. The 23 “Key Measures” are those for which targets are developed by institutional grouping. The 30 “Contextual Measures” are included to explain performance on some key measures, or to provide more detail regarding the institutional mission within the context of the measures discussed. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 4. Accountability Measures: Public Universities | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Legislative Budget Board Report | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Every two years, the institution submits its Legislative Appropriations Request for the next biennium. In that request, the institution includes past actual data and future projections for a set of performance measures. Strategies in terms of budget allocations are included to address the performance measure projections. These data serve as discussion points with the Legislative Budget Board, which reviews the budget requests. The institutional outcomes/performance measures projected include:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| UTPA’s LBB Performance Measures for the FY07 and FY08 biennium was submitted to the State in August 2006 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Use of Major Institutional Level Programmatic Outcomes | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Major institutional programmatic outcomes are assessed, reviewed, and used for improvements. These measures are in unit action plans and assessment reports, Compact performance measures, and a few are tracked in the State Higher Education Accountability System. The following discussion focuses on four major outcomes: first-year retention, six-year graduation rates, graduate semester credit hour productivity, and research and sponsored projects productivity. These outcomes are discussed in relationship to the university goal it supports. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| GOAL: Provide students a quality educational experience that enables them to complete their educational goals in a timely fashion. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| The two major outcomes associated with this goal are first-year retention and 6-year graduation rates. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| First-Year Retention | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| First-year retention rates are monitored annually at UTPA when certified data is available from the Coordinating Board in the early Fall. These rates are also monitored by UT System Board of Regents through the annual Accountability and Performance Reports, and through the Compact reports. On the State level, these outcomes are monitored via the Higher Education Accountability System | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 5 displays the first-year retention rates at UTPA for the entering classes of Fall 2000 through Fall 2004. The right hand column contains the target for the retention of freshmen who entered in Fall 2005 and continued in Fall 2006. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 5. First-Year Retention | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Recent improvements in administrative units to increase the first-year retention rates to achieve the target include: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| FY2005 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| FY2006
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Examples of interventions included in FY07 Action Plans to improve first-year retention are reflected on Table 6, below. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 6: Selected AY07 Interventions to Improve First-Year Retention | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Six-Year Retention | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Six-year retention rates are monitored annually at UTPA when certified data is available from the Coordinating Board in the early Fall. These rates are also monitored by UT System Board of Regents through the annual Accountability and Performance Reports, and through the Compact. On the State level, these outcomes are monitored via the Higher Education Accountability System. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Graduation rates have become an issue with the UT System Board of Regents as evidence by a resolution passed at their February 2006 meeting to improve graduation rates at UT System academic institutions. The targets for improving graduation rates at UT System institutions, and UTPA in particular, were reported at the May Board meeting. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| UTPA’s graduation targets are set to equal the average for all public 4-year institutions in the United States. These targets, which are monitored annually by UTPA and the UT System, are displayed on Table 7. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 7: UTPA’s Graduate Targets | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 8 displays the six-year retention rates at UTPA for the entering classes of Fall 1993 through Fall 1999. The right hand column contains the target for the graduation of freshmen who entered in Fall 2004 and graduated in FY2010. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 8. Six-Year Graduation Rates | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Recent improvements in administrative units to increase the 6-year graduation rates to achieve the target include: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| FY2005 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| FY2006 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Examples of interventions included in FY07 Action Plans to improve six-year graduation rates are reflected on Table 9, below. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 9: Selected AY07 Interventions to Improve Six-Year Graduation Rates | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| GOAL: Become an outstanding research institution, emphasizing collaborative partnerships and entrepreneurship. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| The two major outcomes tracked regarding this goal are: increase graduate SCH, and increase research and sponsored projects dollars received. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Proportion of Semester Credit Hours at the Graduate Level | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| The proportion of semester credit hours (SCH) at the graduate level is monitored annually at UTPA when certified data is available from the Coordinating Board in the early Fall. This data is also monitored by UT System Board of Regents through the annual Accountability and Performance Reports, and through the Compact reports. On the State level, these outcomes are monitored via the Higher Education Accountability System. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 10 displays the proportion of semester credit hours generated at the graduate level for the Fall semesters indicated. The right hand column contains the target for the Fall semester of 2010. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 10. Proportion of SCH at the Graduate Level | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Recent improvements in administrative units to increase the proportion of SCH at the graduate level to achieve the target include: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| FY2005 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| FY2006 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Examples of interventions included in FY07 Action Plans to increase the proportion of SCH at the graduate level are reflected on Table 11, below. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 11: Selected AY07 Interventions to Increase Proportion of Graduate SCH | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Research and Sponsored Projects Dollars Received | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| The total amount of research and sponsored projects dollars received is monitored annually in late Fall after the Annual Financial Report is completed. The Office of Sponsored Projects and Research set a target of a $1 million dollar increase per year. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 12 displays the total amount of research and sponsored projects funding received for the fiscal years indicated. The right hand column contains the annual target for the near future. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 12. Research and Sponsored Projects Dollars Received | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Recent improvements in administrative units to increase the total amount of research and sponsored projects dollars received to achieve the target include: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| FY2005 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| FY2006 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Examples of interventions included in FY07 Action Plans to increase research and sponsored projects dollars received are reflected on Table 13, below. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 13: Selected AY07 Interventions to Increase Research and Sponsored Projects Dollars Received | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| In addition to these outcome measures, UTPA has a set of Key Performance Indicators that act as a “report card” to indicate how well the institution is performing in five key areas: students, admissions, finance, faculty, and financial aid. These 25 indicators are monitored on an annual basis by the President’s Council. Targets are developed for some but not all these indicators – for retention and graduation rates, for instance. The indicators that display a negative change from one year to the next are investigated. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Educational Programs | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| The University of Texas-Pan American has been engaged in the process of identifying and assessing expected student learning outcomes for all its educational programs for many years. Through the process of Program Review, each educational program has examined the student learning outcomes and made improvements as needed. Since Fall 2000, UTPA has become more focused on continuous improvement, and has developed a more systematic process for assessing expected student learning outcomes in all educational programs. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Systematic assessment of student learning outcomes in the general education (core curriculum) was the first to be conducted. A description of that process may be found in Criterion 3.5.1. During the Fall 2003 semester, every educational program developed Assessment Plans to systematically guide the process for assessment of student learning outcomes in each major. Through facilitation from the Associate Vice Presidents for Undergraduate Studies and Graduate Studies, the faculty in each program reviewed, revised, and/or identified new student learning outcomes for each educational program. The faculty also identified direct and indirect means of assessing/measuring the outcomes, as well as set criteria for success. Procedures for how assessment was to be conducted were also developed. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| To date, 65 undergraduate programs and 41 graduate programs have developed Assessment Plans that describe the student learning outcomes expected for the major, the direct and indirect means by which the outcomes will be assessed, and the criteria for success expected. At the end of every fall and spring semesters, all students graduating in every undergraduate and graduate program are assessed. A report describing the results of the assessment and improvements made to the program as a result of assessment is generated by each program coordinator, discussed with faculty in the program, the department chair, and the dean of the college. The faculty analyzes the results and identifies improvements that need to be made to the curriculum design, courses, faculty assignments, and/or assessment processes and procedures. A copy of the report is submitted to the Provost/Vice President for Academic Affairs through the Associate Vice Presidents for Undergraduate and Graduate Studies. Assessment Plans and Assessment Reports of student learning outcomes for all educational programs may be found on the Institutional Effectiveness website. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Assessment of learning for all students graduating was conducted in a systematic manner for all educational programs during Spring 2005, Fall 2005 and Spring 2006. Summarizing the results of the total number of reports is too voluminous to address here. However, below are examples of identified student learning outcomes in each of the six colleges at UTPA, the process use to assess the SLOs, the results of the assessment, and the improvements made based on the results. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Assessment in the College of Arts and Humanities | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Bachelor of Arts (B.A.) in English and Teacher Certification | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| In the College of Arts and Humanities, the faculty have refined the expected student learning outcomes in the B.A. in English and English Language Arts 4-8 and 8-12 Teacher Certification over the course of two academic years as a result of assessment. The Intended Student Learning Outcomes (SLOs) for the B.A. in English and Teacher Certification are as follows:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| To assess SLO 1, a direct measure of learning is utilized. English majors enrolled in 3000 and 4000-level English courses and graduating in May/August or December are asked to submit an essay completed in any upper division English class during their tenure as English majors at UTPA. The essay must fit one of the following descriptions: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Students are advised to submit essays that represent their best work. A team of faculty graders from the English department scores the essays using a rubric developed by the English faculty. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| The criteria for success set by the faculty were that at least 80% of graduating seniors must score “satisfactory” or higher in the following four traits: (1) organization/ development; (2) analysis of texts/topics/sources; (3) rhetoric/audience; (4) writing style. Each essay was assigned a score from 1-4 by two graders, with 4 designated High Pass, 3 designated Pass, 2 designated Low Pass, and 1 designated No Pass. The 2 rating was set as the lowest satisfactory score. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| During Spring 2005, 58 graduating students submitted an essay for scoring; during Fall 2005, 27 graduating students were assessed, and 69 were assessed in Spring 2006. Table 14 depicts the results of assessment for three semesters. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 14: Assessment of Student Learning Outcomes for B.A. in English | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| As can be noted, the assessment results for SLO 1 indicate that the criteria for success were not met for the Spring 2005 semester. Based on these results, the English faculty made several improvements/changes:(1) training/discussion sessions for faculty to coordinate expectations in analytical assignments; and (2) faculty worked with students in improving drafts of major papers in upper division courses prior to submission for a grade. (The consensus among the four readers was that most of the papers submitted for assessment could have been rated 3s and 4s in all categories had the writers been given more direction during the drafting stage.) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| In Fall 2005, the results indicated a significant improvement as compared to results of Spring 2005 semester. The criteria for success were met. During the 2005-2006 academic year, the English faculty revised the scoring rubric, restructured the entire B.A. in English degree with a focus on creative writing, hired three new faculty in creative writing, and gave two faculty members 25% release time each to coordinate assessment efforts in the department and follow up on improvements. In Spring 2006, the assessment results met and exceeded the expected criteria for success. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| To assess SLO 2, English majors seeking certification to teach English language arts and reading at the public school 4-8 middle school level or 8-12 high school level are required to take the English Language Arts/Reading Texas Examination of Educator Standards (TExES), a standardized state examination. The TExES is scored by a national testing firm. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| The results for assessment of SLO 2 for students pursuing teacher certification indicated that 100% of graduating students (N=18) who took the English Language Arts/Reading content TExES examination in Spring 2005 passed it. No students took the test in Fall 2005 or Spring 2006. During 2005-2006 academic year, the English Education Committee in the English department conducted review sessions to prepare students for the exam experience, posted information about TExES on the English Department web site and contacted all students in English certification programs (4-8 and 8-12 certification degree plans) via letters and email to inform them of TExES eligibility requirements, and held individual review conferences with students registered to take the TExES. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| To assess SLO 3, a student satisfaction survey, an indirect measure of student success, was used. In April 2005, student satisfaction surveys were sent to all graduating seniors for 2005 (76 seniors). An additional 80 surveys were sent to students who graduated between 2001 and 2004. As of late May 2005, 44 graduating seniors and three 2002-2004 graduates had responded. Ratings in the 4 (good) and 5 (excellent) categories ranged from 98% for the category “your overall English classroom experience” to 78% for “The English Department’s advisors for teacher certification.” The average for responses in the 4 and 5 ratings was 89%. In the Fall 2005 semester, 80% of students responded in the 4 and 5 categories to survey questions. Twenty-eight (28) graduating seniors (54% of the students who graduated in Fall 2005) completed and submitted surveys either online or in writing. In the Spring 2006 semester, the results indicate that 80% of the graduating students (56) responded in the 4 and 5 categories to survey questions. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Based on the results of the survey, the English department made several improvements in the assessment: (1) The Student Satisfaction Survey was placed on line. (2) The English Program’s Assessment Committee reviewed the open-ended responses to determine trends and to suggest overall program improvement. (3) The Student Satisfaction Survey was revised to yield more useful information for departmental program improvement and to reflect previous respondents’ recommendations and to create items that elicit more specific data on the way that the department contributes to student satisfaction. (4) A detailed report of survey results was prepared for deliberation by the English Programs Assessment Committee. (5) The English Department Assessment Coordinator distributed results of the survey to the Department of English Chair and appropriate Program Coordinators and Committee Chairs. (6) Information on degree requirements, certification requirements, and English careers was updated on the Department of English Web Site and on Department classroom bulletin boards. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Master of Arts (M.A.) in History | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| The M.A. in History has identified the following as the expected student learning outcomes for its program. The student will: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Table 15: Assessment of Student Learning Outcomes for M.A. in History | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| The program is primarily an evening program that consists of part-time students; therefore, enrollment in graduate degree programs is small. Few students graduate each semester/year. As a result of program review and assessment, the History department is focused on implementing strategies for recruitment of students into the graduate program. One of the goals for UTPA is to increase the number of graduate programs and the number of students pursuing graduate studies. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Assessment in the College of Business | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Bachelor of Arts (B.A.) in Business Administration with a Major in Economics | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| In the College of Business Administration, the faculty in the Department of Economics identified the following student learning outcomes for the B.A. in Economics: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||