Return to Archives
Return to Article Summaries
Spring-Summer 2008, Vol. 7, Issue 3
HOW LIVETEXT HELPS HIGHER EDUCATION INSTITUTIONS MANAGE AND AUTOMATE
ACCREDITATION PROCESSES
by George Lorenzo
Back in July of 2006 I wrote about LiveText being adopted at Sonoma
State University’s (SSU) Department of Literacy Studies and Elementary
Education (see
http://www.edpath.com/2006/0706/070603.htm).
The educators at SSU explained how the LiveText tool worked well for
integrating digital video and images inside electronic portfolios
(eportfolios). LiveText’s partnership with unitedstreaming™, a web-based
digital video delivery system that provides access to the largest and
most current library of K-12 core-curriculum digital videos, was one of
the features that SUU liked. They also liked that LiveText software
could generate a variety of reports, based on data from their students’
LiveText eportfolios, which allowed them to take a closer look at what
their department was accomplishing.
Since then I have learned that LiveText is much more
than a provider of eportfolio tools. LiveText is a provider of a
flexible, multi-faceted accreditation management system for developing,
assessing, and measuring student learning. In addition to its
partnership with unitedstreaming, LiveText has developed partnerships
with the International Assembly for Collegiate Business Education
(IACBE), the Association of Collegiate Business Schools and Programs
(ACBSP), and the Western Association of Schools and Colleges (WASC).
Company History LiveText evolved
during the mid 1990s out of its development of a course management
system (CMS)for the K-12 sector. By the late 90s, Co-founder Robert
Budnik, along with three other co-founders at that time, decided to
reengineer their CMS to be an accreditation management system for
schools and colleges of education, based primarily on National Council
for Accreditation of Teacher Education (NCATE) standards.
"We decided to help higher education automate this accreditation
process," Budnik explains. "So, we went to every NCATE accreditation
workshop. We sent our programmers. We sent everybody that we could
within the company to better understand the accreditation process. [In
addition], we visited with institutions to learn more, to see their
documentation and to understand their processes."
By January 2000, LiveText sponsored the general session at the
American Association of Colleges for Teacher Education (AACTE)
conference. Budnik gave a presentation. "I got up in front of 1,500
people at the general session, introduced LivText and asked them to
please stop by our booth if they were interested in learning more. Over
the next two days I never sat down. We had hundreds of deans coming up
to us saying ‘this is exactly what we need.’"
What All Accrediting Agencies Have in Common
According to Budnik, LiveText today has 450 institutional clients.
In 2004, the company started to branch out into other disciplines. "We
started looking at the institution as a whole and at other colleges,
such as colleges of business, nursing, health sciences, pharmacy and
engineering - all these other programs," Budnik says. This became the
impetus of a research project to discover what all accrediting agencies
had in common. The end result was a grid with six common components that
every accrediting agency is looking for - "what we call six guiding
principles," he explains.
They are:
- Accrediting agencies want to see that institutions have missions
and goals that are being accomplished.
- Accrediting agencies want to see that institutions have
academically and/or professionally qualified faculty.
- Accrediting agencies want to be assured that students are
learning and getting more than just a grade.
- Accrediting agencies want to see that curriculum instruction is
aligned to the institution’s missions, goals and learning
objectives.
- Accrediting agencies want to see that there is an effective
assessment planning process in place internally.
- Accrediting agencies want to see that the institution is
effectively utilizing its finances/resources.
"We have a suite of tools that address the six guiding principles for
accreditation," Budnik says.
Meeting Missions and Goals
Revealing how an institution meets its missions and goals can be
accomplished with the LiveText Forms tool that allows users to create
survey, evaluation and data collection forms for a variety of purposes.
Surveys of alumni and their employers, current students, and the local
community, for example, can be created in order to seek out information
related to whether or not institutional and/or program missions and
goals are being met.
In addition, a number of LiveText Review and Assessment tools,
including eportfolio-production tools, can be utilized to assess student
learning and create reports directly related to institutional missions
and goals.
Qualified Faculty The LiveText
Forms tool can also be utilized to inform accrediting agencies about an
institution’s academically and/or professionally qualified faculty.
Qualification forms and annual surveys can be completed by faculty, and
housed in the LiveText system, as a means to keep faculty credentials
and accomplishments updated on a regular basis.
Additionally, faculty eportfolios can be developed and consistently
maintained with the LiveText eportfolio tools.
Assurance The third, fourth and
fifth aforementioned guiding principles are closely related to each
other and represent great and numerous challenges institutions typically
face during accreditation processes. Assurance of student learning (#3)
emphasizes both direct and indirect measures.
Direct measures, such as results from Educational Testing Service
(ETS) exams, can be imported into the LiveText system from a campus
student information system (SIS) and correlated to learning outcomes and
then benchmarked to other factors, both demographic and test-related
(see "Reporting" below). Authentic assessments, such as those that have
rubrics based on learning outcomes, are another important facet for
providing direct measurements to accrediting agencies.
Indirect measures, says Budnik, are typically based on surveys and
are often self-evaluation or peer-review oriented measurements.
Alignment In relation to
curriculum instruction being aligned to institutional missions (#4),
Budnik explains how the LiveText system includes a library of learning
outcomes that can be aligned to courses. "Typically they will bring out
the course number and the learning outcomes that reside in our system
and map the two together," he says. "Then, on a periodic basis they go
back in and evaluate their curriculum to see if it is actually meeting
what the defined learning outcomes are in relation to the institution’s
mission and goals."
Evidence
Overall, most institutions struggle with how
to provide the appropriate evidence of student learning for their
accreditation visits. Budnik says that when an institution approaches
his company, or vice versa, the early discussions typically focus on
discovering what learning objectives and outcomes need to be measured
and at what levels. He explains that there are basically three
overarching options to take under consideration when building the
structure for providing evidence of student learning:
- Assessing Students Holistically
- This can be where students
build eportfolios, with artifacts (some attached to grading rubrics
and some not attached to rubrics) related to their learning
accomplishments and development of their knowledge and skills over
time, throughout their undergraduate and/or graduate education. Such
eportfolios essentially house a gold mine of student learning
evidence that can be aggregated and desaggregated for numerous types
of program, course and institution-wide analysis related to
accreditation as well as for continuous improvement processes.
Assessing Signature Assignments
- Relatively large and typically cumulative, end-of-degree projects
and assignments, such as practicums, capstones, patient health care
plans, etc., frequently fall under this category. In some cases, a
structured eportfolio is utilized to record evidence of student
learning related to these signature assignments, such as when
teacher candidates collect and show artifacts aligned to education
standards and their student teaching experiences. In other cases,
elements such as systematic reviews, essays, test results, research
papers, case study-related projects, various formative and summative
assessments, etc. are collected and analyzed independent of a
structured eportfolio or standards.
Course-Embedded Assessments
- As the name implies, these are simply courses that have some level
of assessment embedded in them. Oftentimes assessment data gathered
from a variety of courses in a variety of disciplines can be
utilized for revealing learning outcomes related to, for instance,
communication skills, critical thinking skills or analytical skills.
Planning
Assessment planning (#5) takes into
consideration academic and non-academic departments. "Every department
at an institution is suppose to have an assessment plan," Budnik says.
"It does not matter if you are the grounds facility manager or the
college of business - academic or non-academic - you must have a plan
with strategic goals. You publish that plan in our system, and then an
assessment committee at the institution will bring up that plan and
assess it. They do authentic assessment and comment on the assessment
plans. They do summative and formative evaluation. They basically build
the plan in our system, manage the plan in our system and assess the
plan in our system."
How It Works Budnik further
explains how many of the assessment-oriented features and functions work
inside LiveText. First, educators define and align learning objectives
to rubrics. "We teach them how to build rubrics and make those
alignments in our system. Most likely they have identified specific
courses in which a portfolio is going to be used, or where a
course-embedded assessment is going to occur. LiveText has the ability
to import those courses in from the campus-wide student information
system."
The imported course listings can be displayed inside both faculty and
administrative views within the LiveText interface. Here faculty and
administrators can see the entire class roster, along with views of each
student’s extensive eportfolio submissions and the results of
course-embedded assessments and assignments that he/she has built up
inside their personal LiveText student view/interface. Plus, data
resides in the background - or what’s referred to as query points by
LiveText - that have been imported from the SIS when the course was
added.
Faculty login to LiveText and see these imported courses with rosters
aligned to student portfolios, assessments, assignments and more. From
this point they are able to take advantage of a robust system with
numerous functions and features, including the ability to conduct and
record formative and summative evaluations, with or without rubrics, of
each student’s work.
Reporting In relation to the
reporting features available in LiveText, administrative-enabled users
can login to extrapolate and analyze data at the individual [student or
faculty], program, unit and institutional levels within the LiveText
system. The reporting features and functions allow users to retrieve
data based on standards, outcomes or competencies. "You can extrapolate
a lot," Budnik says. "From the reporting point of view not only did we
import course rosters and the faculty associated with the courses, we
have also imported student demographic data. We basically have three
different imports inside LiveText: catalog import, course roster import
and student profile import. In the student profile import we have
brought in test data, gender, age, etc. The user has a bunch of query
tables where he or she can see, for example, all students who were
assessed against a communication learning outcome that have a 3.5 or
greater GPA. I can export the data or it will give me a simple table
inside LiveText that will reveal if there is a correlation between GPA,
race and gender [for that particular communication learning outcome]."
Additionally, users can generate inter-rater summary reports where
they can view results and patterns related to how multiple faculty
members have used the same rubric. So, for example, if a certain number
of students with high GPAs suddenly scored low in critical thinking,
Budnik explains, "what does that tell you? It could mean that the
professor(s) assessing those students did not use the rubric. Or maybe
the rubric or the learning object that was developed is not right."
Users can further customize reports using a variety of LiveText
filters, as well as export data out to a third-party program. "When you
start going toward institutional effectiveness, they are typically using
SPSS or SAS [statistical software packages], and they have other data
they are tracking somewhere else," Budnik explains. "They export out the
raw data from LiveText and put it inside their SPSS or SAS model and
then marry the two together for further detailed reporting."
Finances and Resources Finally,
the sixth guiding principle - about the utilization of finances and
resources - "is the most challenging one for us to accommodate," Budnik
says. Institutional resources are based on large files of information
related to whether or not an institutional is financially viable and
what they may need to accomplish in order to become more financially
viable. "Typically what people do in our system is upload EXCEL
spreadsheets and balance statements. So you can think of us as more of a
container for that kind of information."
The Big Picture Actually, the big
container in LiveText where the reports, self-study documents and more
are ultimately housed is called the Exhibit Center. Here administrators
can create a share list for internal reviewers and editors as well as
provide visitor passes to accreditation examiners. There is also an
audit trail function that records the examiners’ click through history.
"The biggest value we have is workflow, workflow and workflow,"
Budnik concludes. "This is the third version of LiveText, and we have
kept it simple. What makes LiveText unique is that the workflow process
that users [faculty, students and administrators] go through to conduct
their work is easy."
www.livetext.com
Return to Archives
Return to Article Summaries
Copyright. All rights reserved. Lorenzo Associates, Inc., P.O. Box 74, Clarence
Center, NY 14032. |