Cafvir2013

21
IV Congreso Internacional sobre Calidad y Accesibilidad de la Formación Virtual (CAFVIR 2013) EVALUATING THE QUALITY OF LEARNING DESIGN OF AN ONLINE COURSES Paula Peres, Luis Lima , Vanda Lima Polytechnic of Porto - eIPP / ISCAP Polytechnic of Porto - eIPP / ESTGF - CIICESI [email protected], {llima, vlima}@estgf.ipp.p Lisboa - 17 a 19 de Abril de 2013

description

Measuring the quality of a b-learning environment is critical to determine the success of a b-learning course. Several initiatives have been recently conducted in Europe on benchmarking and quality in e-learning. Despite these efforts in defining and examining quality issues concerning online courses, a defining instrument to evaluate quality is one of the key challenges for blended learning, since it incorporates both traditional and online instruction methods. For this paper, six frameworks for quality assessment of technological enhanced learning were examined and compared regarding similarities and differences. Within this work we analyzed the elements related to the programme and course design in order to get a detailed view of this perspective. As a result of this research, the following elements arose in the quality analysis of the program and course Design: Learning Methods, Motivation/Participation, Learning Objectives, Curriculum, Learner Center Activities and Collaborative Learning, Learning Materials, Learning Process and eTutoring and Assessment and Test. In this article we present the main elements that should be taken into account when evaluating the programme and design of a blended learning course.

Transcript of Cafvir2013

Page 1: Cafvir2013

IV Congreso Internacional sobre Calidad y Accesibilidad de la Formación Virtual

(CAFVIR 2013)

EVALUATING THE QUALITY OF LEARNING DESIGN OF AN ONLINE COURSES

Paula Peres, Luis Lima , Vanda Lima

Polytechnic of Porto - eIPP / ISCAPPolytechnic of Porto - eIPP / ESTGF - [email protected], {llima, vlima}@estgf.ipp.ptLisboa - 17 a 19 de Abril de 2013

Page 2: Cafvir2013

IV Congreso Internacional sobre Calidad y Accesibilidad de la Formación Virtual

(CAFVIR 2013)

e-Learning has becomewidely used

Quality???

Page 3: Cafvir2013

OD

CQ

C QM

IHEP

E-xc

elle

nce

SEEQUEL

EFQUEL

Quality Evaluation Models

Page 4: Cafvir2013

1. ECBCheck - EFQUELInstitutional

Aspects

• B- Target Group OrientationTarget

Audience

• A – General description, Objectives of the programme; Organizational and technical requirements

Quality of Contents

Program and course Design

• C - Quality of the Contents

Media Design

• D – Learning Design and Methodology; Motivation/Participation; Learning Materials; eTutoring; Collaborative Learning; Assignments & Learning Progress; Assessment & Test

Technology

• E - Media Design

Evaluation and Review

• F - Technology

• G - Evaluation & Review

ECBCheck -

EFQUEL

Quality Evaluation Models

http://efquel.org/

European Foundation for Quality in e-Learning

Page 5: Cafvir2013

2. SEEQUELInstitutional

Aspects

• C - Learning ContextsTarget

Audience

• C - Learning Contexts

Quality of Contents

Program and course Design

• A – Learning Resources

Media Design

• B – Learning Process

Technology

• A – Learning Resources

Evaluation and Review

• A – Learning Resources

SEEQUEL

Quality Evaluation Models

http://www.menon.org/wp-content/uploads/2012/11/SEEQUEL-eLearners-user-guide1.pdf

Sustainable Environment for the Evaluation of Quality in e-learning

Page 6: Cafvir2013

3. E-xcellenceInstitutional

Aspects

• E – Staff supportTarget

Audience

• A – Strategic Management

Quality of Contents

Program and course Design

Media Design

• B – Curriculum Design; C- Course Design; F – Student Support

Technology

• A – Learning Resources

Evaluation and Review

• D – Course Delivery

E-xc

elle

nce

Quality Evaluation Models

http://e-xcellencelabel.eadtu.eu/

Page 7: Cafvir2013

Institutional Aspects

• E – Staff supportTarget

Audience

• A – Institutional Support; F – Faculty Support

Quality of Contents

Program and course Design

Media Design

• B – Course Development; C- Teaching/Learning Process; D – Course Structure; E- Student support

Technology

Evaluation and Review

• G – Evaluation and Assessment

IHEP

Quality Evaluation Models

http://www.ihep.org/assets/files/publications/m-r/QualityOnTheLine.pdf

4. IHEP – Quality on the LineInstitute for Higher Education Policy

Page 8: Cafvir2013

5. QM – Quality MattersInstitutional

Aspects

Target Audience

• A – Course Overview and Introduction

Quality of Contents

Program and course Design

Media Design

• B – Learning Objectives; C – Assessment and measurements, E – Learners Interactions and engagement; G – Learners Support

Technology

Evaluation and Review

• F – Course Technology; H - Accessibility

QM

Quality Evaluation Models

• D – Instructional Materials

http://www.qmprogram.org/about

Page 9: Cafvir2013

6. ODLQCInstitutional

Aspects

Target Audience

• D – Selling; E- Provider; F – Collaborative provision

Quality of Contents

Program and course Design

Media Design

• A – Outcomes; C - Support

Technology

Evaluation and Review

• B - Resources

OD

LQ

C

Quality Evaluation Models

http://odlqc.org.uk/

Open & Distance Learning Quality Council

Page 10: Cafvir2013

Evaluation online courses: FrameworkInstitutional

Aspects

Target Audience

Quality of Contents

Program and course Design

Media Design

Technology

Evaluation and Review

Learning Methods

MotivationParticipation

Learning Objectives

Curriculum

Learner Center

Activities

Learning Materials

Learning Process & Tutoring

Assessement & Test

Page 11: Cafvir2013

A. Learning MethodsProgram and course Design

Learning Methods

MotivationParticipation

Learning Objectives

Curriculum

Learner Center

Activities

Learning Materials

Learning Process & Tutoring

Assessement & Test

• Blended Methods

• Standards for reuse development, design and delivery

• Faculty teams with peer review process.

• Revisions of learning outcomes

• Provide students with clear picture of what will be involved

EFQUEL

Quality Evaluation Models

Page 12: Cafvir2013

EFQUEL

Quality Evaluation Models

B. Motivation/ParticipationProgram and course Design

Motivation Participation

Learning Methods

Learning Objetives

Curriculum

Learner Center

Activities

Learning Materials

Learning Process & Tutoring

Assessment & Test

• Self-motivation and commitment to learn at distance

• Learning methodology should motivate learners

Page 13: Cafvir2013

C. Learning ObjectivesProgram and course Design

Learning Methods

Motivation Participation

Learning Objectives

Curriculum

Learner Center

Activities

Learning Materials

Learning Process & Tutoring

Assessment & Test

• Learning outcomes should be clearly defined and aligned with course objectives

• Objectives are measurable and written from the students’ perspective

• Reason for each component in b-learning

EFQUEL

Quality Evaluation Models

• Objectives should be appropriately designed for the level of the course

• Students should have instruction on how to meet them

• The results of the learning are agreed between the staff and learners

Page 14: Cafvir2013

D. CurriculumProgram and course Design

Learning Methods

Motivation Participation

Learning Objectives

Curriculum

Learner Center

Activities

Learning Materials

Learning Process & Tutoring

Assessment & Test

• Self-contained segments (modules)

• The modules should be aligned with learning objectives

• Logical sequence, progressively on each other module

• Lengths determined by the complexity of the LO

• Clear understanding of all components and structure of the course

• The contribution of e-learning components

EFQUEL

Quality Evaluation Models

• Well-organized and easy to navigate

• Personalization for individual learning styles and a flexible path for the learner

• All information (e.g written)

Page 15: Cafvir2013

EFQUEL

Quality Evaluation Models

E. Learner Center ActivitiesProgram and course Design

Learning Methods

Motivation Participation

Learning Objectives

Curriculum

Learner Center

Activities

Learning Materials

Learning Process & Tutoring

Assessment & Test

• Development of competencies

•Multiple activities

• Social and collaborative activities

• Relevant to professional practice

• Active learning and interaction clearly articulated

• Consistent structure and face learning styles

• Time to develop

• Accessibility

Page 16: Cafvir2013

F. Learning MaterialsProgram and course Design

Learning Methods

Motivation Participation

Learning Objectives

Curriculum

Learner Center

Activities

Learning Materials

Learning Process & Tutoring

Assessment & Test

• Elements to guide learners in achieving the learning objectives

• Library resources

• Supplemental course information

• Students should be provided with hands-on training and information

EFQUEL

Quality Evaluation Models

• Glossary

• Distinction between compulsory and recommended materials

• The bibliography should be commented

• Periodically reviewed

Page 17: Cafvir2013

EFQUEL

Quality Evaluation Models

Program and course Design

Learning Methods

Motivation Participation

Learning Objectives

Curriculum

Learner Center

Activities

Learning Materials

Learning Process & Tutoring

Assessment & Test

• Tutor should provide guidance

• Feedback

• Tutors knowledge

• Predefined tutoring skills

• Learning pace

G. Learning Process & Tutoring

• Timeframe

• Interaction and communication

• Learning Styles

• Different perspectives

•Methods of effective research, including assessment of resource validity

Page 18: Cafvir2013

H. Assessment & TestProgram and course Design

Motivation Participatio

n

Learning Methods

Learning Objectives

Curriculum

Learner Center

Activities

Learning Materials

Learning Process & Tutoring

Assessment & Test

• Formative and summative

• Clearly formulated and adequately explained to learners

• Regular analytical feedback

• Timely and appropriate activities to assess

•Mechanism to identify low performance

EFQUEL

Quality Evaluation Models

• Different approaches (self-evaluation; peer review)

• Aligned with the learning objectives

• To store and organize evidence

• Improve the teaching/learning process

•Measure to what extent informal learning meets the expected objectives and outcomes.

Page 19: Cafvir2013

IV Congreso Internacional sobre Calidad y Accesibilidad de la Formación Virtual

(CAFVIR 2013)

Learning methodsMotivation/ParticipationLearning ObjectivesCurriculumLearner Center Activities and collaborative learningLearning MaterialsLearning process and eTutoringAssessment & Test

Program and course Design

Page 20: Cafvir2013

Institutional Aspects

Target Audience

Quality of Contents

Program and course Design

Media Design

Technology

Evaluation and Review

Learning Methods

MotivationParticipation

Learning Objectives

Curriculum

Learner Center

Activities

Learning Materials

Learning Process & Tutoring

Assessement & Test

IV Congreso Internacional sobre Calidad y Accesibilidad de la Formación Virtual

(CAFVIR 2013)

Page 21: Cafvir2013

IV Congreso Internacional sobre Calidad y Accesibilidad de la Formación Virtual

(CAFVIR 2013)

EVALUATING THE QUALITY OF LEARNING DESIGN OF AN ONLINE COURSES

Paula Peres, Luis Lima , Vanda Lima

Polytechnic of Porto - eIPP / ISCAPPolytechnic of Porto - eIPP / ESTGF - [email protected], {llima, vlima}@estgf.ipp.ptLisboa - 17 a 19 de Abril de 2013