Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

Overview

Curriculum development is an ongoing process aimed at finding new and effective ways to provide students with intellectually challenging and personally inspiring learning experiences. Determining the appropriate level for students and defining learning outcomes are essential when designing a lesson or curriculum. This process varies based on the program of study, such as undergraduate, postgraduate, or flexible learning programs. Data science students, for example, learn complex concepts early in their programs, whereas students taking optional data science courses later in their degree do so at a different pace. By understanding the learners and program requirements and learning outcomes, educators can tailor the curriculum to match the year of study, ensuring course-specific outcomes and competencies are suitably challenging. Frameworks like Bloom’s Taxonomy can help educators structure courses to progress from fundamental to advanced skills, enhancing the students’ learning experience. This chapter will discuss techniques for defining learning outcomes, designing practical and theoretical teaching sessions, outlining learning principles, and examining the characteristics of adult learning and their implications for educators.

Defining Learning Outcomes (LOs)

When developing a lesson or curriculum, you need to determine the appropriate level of study, as similar courses can be taught in both undergraduate and postgraduate programs. The complexity of the material and the type of degree will vary and determine the learning outcomes. For example, students specialising in data science will encounter more complex concepts earlier in their studies compared to those students not specialising in data science and taking optional courses later in their programs.

Once the program and its requirements (program learning outcomes) are known, the year of study provides an indication of the level of study. With this context set, you can move on to specifics about the course, such as the course learning outcomes and the level of competency expected by the end of the course. These outcomes can be developed using Bloom’s Taxonomy (Figure 1), where earlier courses on a program focus more on remembering and understanding information, while later courses move towards evaluating, analysing and creating new methods and knowledge.

A flowchart illustrating the process of lesson and curriculum development. The process starts with “Start lesson and curriculum development” followed by identifying the type of program (undergraduate or postgraduate) and the year of study. It then connects to a section titled “Consider equitable outcomes” which includes steps: “Big Picture” “Identify learning outcomes and student competencies at the end of the course” “Identify mode of assessment and feedback” “Assessment and Feedback (define assessment and feedback aligned with learning outcomes)” “Collect evidence of learning” and “Teaching and Learning (type of resources and materials)” ending with “Plan learning and teaching techniques” and “End”. On the right, Bloom’s Taxonomy is presented as a vertical list of six stages for designing learning outcomes.

Figure 1:System for Developing Effective Learning Outcomes for Curriculum or Lessons. Image created by Saman Gule building on John Biggs and Benjamin Bloom’s work. Used under a CC-BY 4.0 license.

The learning outcomes can be developed using the helpful list of verbs given in Figure 2. The LOs provide a broad overview of the course. Next, identify how you will assess the students, considering the frequency and mode of assessment, alongside how you intend to provide feedback and the frequency of providing feedback. At this point, you can collect evidence of previous learning to improve course delivery for future iterations. Once the learning outcomes and assessments have been defined, draft a plan for the teaching and learning techniques to be used for the course. It is very crucial to ensure that the outcomes of the processes and course are equitable, equity should be considered from the start and not introduced as an afterthought.

A colorful bulb‑shaped graphic showing the hierarchical levels of Bloom’s Taxonomy from bottom to top: Knowledge, Comprehension, Application, Analysis, Synthesis, Evaluation, with key action verbs listed beside each level.

Figure 2:Figure 2: Bloom’s Taxonomy List of Verbs for creating Learning outcomes (Curriculum/Lesson). “Bloom’s Taxonomy Verbs” by Fractus Learning is used under a CC BY 4.0 License.

Types of Sessions

Any learning, especially Science learning, can be divided into two parts: theoretical and practical. It is essential to make both types of sessions engaging for the students to enhance learning, it can be done by incorporating a variety of interactive and dynamic teaching methods, such as multimedia integration, interactive techniques, coding demonstration, personalisation, group work and signposting the lecture contents.

Theoretical Sessions

Creating a good theoretical knowledge base for any topic is essential for effective learning and their implementation.

This process has the following key components:

  1. Developing the theory: Establishing a theoretical foundation is important for data scientists to develop their skills to solve real world problems. Introduce fundamental concepts and theories related to the topic, ensuring that the learners grasp the essential principles before moving to more complex concepts. The explanation should be clear and concise, supported by relevant examples preferably real world to which the students can relate to. These concepts can be demonstrated through a dataset that is provided at the start of the course and examined when each component is being studied. These datasets can be opensource data or mock data that is generated specifically for this purpose.

  2. Signposting Advanced Resources: Students can have different levels of learning and interests on a topic. Signposting them towards relevant resources, for example, academic papers, books, online resources or expert talks is useful. It is essential to point the students towards reputable resources or provide a curated list for the whole course while dividing it into themes/topics that align with the course contents.

Practical Sessions

To make learning more effective and interactive demonstrating the application of the theoretical concepts is useful, designing the practical sessions according to the demographics, capabilities and background of the students is essential. Practical sessions should be integrated into the curriculum and lesson design.

There are different teaching methdos that can be used to deliver practical sessions (Table 1). For example, for shorter sessions (1-hour) you can use flipped learning to maximise the efficiency of the learning process. Choosing flipped learning would depend on the demographics and preference of a cohort. Depending on the feasibility and preferences various forms of study material can be provided, for example, pre-recorded short lecture, reading material, provision of skeleton code that will be discussed or modified during the session. The in-class time should be dedicated to discussion, problem-solving, Q&A and hands-on activities to make it more engaging.

Passive Learning vs Active Learning

Passive learning is a traditional, teacher-centered approach where learners receive information without actively engaging in the learning process. The educator controls the learning environment, delivering content through lectures, demonstrations, or pre-defined exercises. In this setting, students are often passive recipients of information, with limited opportunities for interaction or feedback. The focus is on covering a specific curriculum efficiently, ensuring that learners gain a foundational understanding of data science concepts and tools. However, this method may not always encourage deep engagement or critical thinking, as learners may not actively apply the knowledge in real-world contexts during the training.

On the other hand, active learning refers to teaching methods that engage students in the learning process beyond passive listening and note-taking. Consequently, it emphasises activities that encourage students to understand contexts and reflect on their actions. This approach can be incorporated into both theoretical and practical teaching sessions.

Some active learning methods include demonstration, cooperative learning, case studies, discussion, project-based learning, or pair programming. For example, in project-based learning, students work on actual data science projects, from data collection and cleaning to analysis and interpretation, to encourage deeper understanding of the concepts. Pair programming enables students to collaborate on coding tasks and problem-solving, fostering both technical skills and teamwork. In active learning methods, emphasis is placed on autonomy, cooperation, responsibility, creativity, and critical thinking.

`````{admonition} Case Study
:class: tip
Students use Python tools and ChatGPT APIs to analyse structured and unstructured data [@Tsai2024empowering]. Lesson learnt: The key lies in instructors creating unique assignments that build
on students' personal experiences and practical skills to connect with practical experiences, enhancing the effectiveness of each teaching session. Generative AI should be used as a tool and
not considered the brain by students and instructors.</div>

Key elements of active learning in Educational Big Data Analytics Tsai, 2024:


MethodIdeal for
LecturesConveying theoretical information in a short period of time
Briefly introducing a topic through various methods, for example, story telling, solving a puzzle
Imparting knowledge
BrainstormingBringing up new ideas on a specific topic
Imparting and sharing participants’ knowledge
Exploring opinions on a topic
Exploring the application of theoretical concepts (developed in lectures) to real world problems
Involving students
Case StudiesConsidering problems based on real-life situations
Critically analysing how real-world problems were solved and providing alternatives
Identifying possible solutions
Involving students
Engaging students to demonstrate their skill of addressing a problem
Role PlaysDramatising a problem or situation
Identifying possible solutions
Engaging students prior to a discussion
Teaching skills
Discussions/DebateImparting and sharing knowledge
Exploring opinions on a topic
Involving students
ReflectionDebriefing sessions, whether simple or challenging
Checking for understanding (could be used for self-evaluation and evaluation of a group about their understanding of a topic)
Ensuring all questions and concerns are covered
Engaging students
Parking LotDeferring irrelevant questions or those the educator doesn’t have time to address immediately
Less important questions can be addressed asynchronous via email or course announcement or by sharing relevant resources
StorytellingIncreasing student engagement by starting with a problem narrated as a compelling story. The problem and technique for solving it can be signposted at the end of a previous lecture (like a teaser for the session)
Visualising the story by the help of images, infographics, plots, such as graphs, in illustrating key points
Encouraging active participation
Providing opportunity for in-depth reflection
Peer LearningSenior students presenting their work from the same course they completed when they were at the current students’ stage, either as a show-and-tell or for feedback
Critical reflection
Promoting a culture of mentorship and continuous learning (learning objectives must be clear and peer engagements structured)
RecordingsHelping students to revise and review content in detail
Fostering inclusivity by providing students who may miss a session or have different learning abilities with the opportunity to catch up
In-person student attendance can still be accomplished by refraining from recording class activities
Guest LecturesProvide insight into the application of theoretical principles on real-world problems
Bridging the academic-industry gap
Inspiring students and providing insights into possible career paths
Games (EdTech)Practising skills while having fun
Allowing real-life application of skills
Higher engagement

Table 1. Training methods and their applications. Adapted from Center for Applied Linguistics. (2010). Methods in Training.

`````{admonition} Case Study
:class: tip
Based on four P’s of Creative Learning framework (Projects, Passion, Peers, Play), @Sakulkueakulsuk2018kids outline a novel educational approach using games to teach students. The
program encourages students to engage in hands-on projects using the RapidMiner software to predict the characteristics of mangoes, utilising gamified elements to enhance learning and
motivation. This approach not only helps students grasp complex AI concepts through practical application but also promotes creativity, collaboration, and critical thinking. The study found
that such an integrative method significantly improves student engagement and understanding of interdisciplinary concepts, demonstrating the effectiveness of combining technology education
with gamification and real-world challenges.</div>

Adult Learning Principles

Developing effective and meaningful learning programs for adult learners is a challenge for many higher education institutions. Adults learn differently from children and thus, require different teaching methods and approaches. They may also face challenges like financial limitations, preventing them from fully participating in the learning experience. These crucial differences are explored in Adult Learning Theory. Understanding adult learning priciples is fundamental when develping learning outcomes and teaching material for postgradute or flexible learning programs.

According to the U.S. Department of Education (2018), adult learners are aged 25 and older. This definition also applies to the UK and the majority of European countries.

Based on Adult Learning Theory, the Adult Learning Model synthesises research from the learning sciences with essential skills (for example, problem-solving, numeracy, oral communications). Learning styles differ between individuals, and therefore teaching methods should reflect these differences.

As a common starting point, an adult person receives information through three main sensory receivers (all or a combination of them):

Learning styleFacilitation methods
Learning by sight (visual)Handouts
Data visualisation tools such as graph, charts and illustrations for demonstrating techniques;
Supplement heavy-text information with illustrations;
Use interactive dashboards
Use whiteboards
Learning by hearing (auditory)Lectures
Podcasts and audio resources
Verbal explanation of tasks
Include aural activities, such as brainstorming and buzz groups
Invite guest speakers from industry
Group discussios and debates
Learning by movement (kinaesthetic)Plan activities that get the participants up and moving
Use coloured markers to emphasise key points on flip charts or whiteboards
Have the participants transfer information from the text to another medium, such as flipcharts
Live coding/debudding demonstration (from scratch or modifying a small component)
Role playing
Gamification
Field trips to labs and companies to observe theory in practice

Table 2. Facilitation methods for different Learning Styles.

Each of these sensory channels corresponds to specific teaching methods and techniques (Table 2). Therefore, the aim should be to incorporate a blend of methods rather than focusing on just one style of teaching. For instance, use a variety of instructional methods such as lectures, discussions, role-plays (which can be particularly effective for teaching data ethics concepts), and practical exercises (for example, quizzes, brainstorming sessions). Additionally, provide diverse training materials, including slides, manuals or handouts, and videos, to accommodate different learning preferences (Table 1).

Characteristics of Adult Learning & Implications for Educators

Inclusive Teaching & Learning Sessions

Creating an inclusive and supporting environment empowers learners. Developing inclusive teaching and learning sessions is essential to address the diversity within a student group. Recognising this diversity is crucial for reducing student attrition in programs. It is important to be aware of the group’s demographics, including differences in race, ethnicity, gender, educational background, professional background, and special needs.

Here are some strategies that can be adopted/adapted to create inclusive sessions:

  1. Develop Self-Awareness and Empathy Educators should reflect on their own backgrounds and experiences, understanding how these impact their assumptions and interactions with students. Building empathy by engaging with students, showing them that they matter, and demonstrating a genuine desire to understand their unique perspectives is crucial for the course.

  2. Create a Welcoming Learning Environment Establish a space where students feel welcomed, respected, and valued. This can be achieved by creating an environment of mutual respect, encouraging collaboration and positive peer interactions, implementing a code of conduct, and working to inhibit stereotyping.

  3. Select Appropriate Teaching Methods Choose teaching methods suited to the diverse group being taught. Design activities that consider the factors identified in 1 (develop self-awareness and empathy), ensuring students feel a sense of belonging, see improvement in their competencies, and develop an interest in the course. For example: lectures can be recorded for students who are unable to attend a session or need more time to understand a specific topic at their pace. However, to prevent a decline in attendance due to the availability of recorded content, interactive activities should not be recorded. This encourages students to attend lectures and emphasises the value of participating in these activities for a more comprehensive learning experience.

  4. Collaborate with Academic Colleagues Work with other academics in the field to develop and share practices that maximize inclusion. Inclusivity is a community-wide effort.

Summary

In conclusion, the development of an effective lesson or curriculum requires careful planning and consideration of various elements, including the level of study, program requirements, learner requirements and appropriate teaching methods. By clearly defining competencies and learning outcomes, selecting suitable assessment methods, and incorporating diverse teaching techniques, educators can create engaging and equitable learning experiences. Whether through theoretical or practical sessions, using a blend of methods to cater to different learning styles ensures that students can grasp and apply complex concepts effectively. By embracing both conventional and participatory training approaches, educators can foster a dynamic and inclusive learning environment that prepares students for real-world challenges, particularly in data science.

Resources for Creating Engaging Teaching and Learning Content

Creating Accessible Learning & Teaching Materials

Increasing Student Engagement

Educational technology (EdTech) tools are designed specifically to enhance the teaching and learning experience, improve outcomes and increase accessibility, collaboration and engagement amongst students and educators. Following is a list of useful resources.

However it is worth noting that this field is constantly evolving, with new resources emerging and existing ones updating:

This chapter has been written with members of the Educators community that formed as a result of the Data Science and AI Educators Programme (DSAIEP), which ran at The Alan Turing Institute between 2022 and 2023. We would like to acknowledge the contributions of the entire community and the programme organisers. Special thanks to Dr Gule Saman, Thao Do and Denise Bianco who have written this chapter, and the reviewers for their valuable comments and support throughout the process.

References
  1. Tsai, Y.-C. (2024). Empowering students through active learning in educational big data analytics. Smart Learning Environments, 11(1). 10.1186/s40561-024-00300-1
  2. Milo, T., & Somech, A. (2020). Automating Exploratory Data Analysis via Machine Learning: An Overview. Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, 2617–2622. 10.1145/3318464.3383126
  3. Aslan, A. (2021). Problem- based learning in live online classes: Learning achievement, problem-solving skill, communication skill, and interaction. Computers & Education, 171, 104237. 10.1016/j.compedu.2021.104237
  4. Waskom, M. (2021). seaborn: statistical data visualization. Journal of Open Source Software, 6(60), 3021. 10.21105/joss.03021
  5. Qureshi, M. A., Khaskheli, A., Qureshi, J. A., Raza, S. A., & Yousufi, S. Q. (2021). Factors affecting students’ learning performance through collaborative learning and engagement. Interactive Learning Environments, 31(4), 2371–2391. 10.1080/10494820.2021.1884886