Team-Based Learning
  • Team-Based Learning
  • Why would I use TBL?
    • Transition to TBL
  • TBL Process
  • TBL with LAMS
  • TBL for Teachers
    • Getting Started
      • Create TBL lessons with LAMS Generative AI
      • TBL Design Wizard
        • Launch TBL Wizard
        • Design Details & Teams
        • Readiness Assurance Questions
        • Application Exercises
        • Self & Peer Review
      • TBL Features & Customisations
    • Creating a Lesson
    • Monitoring a TBL Lesson
      • TBL Monitor
    • TBL How-To
      • General TBL
      • Teams
      • iRATs
      • tRATs
      • App Exercises
      • Self & Peer Evaluation
      • TBL Facilitation
    • Analytics
    • TBL Design Examples
    • Research & Projects
    • Team Inclusion & Diversity
    • Glossary & Acronyms
  • TBL For Students
    • TBL as Student
    • Student's TBL Guide
      • Preparation Work
      • Teams & Team Formation
      • Individual Test (iRAT)
      • Selecting a Team Leader
      • Team Test (tRAT)
      • Mini Lecture
      • Application Exercises
      • Self & Peer Review
Powered by GitBook
On this page
  • Accessing TBL Monitoring
  • Teams
  • Set-up Team
  • Comparison iRAT and tRAT inter-team scores
  • Comparison iRAT and tRAT intra-team scores
  • Gates
  • iRAT Reports
  • Completion Chart
  • Students Progress Chart
  • Students' Choices
  • Item Analysis
  • Results by Student and Teams
  • Export Results
  • Time Management
  • tRAT
  • All Teams Summary
  • Reports by Teams
  • tRAT score comparison charts
  • Item Analysis
  • Export Results
  • Time Management
  • Burning questions
  • Likes for Burning questions and priority
  • Using Burning questions for facilitating discussion
  • AEs
  • Assessment AEs
  • doKu AEs
  • Time Management for AEs
  • Peer Review
  • Students' Reports
  • Managing missing students
  • Sequence
  1. TBL for Teachers
  2. Monitoring a TBL Lesson

TBL Monitor

Special reports and analytics for TBL

PreviousMonitoring a TBL LessonNextTBL How-To

Last updated 4 years ago

When LAMS detects your design is based on TBL, it provides a specialised set of reports that make it easier to analyse the students performance in a TBL lesson.

For further results analysis, please see .

Accessing TBL Monitoring

Once you open the monitoring interface, LAMS detects that lesson is based on the and adds a new tab: TBL Monitor (see red highlight).

TBL Monitor has a set of tabs that will facilitate the analysis of the students and teams progress and performance. More importantly, it provides you real-time data insights to help you know where and how students might be struggling - thus, allow you to plan your facilitation and interventions in the lesson.

Let's look at each of the tabs in TBL Monitor:

  • Sequence

TBL Analytics

Teams

The Teams tabs shows you a thorough summary of the TBL assessments at a glimpse.

From this tab, you can set up the teams as well as visualise the individual student performance (iRAT) compared with the team performance (tRAT).

Set-up Team

The team button leads you to create the teams.

Comparison iRAT and tRAT inter-team scores

The Summary chart compares all each team's average correct answer for the iRAT with their respective team's tRAT score.

The Summary table shows you the data that is reflected in the chart. It also highlights the higher and lower scores for the iRAT and tRAT for each team.

More importantly, it shows the percentage increase or decrease (Delta Δ) between the iRAT and the tRAT score.

iRAT & tRAT deltas (δ)

In TBL, it is expected that the tRAT score will always be higher than the average individual score in the iRAT. You might want to have a look at teams where there is a decrease in score.

Comparison iRAT and tRAT intra-team scores

You can click on a team's name to get the breakdown of scores for individuals within that team.

Here you can compare the individual iRAT scores for each member of a team, find out the lowest and highest scores and use the chart to compare the students.

Gates

iRAT Reports

This tab shows you two sections: one is the list of all questions in the iRAT.

If you click on the button: "Show students' choices", the following reports the iRAT analytics based on students' answers.

Completion Chart

In this view, you can track the completion of all the students in real time as they progress through the iRAT.

It's split in three categories:

  1. Not started, Students that are part of the lesson but have not yet started the assessment.

  2. In progress,

    Students that are in the middle of the assessment

  3. Completed The number of students that have now completed the exam.

iRAT Completion and managing time for TBL

Students Progress Chart

The Students Progress chart, aggregates the number of questions answered by the students. This chart will tell you how many questions students have answered as they are progressing through the exam.

This is a bar chart so you will see how the bars "move" as the students advanced question by question, from the right to the left.

On the x-axis, are the number of answered questions. On the y-axis, it's the number of students. So as an example, let's assume that our exam has 10 questions. So when a student has answer 5 questions, it will show him/her in the 5th position on the x-axis. As he/she continues answer other questions, then we can see the progress until he/she completed all the exam questions.

Both of these charts (student progress and completion) are progressive, meaning that they are updated continuously as the students are advancing in the test.

Students' Choices

As students submit their answers on the iRAT, the Students' Choices table will display the students' answer distribution.

The rows represent each answer (in order of display) and the columns the available answers. Each cell shows the percentage distribution for the given answer choice.

If the cell is green, it means that this option/choice is the correct answer.

For example, in the table above, we can see that for question #2, 92.59% of the students chose answer "C". And if this case, they were correct.

However, less than 2% of the students chose the correct answer from Question #9.

This table is very useful to identify potential knowledge gaps and can prepare you for the discussions ahead.

If you want to see the full text for each question, click on the question number and an overlay with all the details of the question will be displayed.

Item Analysis

Results by Student and Teams

Export Results

Time Management

If you need to allocate time for students to complete the iRAT, here's where you do it.

There are three options for managing times in the iRAT:

  1. Everyone gets the same amount of time to complete the iRAT Time starts counting down from the moment the student enters the iRAT

  2. Hard time limits Teacher specifies an exact time for all students to finish (ie: "All students to finish within in 5 minutes")

  3. Time extension Teacher grants one or more students additional time to complete the iRAT.

tRAT

Important TBL Insights

All Teams Summary

As the leader for each team selects and option from a tRAT question, you are able to view their choices in real-time:

Each team is represented in rows and the questions as columns.

The tRAT summary shows you which answers each team selected for each question and the order in which they selected the answers.

Unlike in the iRAT, the tRAT allows teams to have multiple attempts for each answer. If the team does not select the correct answer in their first attempt, then they can try again until the finally reach the correct answer.

Therefore the green and red letters that you see represent the options that each team selected and the sequence in which choose them.

For instance, the first row team "The Renagades" for Question 10, first selected the answer "B" as their first attempt -which was not correct. Then they opted for "D" which was not correct and finally selected "C" which was the correct answer.

The Total and Total % columns show you the number of questions that were answered correct at the first attempt.

The Total and Total % rows show you the number of teams that answered the question in their first attempt.

Insights!

Note that the cells in RED, denote the questions where all teams struggle the most. Focusing on this insights as the students answer the questions will give you a good idea where the students' knowledge gaps are.

Clicking on the question, you are able to view the question in an overlay

And clicking on the team name, you see the full list of answers for the team including the sequence of their responses, scores, burning question and discussion (in case the tRAT is conducted asynchronously).

Reports by Teams

tRAT score comparison charts

Item Analysis

Export Results

Time Management

If you need to allocate completion times for the tRAT, here's how you do it:

There are three options for managing times in the tRAT:

  1. All teams gets the same amount of time to complete the tRAT Time starts counting down from the moment the leader of the team enters the tRAT

  2. Hard time limits Teacher specifies an exact time for all teams to finish (ie: "All teams must finish within in 5 minutes")

  3. Time extension Teacher grants a team or teams additional time to complete the tRAT

Burning questions

Teams might raise burning questions, appeals or challenges about a question(s) regarding a particular answer or a concept that they might need help with. When students do, these are presented as Burning questions and can be seen in the Burning Qs tab.

When team leaders raise burning questions for a question, these immediately show in Burning question tab. When you expand the question, then you are able the burning question and the team or teams that have raised them.

Only questions that have burning question will show.

Likes for Burning questions and priority

As teams complete their tRAT, they are also able to see burning question raised by other teams. Then team leaders, in agreement with the team members, will be able to like other teams' burning questions. These likes then accumulate to help the facilitator/content export to know which burning questions should be given priority.

Using Burning questions for facilitating discussion

This page has been designed so the facilitator is able share it with the class and encorage discussion. When discussing a question with the class, the facilitator can display this page in the classroom board or share the screen via Zoom or other conferencing facility and encourage teams to address the burning question first.

Note that from the picture above the answer for the question are hidden so student can have a discussion prior to the facilitators disclosing the answers and correct answer.

AEs

For instance, say your lesson is based on a design that contains two AEs. The first AE (AE1) is based on the Assessment tool and the second one uses the doKu tool (AE2):

Then when you select the AEs in TBL Monitor, you will be able to see two tabs that display both AEs (AE1 and AE2). The main purpose of aggregating the AEs is to allow better comparison and also make it easier to manage AEs in a single section.

Let's start looking at AE1, which is based on the Assessment tool.

Assessment AEs

Assessment AEs will show first the list of the questions and options to disclose answers.

If you want to track scores and team's progress, click on "Show students' choices":

Similarly to what you saw before in the completion and progress page for iRAT, the Assessment activity displays almost the same charts. However, in this case, as the AE is performed in teams, then the details presented are based on teams instead.

Completion and Teams progress

The two charts at the top show you the completion as well as the number of questions that teams have completed in real-time (Groups Progress).

Teams' choices

As teams submit their answers on the AE, the Students' Choices table will display the teams' choices.

The rows represent each team and the columns the questions. Each cell shows the selected answer by that team.

If the cell is green, it means that this option/choice is the correct answer.

Item Analysis

Simultaneous Answer Disclosing

During the lesson, when teams have submitted their responses, you can disclose their answers to the rest of the class.

For MCQ questions, there's a two step disclose. You can disclose the teams' answers first. Then facilitate an intra-team discussion where each team might defend their choice and once they correct answer might be apparent to the class, then disclose the correct answer.

Right after you disclose the teams' answers, you want to facilitate a discussion between teams so they can back and justify their choice, thus encouraging discussion and promoting exchange.

Ideally, you want the students to come up with the correct answer by themselves while exchanging their perspectives.

The disclosure of MCQs can be done question by question or all questions at once (see "Disclose All..." buttons above). Up to your preference.

For essay responses, you can disclose the answers at once and follow up with the team's defence of their response. For essay responses, other teams can respond and rate.

doKu AEs

doKu, in essence, is a collaborative real-time editor, allowing students to simultaneously create and edit a text document. As they edit the document, students can see each other editing in real time. This tool is ideal for AEs as it allows students to collaboratively provide a response for a case or create extended essay response.

In the AEs tab, when the AE is a doKu, then you are able to see all the document responses from all teams and see all students within each team writing on the document in real-time.

Gallery Walks

As you are able to monitor each teams progress, you can launch the Gallery Walk whenever you think the students are ready. To do so, just press the "Start Gallery Walk" button, confirm that you are to start it and then the students will be able to see other teams document and comment and rate each other's documents.

Whenever you think students have completed the Gallery Walk, you can just complete it and everyone will simultaneously will be able to see the comments on their document as well as all teams' ratings.

Time Management for AEs

Just like iRAT and tRAT, you can apply time management limitations for AEs in Assessment and/or doKu tools.

Peer Review

For each team, you are able to see a report for the evaluation criteria. When clicking on the criterion, you get the full report for the ratings.

Students' Reports

When reviewing any of the criterion, you are able to preview the email that will be sent to each individual student. When you preview the email, the following report will be shown:

The report shows:

  1. SPA factor for each criterion

  2. Qualitative feedback

  3. Self and Peer's rating for each criterion

  4. SPA Factor (average) and SAPA Factor

  5. SPA explanation and

SPA (Performance) and SAPA Factors

Managing missing students

If you have missing students in the lesson but these have been allocated to teams, as the above calculation might take them into account, you need to remove them for the purpose of the factors mentioned above. If so click on Manage Students and unselect the ones that you are missing.

Sequence

The sequence or design tab shows you the original design as well where all the students in your lesson are

You can double-click on any activity to access to monitor what students are doing in them at any time.

For in-depth analysis and analytics see .

allow you to manage the flow of students in your TBL lessons. From this page you are able to manage your gates by open and close them. You can also see who and when a gate was open. As always, gates can be open selectively, to allow certain students/teams to continue if need be.

At any time you can export these iRAT results including analysis and time stamps for each answer. See .

Knowing how many students have completed can help you to speed things up and avoid students that have already completed not getting distracted.

See .

See . Or see .

See for further analysis.

see for a full explanation of these options.

tRAT Analytics are best to be used with the previous results from the iRAT. So make sure you use these results in conjunction with the as that's when it will give you better insights into the students' knowledge gaps and strengths.

For further comparison between the iRAT and tRAT results see the .

See .

See .

See .

See for further analysis.

See for details.

Use the burning question tab to facilitate discussion and let teams address each other burning question before giving them the correct answer.

The AEs tab aggregates all the AEs present in the lesson. AEs of the type (for quizzes and essays) as well as essay will be displayed as separate tabs.

As iRAT and AEs use the same Assessment tool, you can get the same report. The main difference between the two is that the AE Item Analysis report is aggregated in Teams instead.

Here you are able to see a summary of all the self and peer evaluation feedback based on the for the students to perform their own assessment.

For this example we use a self & peer evaluation using .

is a weighting factor that can be used to change a team mark for a project (stage) into an individual mark.

or Self Assessment to Peer Assessment factor is the ratio of a student's own rating of themselves compared to the average rating of their contribution by their peers. This has strong feedback value for future development both for self-critical reflection and peer evaluation.

💡
TBL Analytics
CATME Peer Evaluation Questions
The SPA (Performance) factor
The SAPA (Feedback)
Teams
Gates
iRAT
tRAT
AEs
Peer Review
Assessment
doKu
TBL Analytics
TBL process
Comparison iRAT and tRAT intra teams
Allocating students into teams manually
Analytics Export iRAT results
iRAT item analysis
Summary by Students and Teams
Analytics - iRAT export results
iRAT Analytics
iRAT and tRAT Insights
Analytics - tRAT Reports by Teams
Analytics - tRAT Score comparison charts
Analytics - tRAT item analysis
Analytics - tRAT export results
Item Analysis
tRAT Time Management
set up a time limit for the iRAT
criteria that you set
iRAT Time Management
Accessing TBL Monitor
Intra-team scores comparison
TBL monitoring - Managing gates
TBL Monitor - iRAT question list
TBL Monitor - iRAT Analytics
Completion chart
Students progress in iRAT
Students' choices
Time management iRAT
Time management tRAT
TBL Monitor - exploring burning questions.
TBL Monitor -AEs
AE MCQ questions
View when disclosing teams' answers
View after disclosing correct answer
TBL Monitor - doKu AEs.
Student's view for Gallery Walks
Students' view after Gallery walk completed.
TBL Monitor Peer Review
Student's report
TBL Monitor - Peer Review Manage Students
TBL Monitor - Sequence
Gates