返回文章列表
Online CoursesCompletionLearning Analytics
📚

Where Did the Learners in the Completion Rate Go?

Three cohorts in a free online course reveal how enrollment, stated intent, assignment deadlines, and reentry change the meaning of completion.

iBuidl Research2026-11-1818 min read 阅读

TL;DR Calculate completion from the population that matches your question. Enrollment-based completion describes how a course turns registrations into awards. Completion among starters describes a later part of the journey. A useful diagnostic also shows who started, who submitted, what deadline applied, and how many early nonparticipants or late finishers the system could observe. A percentage without those facts can send a redesign to the wrong stage.

The director of a free course assembles three reports for a renewal meeting. The first shows eighteen percent completion. The second shows ten and a half percent. The third shows just over a quarter. All three refer to the same course on reading and explaining basic public data. The director needs to decide whether to spend a small budget advertising, improving the first assignment, or hiring a tutor for the last module.

The reports come from fictional course cohorts. Their numbers are intentionally simple enough to reconstruct. What matters is the path learners had available, which events the platform actually recorded, and the decision for which the director wants evidence. Picking whichever denominator makes a program look better would discard the very distinction that could help it improve.

Katy Jordan's 2015 analysis of openly available course data defined completion as a share of enrollees. In the 221 courses studied, reported rates varied widely. The paper also examined course-level factors and attrition during a subset of courses with suitable longitudinal data. That dataset is a historical example with particular providers and definitions. It gives no current expected rate for the fictional course. The variation and choice of denominator are reasons to keep the underlying events visible. Jordan's MOOC completion analysis

The first report arrives with all events in order

The first run records one thousand unique people enrolled during its recruitment period. Five hundred open the first teaching activity. Of those, three hundred submit the first assessment. One hundred eighty meet the course's stated completion criteria by the primary cutoff. The system requires a first submission before it can award completion, and the events have been reconciled so the groups are nested for this example.

Enrollment-to-completion is one hundred eighty out of one thousand, or eighteen percent. Completion among starters is one hundred eighty out of five hundred, or thirty-six percent. Completion among first submitters is one hundred eighty out of three hundred, or sixty percent. The initial denominator is useful when the director wants to understand the overall conversion from recruitment to awards. The later ones help locate where eligible and engaged learners lost access, changed goals, or encountered difficulty.

Subtracting the stages gives three different questions. Five hundred enrollees never opened the recorded teaching activity. Two hundred opened it and did not submit. One hundred twenty submitted and did not finish by the cutoff. The group's losses may overlap in cause even when they are disjoint in the ledger. A scheduling problem can reduce opening and later submission. A misleading course description can attract people who never intend to finish and can also attract someone who discovers a mismatch during the first lesson.

The word starter needs a plain definition. An automatic welcome email does not show that the learner began. Logging in once might be too broad if people open the learning platform for unrelated courses. The course uses a recorded opening of a teaching activity as its operational indicator of a start. Someone who reads an exported lesson off-platform could be absent from that event count. Where the system allows that route, the analyst describes the recorded action and checks whether the unobserved activity could affect the decision.

The course also checks the nested assumption. In a real platform a learner might submit after visiting a direct link and bypass the logged activity open. If the completion ledger can contain paths not captured by the earlier step, the analyst should reconcile those paths or show them separately. Dividing all completions by a convenient count of people with one unrelated event can produce a ratio that no longer describes a subset. The arithmetic is still possible, but the interpretation changes.

A larger second intake spreads across a smaller classroom

The second run enrolls sixteen hundred people after a partner makes the course available in a broad newsletter. Four hundred twenty people open the first activity. Two hundred eighty submit the first assessment. One hundred sixty-eight finish at the same main deadline under equivalent criteria. The course has received six hundred more registrations than in the first run and issued twelve fewer completions.

The director initially wants to announce that the course performed much worse because its completion rate went from eighteen to ten and a half percent. The new denominator grew faster than the group moving into instruction. Startup dropped from fifty percent of enrolled learners to twenty-six and one-quarter percent. The count of starters fell from five hundred to four hundred twenty. Something important changed in how enrollment reached course activity.

The later stages tell a different story. Forty percent of the four hundred twenty starters complete in the second run, compared with thirty-six percent in the first. Of first submitters, sixty percent complete in both. The conversion from starting to submitting increased from three hundred out of five hundred, which is sixty percent, to two hundred eighty out of four hundred twenty, which is about two-thirds. When the director asks whether final assessment support needs repair, the second run alone supplies limited evidence for that interpretation.

The cohorts were not randomly assigned to recruitment channels. The second one encountered a different partner and may contain a different mix of learners, intentions, and time constraints. The stage rates are descriptive, and later denominators condition on earlier behavior. If only highly motivated learners opened the first activity in the second run, improved completion among starters could reflect who entered. These figures can guide a closer examination of entry without establishing whether the newsletter caused the difference.

The course staff inspect an ordinary task from each stage. They check whether the invitation link worked during enrollment, which start date appeared in the partner message, and how much space the course page gave to workload. They read a sample of participant questions about the first assessment. They would need different evidence for each possible change. A broad denominator gives them no reason to rewrite an effective final module while leaving a confusing invitation in place.

One colleague proposes stopping the partnership to restore the percentage. In the example the newsletter also reached people who completed a targeted data lesson and never intended to earn an award. The staff might consider those outcomes independently. Recruitment can be valuable for a learning objective other than finishing the full course. The report should describe the intended purpose, track evidence that speaks to it, and count the staffing cost of supporting the additional use.

The people who registered to finish have a separate denominator

In the first run, an optional entry survey asks whether a person currently plans to meet full course completion requirements, use selected modules, or is undecided. Four hundred of the thousand enrollees select full completion. Of those four hundred, one hundred fifty finish by the main cutoff. Thirty additional finishers come from among the other enrollees, including people who chose another response or supplied no answer.

The observed completion proportion among respondents who reported that goal is thirty-seven and a half percent. The exact proportion may interest someone investigating whether the course serves people who plan to finish. It still describes the respondents who selected an option at that moment. Making it the sole measure would remove the other thirty known finishers and treat unknown intent as outside the objective without a reason. Nobody should assume the remaining six hundred have a single motive.

A student who starts for one lesson may later decide to complete. Another may intend to finish and be unable to begin once work hours change. The entry response gives one contemporaneous observation and should be stored with its date. Asking at the end whether people ever meant to finish can be useful for understanding reported reasons. It changes the measure because it is asked only of people still reachable and can be influenced by what happened.

The designer might ask about available hours at the same time. That question can identify whether registrants who plan to finish expect to spend less time than the curriculum assumes. If the form is too long or requires personal circumstances unrelated to the course, some registrants will skip it altogether. The analytics team records how many were asked and how many answered and needs care about comparing volunteers with nonrespondents. A short optional goal question may answer enough of the practical concern.

This approach has implications for the student's experience. The person who wants one skill can be offered a self-contained route through that topic. If they use a downloaded resource, the course can tell them whether it offers a way to demonstrate the learning. The course can acknowledge a narrower use without handing out completion credentials for an activity that lacks the full requirements. Tracking the subset and preserving the meaning of the award are compatible.

The third report admits a month the other two left out

The third run takes in nine hundred fifty enrollees, five hundred starts, and three hundred forty first submissions. Two hundred four finish by the main cutoff. In the month that follows, another thirty-six finish through a revised completion window. The latest report counts two hundred forty. The count of first submitters includes all known finishers for simplicity in this example. The main cutoff is the same number of days after course launch as in the earlier runs.

The headline rate shown to the renewal committee uses the extended window. Two hundred forty divided by nine hundred fifty is approximately twenty-five and a quarter percent. At the common deadline, two hundred four divided by nine hundred fifty is approximately twenty-one and a half percent. The one-month window adds about 3.8 percentage points. It cannot be interpreted as an improvement in finishing by the main cutoff.

The extra period can have genuine value. A learner who needed to travel during one week can return and meet the same objectives. A public university deciding which course deserves more resources may care about the eventual award rate. The analyst can show it as an additional outcome and ask whether comparable late completions existed in earlier runs. If the earlier records closed at the deadline, those learners had a different opportunity to finish. Their unrecorded hypothetical behavior cannot be filled in by supposition.

Fast follow-up could also be a resource question. Suppose forty-five learners request reopening and thirty-six earn completion under that route. If all the extra finishers came from those requests in this fiction, eighty percent of requesters complete. That ratio does not measure what would happen if every eligible learner were offered a reopening by default. People who request more time have supplied a signal of motivation or circumstance. Find out who was eligible, who learned of the option, and who used it before using the rate to justify a policy change.

A longer window can alter completion criteria in practice if reviewers are unavailable or the forum is closed. The existing worksheet may require machine feedback and one staff comment. A reopened attempt needs both unless requirements are formally revised. The record should specify whether late passes used the same assessment conditions. An extension that silently drops a component gives the resulting percentage a new numerator definition in addition to a longer denominator window.

The people no report currently sees

One participant reports completing all readings from a downloaded packet but did not touch the platform after the first lesson. Another watches a recording and performs the exercise privately. A third submits an assignment to an expired link and receives no recorded submission. All three fall outside the course's electronic completion record, for different reasons. The first two can represent meaningful use without documented completion. The third may have attempted to satisfy a requirement and encountered a delivery failure.

The course team does not have a free correction for activity it cannot observe. It can add a clearly labeled reason field from voluntary responses, compare support requests with submission logs, or design an accessible reentry path for people whose submission failed. It should describe the unseen activity as a limitation. Counting every download as completion would replace one missing observation with a guess about learning.

An opposite problem appears when the system records successful completion for one person twice, perhaps when a revised certificate carries another issuance event. The course distinguishes persons, registrations, assessment completions, and awards. It decides whether one person enrolling in two runs is counted in each enrollment cohort but once in a cross-cohort unique learner statistic. The answer depends on the question and how the identities can appropriately be matched. A clear definition also lets a new analyst recover the same figures next term.

The same care applies to exclusions. Ineligible registrations, internal test accounts, repeated sign-ups, and people placed on a waitlist can distort a cohort count if the rules change midstream. The assistant preparing the report should keep the inclusion rule and counts for each reason. Exclusions must be specified independently of whether the person finished. Removing validated enrollees who never opened a lesson may be suitable for a starter-rate analysis. They remain relevant to an analysis of whether registration resulted in a start.

A transfer learner gives one more test. A person begins the second run, moves to the third at the tutor's suggestion, and completes there. The system may legitimately count them as a nonfinisher in one run and a finisher in another, depending on its declared cohort rule. A lifetime measure for the program might instead analyze that as one successfully completed learning journey. Both views can help. They must not be pooled as though the row, the cohort, and the person were interchangeable.

The class with different days remaining

One week into the third run, the live dashboard is higher than it was on the same date in the second run. A new enrollment policy let people enter the class after the first lesson opened. The report counts registrations as soon as they occur. Many people who enrolled yesterday are in the denominator even though they have had one day to see teaching activities. A comparison equalizing only the date of the snapshot can mix learners with very different exposure.

For the operational planning question, the director needs to know how many people could ask for help this week. The current enrollment and start counts are relevant as long as the date is clear. For the different question of whether new registrants start, the analyst can look within seven days after each person registers, using only people whose observation windows have elapsed for a complete seven-day comparison. The learner who registered yesterday will appear in that analysis when enough time passes.

A fixed course deadline deserves separate treatment. A learner who enters two days before it has two days to finish under the rule. A learner who enrolled earlier has more opportunity in the same course. Matching people by time since enrollment can illuminate behavior while obscuring differences in calendar deadlines. A report can retain both dates and say whether it asks about a start interval or eventual completion under the actual terms.

The instructor inspects the stage chart split by registration timing. If people arriving late rarely complete, an ordinary cause might be that a required peer exchange has already closed. Recruitment may be responsible for sending a late invitation to a course that cannot accept such participation. Curriculum may be responsible for offering a live deadline without a viable alternative. The rate alone does not assign responsibility. It locates a process point for the owner to inspect.

The director sets a simple rule for draft dashboards. The time recorded next to a numerator should disclose whether learners still have time to produce the event. If the run is open, the dashboard reports completion recorded to date. Once the bound closes, the published record supplies a final rate under a named cutoff. Comparisons across cohorts can then use equivalent stages rather than treating a provisional count as a complete outcome.

Which promise gets the next dollar

At the renewal meeting the director answers three questions on three sheets. A recruitment sheet shows enrolled people, entry events, and completed awards under a common window. An instructional sheet shows movement between the first activity, first submission, and completion among learners with evidence of entering. A flexibility sheet shows offered windows, requests, late awards, and the work required to process them.

Each sheet has a decision attached. The larger intake calls for checking announcement clarity and access to the first activity before buying more advertising. The ratio from starting to submitting can motivate inspection of the first exercise for specific barriers. The request-and-return figures call for evaluating support capacity before broadening the extension. The director can state which evidence is compatible with each choice and which comparison remains uncertain.

The small tutor budget can be modeled explicitly. If a tutor can handle six twenty-minute late reviews in a two-hour block, nine such blocks allow fifty-four reviews before extra administration. Forty-five requests would fit in the simple model only if a review is needed once per request and arrival timing permits matching work to blocks. Twenty-minute reviews arriving on one day may produce a queue even when the monthly supply would be sufficient. A promising rate still has to travel through an actual service.

Likewise the first module redesign could be tested against a better denominator. A new welcome page may increase the number of starters among newly eligible registrants. It can also increase the number of students who open the first page but decide they have found all they need. The useful measure depends on the page's purpose. A diagnostic could record whether first-time visitors understand the anticipated work and reach a chosen activity, not require them to earn a full award as proof of understanding the page.

In the next run the team plans to define its windows before enrollment and keep the recruitment channel and registration definition with each cohort. It will report both the main deadline and a separate reentry window, verify whether assessments are comparable, and preserve unknown participation where the system cannot see it. A result can then be compared at the point of the journey it describes.

One meeting participant asks for a headline that will fit on a small chart. The director chooses first-window awards per enrolled person because the discussion concerns movement from recruitment to the full course outcome. The chart displays the underlying counts. The adjacent note names the change in who started the course and the treatment of late awards. The program can keep a headline rate when a reader can tell where the learners went.

Sources

更多文章