Loopyah Icon

· 27 min read

How to evaluate conference speakers after the event

Featured image for How to evaluate conference speakers after the event article

You've got a speaker everyone remembers. The room was lively, the closing applause was generous, and your colleague wants to book them again before another conference does. Then you read the feedback. People enjoyed the talk, but several wanted the practical examples your programme promised. Do you bring the speaker back?

Evaluate conference speakers against the job you booked them to do, using attendee feedback, evidence from the session and the conditions in which they presented. Make the rebooking decision for a particular audience and format, with clear reasons and any changes you need. An enthusiastic room is useful evidence, but it can't answer every question about the session people paid for.

The interesting part is what happens when those sources disagree. A popular keynote can have missed its brief. A specialist session can serve its intended audience well while attracting fewer people. A capable presenter can struggle because your production failed. Your review needs to explain those differences before next year's programme inherits the wrong decision.

We'll use a fictional paid business conference called Northbank throughout this guide. Its speakers, attendance figures, feedback and costs are invented examples, not customer results or industry benchmarks. The process is a recommendation you can adapt to your conference, rather than a universal speaker rating system.

Start with the session you sold

Before opening a feedback dashboard, find the approved session description and speaker brief. What did you tell ticket buyers they would get? What did you ask the speaker to deliver? Those documents establish the commitment you're reviewing. A speaker shouldn't receive a poor assessment because a reviewer now wishes they had delivered a different talk.

At Northbank, a session for experienced operations managers promised to help delegates compare alternative supplier plans. The description offered a worked example, the reasoning behind a choice and time for questions. The brief agreed those elements with the speaker. The programme team therefore has something specific to examine after delivery.

Start the review by writing that promise in ordinary language. Then note the intended audience, assumed knowledge, format and time available. Keep the version that was public when people chose the session. If marketing changed the description after the speaker approved it, you need to know that before assigning responsibility for a mismatch.

Different sessions have different purposes. An opening keynote may be commissioned to introduce an argument and provoke discussion. A technical presentation may need to explain a method accurately. A panel may need to expose a genuine disagreement. Don't impose a practical-skills test on a session you sold as an informed debate.

You can still ask whether that debate was useful. Did the moderator get beyond prepared statements? Were opposing views explained? Did attendees leave better able to understand the choice? The evidence should follow the promise. It shouldn't reward every speaker for behaving like your most entertaining keynote.

The conference speaker briefing guide helps you agree that purpose before delivery. After the event, compare the delivered session with the actual agreement. Where the brief was vague, record that limitation and improve the next brief rather than inventing a requirement retrospectively.

Decide what the review needs to change

A conference speaker evaluation should end in a decision somebody can use. You might be deciding whether to invite the person again, whether to change their format, whether to revise your briefing or whether an attendee complaint needs a separate response. Those questions need related evidence, but they don't always have the same owner.

Name the person responsible for the rebooking recommendation. Give production responsibility for explaining technical conditions, and ask someone familiar with the subject to review accuracy where that matters. At a small event, one colleague may cover several roles. They still need to distinguish their observation from something another person reported.

Set the review timing around your next real commitment. Capture factual notes while people remember the session. Collect the feedback you planned, allow the speaker to respond to material concerns, and make the booking decision before somebody pays another deposit. You don't need to keep the entire programme unresolved while waiting indefinitely for more replies.

The US Centers for Disease Control and Prevention's training evaluation guidance distinguishes satisfaction, learning and later application. It also explains that an end assessment alone cannot establish learning change. For a conference session, that distinction helps you decide which evidence you actually need before claiming success.

Your own review can then stay proportionate. A short introductory talk may need a content check, audience feedback and delivery notes. A substantial paid learning session may justify looking at an agreed exercise. Don't collect an assessment because a template contains a box for it. Ask what the result would change.

Tell speakers how you intend to use the review. A private programme discussion is different from publishing a named ranking. If evaluation wasn't agreed before this event, use the evidence you legitimately have and explain its limits. Plan any new collection with the next cohort, rather than pretending you measured something this time.

Keep the important judgments separate

Use a short review covering audience fit, content, delivery, working arrangements and commercial suitability. These are prompts for judgment, not ingredients for a mysterious final number. Keep a note of the supporting evidence and what remains uncertain beside each conclusion.

Audience fit asks whether the session served the people it was intended for. Content asks whether it delivered the agreed substance and whether relevant claims were sound. Delivery concerns how people could follow and participate. Working arrangements cover the commitments that made the session possible. Commercial suitability asks whether the proposed next booking makes sense within your programme and budget.

At Northbank, the programme owner might conclude that a speaker understood the audience and provided a sound explanation, but rushed the practical example. That is a more useful finding than an average of several unrelated scores. It suggests a revision to the session plan, rather than a blanket judgment about the person's quality.

Some requirements also need their own decision. An unresolved accuracy concern shouldn't disappear because the speaker was punctual and entertaining. A serious conduct complaint needs the appropriate complaint process. Adding every issue into an average can make a material failure look acceptable simply because other boxes scored well.

If your team wants ratings, describe what each rating means before using it. "Delivered the agreed example with enough explanation to follow the choice" is more usable than "content quality: excellent". Allow "not observed" and "insufficient evidence". A reviewer who missed the session should not turn that absence into a low score.

Collect observations people can verify

Ask room staff and programme reviewers to record what happened, with the session reference and relevant timing. "The exercise started after the scheduled finish" is useful. "The speaker seemed disorganised" is an interpretation that needs an example before you can act on it.

At Northbank, the room host notes that the session began late after an equipment reset. The speaker then delivered the introduction, shortened the case explanation and left time for a brief question. Those facts help the programme owner investigate the missing detail. They don't settle whether the speaker or the organiser should have changed the running plan.

Record your own interventions too. Did a producer ask the speaker to remove a section? Did the chair interrupt with an unplanned announcement? Did the room change make the advertised activity impossible? A review that logs only the presenter's decisions can leave out the cause of the audience's disappointment.

Where a recording is available and you have permission to use it for review, check the disputed passage rather than relying entirely on memory. Keep timestamps for relevant observations. A camera view may still miss unreadable slides, poor sound at the back or questions the microphone didn't capture, so compare it with room notes.

The speaker management workflow gives you a place to connect the approved description, files and changes. Add the delivery record there, while restricting sensitive feedback to people who need it. The next programme producer should be able to find the reason for your recommendation without reading every private message.

Don't turn observation into a hunt for mistakes. Record what worked as specifically as what failed. If a speaker explained a difficult distinction with an example the audience could use, keep that detail. It tells you what to preserve when you ask for a shorter version or a more advanced session.

Ask attendees questions they can answer

Attendees can tell you whether the session matched their needs, whether they could follow it and what they found useful. They may also identify a specific problem your reviewer missed. Ask about those experiences directly, using language that describes the session rather than asking people to judge the speaker's personality.

For Northbank's supplier-planning session, a question about following the comparison is more helpful than asking whether the speaker was inspiring. A keynote might legitimately need a different question. You can retain a small common section across your programme while adding a session-specific question about its central promise.

The American Association for Public Opinion Research, or AAPOR, recommends in its survey research guidance that questions address one concept at a time and avoid wording that pushes respondents toward an answer. Applied here, separate relevance from clarity, and ask neutrally about what worked and what should change.

Avoid "How useful and engaging was this excellent session?" Someone might find it useful and difficult to follow, and the praise tells them which answer you prefer. Ask each judgment separately. Include a way to say they can't judge, especially when someone attended only part of the session.

Keep the speaker evaluation distinct from the whole-event form. A delegate who disliked lunch may still have learned something valuable from the presentation. Your broader post-event survey questions can cover the overall experience. A session review needs enough identification that neither you nor the respondent confuses one talk with another.

Test the form with someone outside the programme team. Ask them to explain what each question means and how they would answer after attending only part of a session. If they need you to explain the scale, change the instructions before delegates see it.

An adaptable conference speaker evaluation form

Here's a starting form for a practical conference talk. It's an original example, not a validated research instrument. Adapt it to your purpose, test the wording and keep it short enough that a delegate can complete it without reconstructing the whole session.

Begin with the session title, speaker and time. Explain who will review the answers, whether comments may be shared with the speaker, and how to report a concern privately. Don't promise anonymity unless your collection method actually provides it. Make participation voluntary and distinguish the feedback request from any promised attendance record.

You could then ask:

  • How much of this session did you attend? Offer all or nearly all, part, and none.

  • How relevant was the session to the work you came to learn about? Offer not at all relevant, slightly relevant, moderately relevant, very relevant, extremely relevant, and unable to judge.

  • How easy was it to follow the explanation? Offer very difficult, difficult, neither easy nor difficult, easy, very easy, and unable to judge.

  • How well did the session cover the supplier comparison promised in its description? Offer not at all, a little, partly, mostly, fully, and unable to judge.

  • What is one idea or example you could use in your work? Leave this optional.

  • What should we change before offering this session again? Leave this optional too.

The coverage question should name whatever your session actually promised. For a panel, it might ask about understanding the competing approaches. Don't leave "supplier comparison" in every form because it worked in this example. The response choices also need a pilot with your own audience; they aren't a measurement standard.

Ask optional background questions only when they help interpret the session. Prior familiarity with the subject might explain whether the advertised level worked. An employer name usually adds little to a rebooking decision. Don't make delegates disclose personal details just to tell you the sound was poor.

The World Wide Web Consortium's guidance on form labels explains that controls need descriptive, properly associated labels. Check that delegates can understand and complete your chosen form with assistive technology. A visible set of stars without an accessible explanation of the question and choices needs attention before you send it.

Reach the right attendees without overstating what you know

A ticket purchase isn't proof that someone attended a particular session. The buyer may have bought for colleagues. A multi-track delegate may have chosen another room. If you send the evaluation to everyone with a conference ticket, include a session-attendance question and exclude non-attendees from judgments about that presentation.

Use a verified session attendance record where you have one and where its use fits your stated purpose. Explain its limits. An entry count may not tell you who stayed, and a full-event check-in doesn't establish session attendance. Don't build a precise-looking response percentage on an attendance total your team cannot explain.

With Loopyah attendee email, you can build a message, choose an audience using ticket and purchase information, and send yourself a test. That helps distribute a clear request without recreating your buyer list. You still need to establish who attended the session and use an appropriate audience for the message.

Tell people why you're asking. You want to improve the programme and decide how to offer this subject again. State the actual deadline you've chosen, and send only the reminders your plan calls for. Avoid implying that the speaker personally expects a favourable review, especially if the presenter is standing nearby as people answer.

Give people a workable route if they can't use the form. That could be a named contact or an accessible alternative your team can handle. Record those answers with their collection method. Feedback provided in a conversation may be useful, but it wasn't collected under the same conditions as an unprompted written response.

If you offer an incentive, describe it honestly and don't reward positive answers. Keep any prize-entry details separate where possible. Record the incentive in the review notes because the collection conditions matter when you compare this conference with another edition.

Read the replies before ranking the speakers

Start with how many people you invited, how many could actually judge the session and how many answered each question. Then read the distribution of answers and the comments. A single average can hide a group who loved the session and another group who couldn't follow it.

At fictional Northbank, the organiser has a verified list of 120 attendees for one session and invites all of them. Forty-eight submit the evaluation, so the simple participation proportion is 48 divided by 120, or 40%. That describes participation under this example's stated conditions. It is not a claim that the answers represent everyone in the room.

Of those 48 respondents, 36 choose easy or very easy for following the explanation. That's 75% of respondents to that question. In this example, all 48 answered it and reported attending all or nearly all of the session. Say exactly that. "Three quarters of attendees found the session clear" would claim knowledge about people who didn't reply.

For coverage of the promised comparison, only 40 of the 48 respondents answer. Twenty-four choose mostly or fully, giving 60% of the 40 answers. None of those 40 select unable to judge. Keep that choice separate from missing answers and substantive judgments in your own review. Report the eight missing answers alongside the result. Using 48 as the base would answer a different question, and using 120 would misrepresent missing answers as negative judgments.

AAPOR's overview of response rates and survey quality explains that response rates alone do not reliably distinguish accurate from inaccurate results. For your review, look at who may be missing and whether other evidence agrees. A higher participation proportion doesn't automatically resolve selective responding.

Don't rank that speaker against another using a different question, audience or collection method. Even with a shared form, a narrow specialist workshop and a broad keynote have different jobs. Compare relevant evidence within comparable sessions and explain the remaining differences before describing one speaker as better.

Use comments to locate the problem

Read comments for recurring, specific observations. "The example stopped before the final choice" points to something you can inspect. "Not my thing" is still a valid reaction, but it doesn't tell you whether the speaker missed the brief or the attendee chose a session outside their interests.

Group comments by the issue they describe, such as level, examples, pace, audibility or relevance. Keep contradictory comments visible. Several people may want a slower explanation while experienced delegates want more depth. That disagreement could suggest a badly defined audience, rather than a presenter who should somehow move faster and slower simultaneously.

Count respondents, not repeated phrases. One long response mentioning pace in several sentences is still one respondent reporting that issue. State the base when reporting a count. If comments were optional, absence of a criticism isn't evidence that everyone else thought the pace was right.

Read the original text before deciding what a category means. A comment about "too much sales" could concern an undisclosed product pitch, an example built around a vendor, or the event's advertising generally. Those situations require different action. An automated summary can help organise reading, but someone must check the comments behind the recommendation.

Treat comments about accent, appearance or identity carefully. Ask whether they identify a concrete barrier to understanding or participation, or simply express a preference unrelated to the session's job. Apply your programme and conduct standards consistently. Don't turn prejudice into a booking rule because it arrived through a feedback form.

Where someone raises a serious concern, follow the appropriate reporting and review process. Preserve the relevant information with controlled access, establish what can be checked, and avoid declaring the allegation proven in a general speaker spreadsheet. You can withhold a new booking while a material concern remains unresolved without pretending you already know the outcome.

Separate speaker performance from the room and programme

Now compare the audience feedback with the actual delivery conditions. At Northbank, delegates say the comparison felt rushed. The host's notes show that an equipment reset delayed the start. The programme team asked the speaker to finish at the original time because the next session needed the room.

That explains part of the pressure, but it doesn't answer every question. Did the speaker follow the agreed shortened plan? Did the organiser provide one? Could the introduction have been reduced to preserve the central example? Review the choices and information available at the time rather than assuming somebody could simply have done better.

Suppose the production record confirms that the speaker submitted the agreed files on time and the venue machine failed. Record the failure as an organiser-controlled delivery problem. If the speaker also spent the remaining time on material outside the agreed purpose, record that separately. Responsibility can be shared without becoming vague.

Attendance needs the same context. A room with empty seats might reflect an unclear description, a clash with a popular session, a distant location or limited demand for the topic. It may also reflect weak interest in the speaker. You need more than a room photograph to distinguish those explanations.

For a panel, review the format before assigning the whole result to each participant. A moderator may have directed nearly every question to one person. Another panellist may have had little opportunity to contribute. Note what each person could reasonably influence and what the producer needs to change next time.

A remote session adds other conditions. Check connection failures, audience audio, the moderator's handling of questions and what the speaker could see. The rebooking decision might be to invite the person in a supported interview format, rather than repeat an unsupported remote presentation and hope the result changes.

Check learning only as far as your evidence allows

When a session promises learning, look for evidence that matches the promised outcome. A delegate saying they feel more confident is useful feedback. It doesn't establish that they can perform a task accurately, and it doesn't tell you whether the speaker caused a change.

If you agreed a short exercise before the event, examine the work against its stated criteria. Report who attempted it, who completed it and what they demonstrated. Don't invent an exercise after the conference and treat responses from a small willing group as though you assessed everyone who attended the original session.

A session might only aim to help people recognise a problem and ask better questions. Evidence could include a relevant explanation in an agreed activity, rather than a full practical demonstration. Keep your claim at that level. Completing a conference exercise doesn't establish professional competence across a whole field.

The detailed guide to measuring workshop learning outcomes covers starting tasks, final tasks and consistent criteria. Use that method when the offer warrants it. Here, the rebooking review needs to know what evidence exists and how much weight it can reasonably carry.

A later follow-up can ask whether people had an opportunity to use an idea, what they tried and what happened. Choose the timing around the work involved. Someone who hasn't yet encountered the relevant decision cannot tell you whether the method helped with it. Leave room for that answer.

Keep self-reports labelled as self-reports. If several delegates describe using a comparison method, that's encouraging information for the next programme. It isn't independently verified business improvement. Your speaker review can record the positive signal while leaving a stronger claim unmade.

Make a provisional decision when evidence is thin

Sometimes you finish the conference with almost no session feedback. The form may have failed, the invitation may have reached buyers rather than delegates, or the audience may simply not have answered. Record what happened. A missing collection is a process problem to fix, rather than a reason to assign the speaker an average score.

Use the evidence you do have. Check the brief, the delivered material, room observations and any specific feedback. You can make a limited recommendation from that record if it answers the relevant question. Describe the uncertainty plainly, especially if the proposed next booking is larger or serves a different audience.

If you seek additional feedback, decide whom to contact and why before reading their answers. Approaching only the people who praised the speaker in person will produce a predictable account. A small set of conversations can reveal useful detail, but report how you selected those delegates and avoid presenting the conversations as a representative survey.

You may need to reserve a programme slot before the follow-up is complete. Separate the deadline for holding availability from the authority to confirm a booking, and agree any associated terms explicitly. If the commitment cannot wait, the decision owner must choose based on the evidence and cost available. Uncertainty doesn't vanish because a deadline arrives.

Compare the next offer, not just last year's scores

The next booking may be a choice between a returning speaker and a new proposal. Compare the session each would deliver to your intended audience. The returning speaker has evidence from your event; the newcomer may have a relevant recording, references or a proposed outline. Those are different evidence sources, so don't fill the newcomer's blank feedback column with a guessed score.

Start with the gap in your programme. Perhaps experienced delegates need a difficult practical example, while the returning keynote offers a broad introduction. A high rating for that introduction doesn't establish suitability for the new task. Ask what the person would change and examine the proposed material before using past popularity to close the discussion.

The same applies to speakers with commercial backing. A sponsored session still needs to deliver the description attendees saw, while its agreed commercial purpose should remain explicit. Keep sponsor income separate from the content assessment. A commercially valuable package can still need a revised presentation, and positive content feedback doesn't confirm that every sponsorship commitment was fulfilled.

Consider the programme as a whole before repeating a strong session. Returning delegates may already know the material. Another speaker may provide necessary expertise or a perspective the current lineup lacks. Record whether you're repeating the session for a new audience, commissioning genuinely new content or changing the format. Those are different offers with different preparation needs.

Then compare confirmed costs and delivery requirements on the same basis. One proposal may include a rehearsal, while another charges separately. One may require extra equipment. Ask for the missing information rather than treating an unstated cost as zero. Your final recommendation should explain why this particular offer belongs in the next conference, with past evaluation contributing evidence to that choice.

Put the cost beside the proposed next booking

A speaker can deliver a useful session at a cost your next conference cannot support. Another can be inexpensive but require more preparation or technical support than you budgeted. Review the full cost of the proposed arrangement, including the work needed to make the session suitable again.

For fictional Northbank, suppose the completed booking cost $1,800 in speaker fee, $400 in travel and $300 in additional production, using tax-inclusive USD figures. Assume those are all the booking-specific cash costs here; continuing salaries and conference overhead are excluded. The total is $2,500. This describes the example booking only. It is not a suggested market rate or a measure of what the speaker should charge.

For a repeat booking, the speaker proposes the same fee and travel, while the programme owner estimates $200 for an additional rehearsal. With the same $300 production requirement, the proposed total becomes $2,700. In this example, the rehearsal is an additional cash payment. Confirm that assumption in your own budget and avoid counting staff time twice if it is already included elsewhere.

If a genuinely additional ticket would contribute $75 after the costs directly added by that sale, $2,700 divided by $75 is 36 tickets. That is an arithmetic cost comparison, before any continuing overhead excluded from the contribution figure. It doesn't prove this speaker would sell 36 additional tickets, or that ticket sales are the only reason to include the session. You would also need available inventory and credible demand for those additional sales. Moving buyers from another ticket type or session doesn't create extra conference income.

A programme also needs to deliver the value already sold to delegates. You might approve the session because it supplies essential subject expertise within an affordable conference budget. Write that reason down. Don't invent attributable ticket revenue to make a sensible editorial choice look more measurable.

The separate guide to conference speaker fees helps with the booking discussion. Your retrospective review should explain whether the previous arrangement delivered what you agreed and what the next arrangement would cost. It shouldn't use a weak popularity score as a pretext for renegotiating an agreed past fee.

Turn the Northbank evidence into a decision

Bring the records together before approaching the speaker. Northbank's talk had encouraging clarity feedback among respondents, weaker coverage feedback, missing answers and a documented equipment delay. The approved brief required a worked comparison. The review recording confirms that the speaker shortened that section after the late start.

The programme owner asks the subject reviewer whether the material that was delivered was sound. They ask production what caused the reset and what would prevent a repeat. They check the speaker's submitted plan and the finish instruction. Those checks establish what happened without pretending that the feedback percentages explain the cause.

In this fictional case, the reviewer finds no material accuracy concern. The speaker followed the instruction to finish on time but retained a long introduction at the expense of the central example. Production accepts responsibility for the delayed start. The programme owner also recognises that nobody supplied an agreed reduced version of the session.

A reasonable recommendation is to consider the speaker again for the same audience, subject to a revised running plan and an affordable confirmed quote. Ask for an example-led version, an agreed shortened fallback and a rehearsal in the intended setup. Assign production responsibility for the equipment fix. Each condition follows something the review actually found.

This isn't a promise to rebook. The next conference may need a different subject, or the proposed cost may not fit. Record the session as suitable for consideration under those conditions, and give someone responsibility for checking them before an invitation becomes a commitment.

You might reach a different conclusion with different evidence. If the central material was inaccurate, the speaker refused the agreed purpose or a material concern remained unresolved, a repeat invitation could be inappropriate. A fair process allows a clear refusal. It simply requires a reason stronger than an unexplained rank in a spreadsheet.

Give the speaker feedback they can use

Contact the speaker with the purpose of the conversation and the evidence you want to discuss. Start with the agreed session promise and what the review found. Describe observations directly, including your team's part in the result. That makes it possible to discuss a change without asking the speaker to defend their entire professional reputation.

At Northbank, the programme owner could explain that respondents generally found the explanation clear, while the promised comparison received less positive coverage feedback. They would give the actual counts and missing answers, describe the shortened example and acknowledge the equipment delay. They would then ask how the speaker understood the finish instruction.

Share relevant comments in a way consistent with what you told respondents. Remove unnecessary identifiers and don't forward an unrestricted export simply because it is convenient. A short comment can identify someone through their employer, role or the incident described even after you remove their name.

The UK's Information Commissioner's Office explains data minimisation as keeping personal data adequate, relevant and limited to the stated purpose. Apply the rules relevant to your event and collection. For this review, decide what the speaker needs to understand the issue and share only that information.

Invite factual corrections and distinguish them from disagreement over judgment. If the speaker shows that your team sent the wrong description, correct the record. If they disagree about pacing, retain the evidence and explain the programme decision. Fairness doesn't require everyone to reach the same interpretation.

End the conversation with what happens next. You might ask for a revised outline by an agreed date, confirm that no repeat invitation is planned or explain that a separate concern remains under review. Send a short written record so the next colleague doesn't mistake a constructive conversation for a confirmed booking.

Keep a record the next programme team can trust

Your final speaker review can be concise even when the investigation required more work. Link to the supporting records rather than copying everything into one widely shared document. Keep the recommendation understandable to a producer who wasn't in the room.

Use these fields as an adaptable record:

  • Session reference, event date, intended audience and approved promise.

  • Evidence reviewed, collection conditions and important missing information.

  • Findings on audience fit, content, delivery and working arrangements.

  • Organiser or venue conditions that affected the result.

  • Speaker response and any factual corrections.

  • Proposed next role, required changes, estimated cost and unresolved conditions.

  • Rebooking recommendation, decision owner and date for reconsideration.

Avoid writing a permanent judgment such as "poor speaker" when your evidence concerns one presentation to one audience. "Suitable for an experienced operations audience if the revised example-led plan is approved" tells the next producer much more. If the recommendation changes after another event, keep enough history to understand why.

Review access and retention too. The programme team may need the booking conclusion for a future edition, while raw comments and identifiable submissions may need tighter access and a shorter retention period. Choose arrangements that fit the purpose and applicable obligations, then assign someone to carry them out.

Before you send the next invitation, open that record and check the conditions. Has the outline changed? Is the equipment fix assigned? Does the quote fit the budget? Resolve those points with the speaker and your team before anyone confirms the slot.

Loopyah Icon

Author: By the Loopyah Content Team

The Loopyah Content Team shares expert insights, practical guides, and industry updates to help event organizers create unforgettable experiences and stay ahead in the event planning world.