Redesigning Khoros’ moderator inbox to enable AI-powered assistance at scale

Redesigning Khoros’ moderator inbox to enable AI-powered assistance at scale

Turning repetitive tasks into AI-driven workflows for faster, calmer, and more accurate moderation
Turning repetitive tasks into AI-driven workflows for faster, calmer, and more accurate moderation

By 2023, AI had become the buzzword of every product roadmap, but inside the moderator inbox, the day-to-day still felt manual, repetitive, and unsustainable at scale.

I was handed the baton to lead AI innovation at Khoros and rethink the moderator inbox for one of the fastest grwoing community solution provider's

By 2023, AI had become the buzzword of every product roadmap, but inside the moderator inbox, the day-to-day still felt manual, repetitive, and unsustainable at scale.

I was handed the baton to lead AI innovation at Khoros and rethink the moderator inbox for one of the fastest grwoing community solution provider's

What can flow do

In Moderator inbox

What can flow do

In Moderator inbox

What can flow do

In Moderator inbox

Duration

2 Months

Team

1 Product Manger, 5 Engineer & 1 Designer

Deliverables

UX Research, UX Design, UI Design, Prototyping, Usability testing, Micro-animations

Outcome

Fully shipped end to end AI Experience

01.Overview

01.Overview

No Scenic Route,
Just Strategic Speed

No Scenic Route,
Just Strategic Speed

Addressing the core challenges in moderation required more than just designing new features—I needed to deeply understand operational workflows, resource allocation, and the practical realities of moderator workloads.

Addressing the core challenges in moderation required more than just designing new features—I needed to deeply understand operational workflows, resource allocation, and the practical realities of moderator workloads.

The Moderator Inbox at Khoros acts as the frontline hub where moderators manage all user-generated content and customer interactions, including tickets, messages, queries, and complaints. My goal was to enhance this critical tool to help moderators deliver efficient, consistent, and high-quality community support.

The Moderator Inbox at Khoros acts as the frontline hub where moderators manage all user-generated content and customer interactions, including tickets, messages, queries, and complaints. My goal was to enhance this critical tool to help moderators deliver efficient, consistent, and high-quality community support.

This is what the moderator inbox looked like when we stepped in.

Business
Motivations

Business
Motivations

What was the rush ?

The business saw AI as its fastest path to cutting costs, protecting market leadership, and creating a new line of value for customers.

The business saw AI as its fastest path to cutting costs, protecting market leadership, and creating a new line of value for customers.

But Before we could talk about solutions, we had to understand why the business was pushing for this change so urgently.

But Before we could talk about solutions, we had to understand why the business was pushing for this change so urgently.

1

1

Escalating
costs

Escalating
costs

Hiring more moderators with every growth spurt had become unsustainable. The business needed to scale output without scaling payroll.

2

2

Revenue opportunity

Revenue opportunity

Beyond cost savings, an AI-powered moderation toolkit could be sold as a premium add-on to enterprise clients, opening a new revenue stream.

3

3

Flow.ai
acquisition

Flow.ai
acquisition

The recent acquisition gave Khoros a ready-to-deploy AI asset. Leadership wanted to show results fast and prove the value of that investment.

4

4

Competitive pressure

Competitive pressure

Competitive pressure was rising, and tweaks weren’t enough. The industry was shifting fast, and incremental change risked falling behind.

Business Goals

From urgency to action

The motivations gave us the why—the pressures and opportunities that made AI a priority. The business goals defined the how

The motivations gave us the why—the pressures and opportunities that made AI a priority. The business goals defined the how

The business motivation was clear: rising support costs, investor pressure, and increasing competition demanded a smarter way to scale. The acquisition of Flow.ai created an opportunity to take a meaningful step forward.

The business motivation was clear: rising support costs, investor pressure, and increasing competition demanded a smarter way to scale. The acquisition of Flow.ai created an opportunity to take a meaningful step forward.

01 Integrate Flow.ai into the core product to create tangible business value.

01 Integrate Flow.ai into the core product to create tangible business value.

02 Integrate Flow.ai into moderator workflows

02 Integrate Flow.ai into moderator workflows

03 Differentiate Khoros with an AI-powered inbox to defend market leadership.

03 Differentiate Khoros with an AI-powered inbox to defend market leadership.

04 Position the AI-powered inbox as a premium,
sellable feature for new revenue.

04 Position the AI-powered inbox as a premium,
sellable feature for new revenue.

Product Goals

Vision to execution

Business goals gave us the mandate, product goals clarified the lens through which success would be measured

Business goals gave us the mandate, product goals clarified the lens through which success would be measured

At a high level, the product needed to evolve beyond incremental fixes. The goal was to set a foundation that balanced innovation with reliability while leaving room for refinement through research.

At a high level, the product needed to evolve beyond incremental fixes. The goal was to set a foundation that balanced innovation with reliability while leaving room for refinement through research.

01 Place Flow.ai inside the moderator inbox where it drives daily impact.

01 Place Flow.ai inside the moderator inbox where it drives daily impact.

02 Ensure the system can handle millions of interactions with stability.

02 Ensure the system can handle millions of interactions with stability.

03 Balance faster ticket resolution with consistent, trustworthy responses.

03 Balance faster ticket resolution with consistent, trustworthy responses.

04 Build a flexible foundation ready for future AI advancements.

04 Build a flexible foundation ready for future AI advancements.

User Goals

From pain points to priorities

While product goals defined the “what,” user goals reminded us of the “for whom.”

While product goals defined the “what,” user goals reminded us of the “for whom.”

For moderators, the stakes were personal. Their day-to-day experience shaped whether any solution would be adopted or rejected. Our role was to keep these needs at the center of the design.

For moderators, the stakes were personal. Their day-to-day experience shaped whether any solution would be adopted or rejected. Our role was to keep these needs at the center of the design.

01 Reduce the mental strain of managing high-volume ticket queues.

01 Reduce the mental strain of managing high-volume ticket queues.

02 Support moderators in maintaining a consistent brand voice under pressure.

02 Support moderators in maintaining a consistent brand voice under pressure.

03 Boost moderator confidence and well-being through empowering tools.

03 Boost moderator confidence and well-being through empowering tools.

Current Scale of Moderator Inbox

The moderator inbox isn’t just another tool—it’s the heartbeat of customer interactions across Khoros communities.

The moderator inbox isn’t just another tool—it’s the heartbeat of customer interactions across Khoros communities.

Before diving into solutions, it was important to establish the sheer scale of what moderators face every day. These metrics gave us the baseline to understand the stakes.

Before diving into solutions, it was important to establish the sheer scale of what moderators face every day. These metrics gave us the baseline to understand the stakes.

Global
enterprise adoption

The platform is trusted by leading companies worldwide, including some of the largest enterprises.

The platform is trusted by leading companies worldwide, including some of the largest enterprises.
0

Community
footprint

Khoros powers hundreds of enterprise communities across industries, setting the stage for massive engagement at scale.

Khoros powers hundreds of enterprise communities across industries, setting the stage for massive engagement at scale.
0

Daily
digital interactions

Khoros powers hundreds of enterprise communities across industries, setting the stage for massive engagement at scale.

Khoros powers hundreds of enterprise communities across industries, setting the stage for massive engagement at scale.
0

02. My Role

Owning the entire journey of change

Owning the entire journey of change

I was responsible for making sure the experience worked—for everyone, every day.

I was responsible for making sure the experience worked—for everyone, every day.

As the Senior Product Designer and Design Tribe Lead, I own the end-to-end experience of the Moderator Inbox and other core surfaces within the Khoros Community platform.

For this initiative, I led the entire design process, from framing the problem to delivering a reimagined inbox experience.

03. Impact

Six months later
A redesign that rewrote the playbook

When the redesigned Moderator Inbox launched in early 2025, it marked a significant evolution for the Khoros Community platform.

Moderators weren’t just completing tasks more quickly — they were working with more focus, less fatigue, and greater confidence. The redesign made a difference not just in how fast things got done, but in how people felt doing them.

0

Faster
Response Times

Cut average resolution times by reducing 2–4 minutes of search per ticket.

0

Reduced
typing effort

Auto-drafts and rephrasing slashed repetitive writing work.

0

More
efficient workflows

Reduced external tool usage, creating a single streamlined inbox.

0

Higher
moderator satisfaction

Less burnout, more confidence, and better day-to-day experience.

0

Lower
staffing needs

client scaled their community without adding headcount.

0

Faster Response Times

Cut average resolution times by reducing 2–4 minutes of search per ticket.

0

Reduced typing effort

Auto-drafts and rephrasing slashed repetitive writing work.

0

More efficient workflows

Reduced external tool usage, creating a single streamlined inbox.

0

Higher moderator satisfaction

Less burnout, more confidence, and better day-to-day experience.

0

Lower staffing needs

client scaled their community without adding headcount.

0

Faster Response Times

0

Reduced typing effort

0

More
efficient workflows

0

Higher
moderator satisfaction

0

Lower staffing needs

For confidentiality reasons I have omitted the actual values for these metrics.

04. Introducing Flow AI

From responders to reviewers

With the redesign, moderators were no longer bogged down writing from scratch. Instead, they became approvers—reviewing AI-generated solutions, fine-tuning them with a human touch, and focusing their energy where it mattered most: empathy, nuance, and judgment.

Before Flow.ai, the moderator’s day was a blur of tabs, scattered documents, and mental juggling—each ticket a race against time with no room to breathe. Responses had to be written from scratch, brand tone had to be remembered, and long threads drained focus. With the new AI-powered inbox, the shift feels different. Moderators start with clarity, work with confidence, and finish knowing every response is fast, accurate, and unmistakably on-brand.

Flow in action

Hey Flow, Draft a solution!

Hey Flow, Draft a solution!

Flow.ai understands the context of each query and auto-drafts a tailored solution. Moderators simply review, tweak if needed, and send—reducing writing fatigue.

Flow.ai understands the context of each query and auto-drafts a tailored solution. Moderators simply review, tweak if needed, and send—reducing writing fatigue.

Impact: Reduced typing effort by up to 80% on repetitive or straightforward tickets.

Impact: Reduced typing effort by up to 80% on repetitive or straightforward tickets.

Quick action shortcuts

Actions appear before you even think of them.

Actions appear before you even think of them.

Flow.ai predicts the most relevant next steps for each ticket—whether that’s sending the drafted reply, escalating an issue, or pulling supporting content.

Flow.ai predicts the most relevant next steps for each ticket—whether that’s sending the drafted reply, escalating an issue, or pulling supporting content.

Impact: Cuts down decision time and click fatigue, allowing moderators to move faster.

Impact: Cuts down decision time and click fatigue, allowing moderators to move faster.

Ask complex questions

No more tab-switching for answers.

No more tab-switching for answers.

Moderators can ask detailed, multi-part questions and instantly get relevant answers from the Knowledge Base and past tickets, all without leaving the inbox.

Moderators can ask detailed, multi-part questions and instantly get relevant answers from the Knowledge Base and past tickets, all without leaving the inbox.

Impact: Saved an average of 2–3 minutes per ticket by removing context switching.

Impact: Saved an average of 2–3 minutes per ticket by removing context switching.

Summarizes the conversation

No more losing track of long threads.

No more losing track of long threads.

Flow.ai condenses entire conversations into quick, actionable summaries, so moderators can get the full picture in seconds and focus on resolving the issue.

Flow.ai condenses entire conversations into quick, actionable summaries, so moderators can get the full picture in seconds and focus on resolving the issue.

Impact: Cut onboarding time for complex threads by up to 70%.

Impact: Cut onboarding time for complex threads by up to 70%.

Tells you how confident it is

AI Confidence level is clear before sending.

AI Confidence level is clear before sending.

Each suggestion includes a confidence score, helping moderators decide when to send as-is and when to review more carefully.

Each suggestion includes a confidence score, helping moderators decide when to send as-is and when to review more carefully.

Impact: Builds trust and encourages smart AI adoption.

Impact: Builds trust and encourages smart AI adoption.

Always in control

Not taking over your workflow.

Not taking over your workflow.

Flow.ai suggests, you decide. Moderators stay in charge, approving, editing, or rejecting every draft to ensure the final response reflects human judgment and context.

Flow.ai suggests, you decide. Moderators stay in charge, approving, editing, or rejecting every draft to ensure the final response reflects human judgment and context.

Impact: Maintained 100% moderator oversight while cutting response times by up to 40%.

Impact: Maintained 100% moderator oversight while cutting response times by up to 40%.

Knowing the sources

No more guessing where information comes from.

No more guessing where information comes from.

Every AI suggestion cites its sources—whether from the Knowledge Base, past tickets, or trusted documentation—so moderators can quickly verify accuracy.

Every AI suggestion cites its sources—whether from the Knowledge Base, past tickets, or trusted documentation—so moderators can quickly verify accuracy.

No more guessing where
information comes from.

No more guessing where
information comes from.

Explain the thinking

Reasoning behind every draft is transparent.

Reasoning behind every draft is transparent.

Flow.ai offers clear reasoning for its suggestions, breaking down the logic and references behind each draft so moderators understand the “why” before sending.

Flow.ai offers clear reasoning for its suggestions, breaking down the logic and references behind each draft so moderators understand the “why” before sending.

Increases trust and reduces
hesitation when using AI drafts.

Increases trust and reduces
hesitation when using AI drafts.

04. How did we do it

First things first

This wasn’t a project we could afford to get wrong. The margin for error was zero. To stay close to the people we were designing for, I relocated to Bangalore for the Project

I embedded myself on the moderators’ floor, sharing a cabin with our product manager, working side by side with the people on the frontlines. I joined their standups like a new team member, listened in on manager feedback, tracked their KPIs, and even joined them for lunches, weekend outings, and casual conversations.

These moments offered unfiltered context into their motivations, frustrations, and unspoken workarounds.

05. Kickoff

Understanding every moving part before setting the course

In high-stakes projects, the kickoff is more than a formality—it’s the moment to define the battlefield. For me, it meant translating business goals, technical realities, and AI capabilities into a shared design vision that would hold under pressure.

Discovery

How did we do it ?

  • AVAILABLE ONLY FOR PORTFOLIO PRESENTATION

Explore More

Let's see some more work

5 min read

Sept 2021 -Feb 2022
Reimagining the
SIXT Car Rental flows.

Turning high-traffic dead

ends into high-converting journeys

Product Design

Generative AI

Viplav Upadhyay

Author

Read Case study

Create a free website with Framer, the website builder loved by startups, designers and agencies.