Pilot case study

Web3Payments × CommunityPulse

Telegram · 14 July to 16 November 2026

Web3Payments builds the payment, presale and staking tools that Web3 teams use to launch their tokens. They ran CommunityPulse in their own Telegram group for four months, to test it with real members, and let us share what happened. Every number below comes straight from the bot.

Who they are

Token launch infrastructure for Web3 teams: a presale payment widget, smart contracts, on-chain staking dashboards and a concierge service that takes a project from tokenomics to launch.

$750M+
in transactions enabled by their tools
500+
cryptocurrencies accepted
118+
countries supported

Figures from Web3Payments' own website.

  • They work with partners such as CredShields on safer token launches, and had a booth at TOKEN2049 Singapore in October 2026.
  • CommunityPulse runs in both their communities: their Telegram group since July (1,289 members) and their Discord server since August (1,635 members).

Website: web3paymentsolutions.io

“Our member count told us we were growing. CommunityPulse showed us who was actually staying and talking, and the quests got members replying to each other instead of just saying GM. We liked it enough to add it to our Discord too.”

— The Web3Payments team

The results

18×
more replies from members in the first week of quests
3.4×
more messages from members in that same week
7×
more messages from members who did quests than from those who didn't
2/3
of everything members wrote came from the 30 members who did quests

Quests got members talking

In the first week of quests, members wrote 18 times more replies than the week before.

Quests started on 21 July, a week after CommunityPulse joined the group:

Week before questsFirst week of questsChange
Messages from members19653.4 times more
Replies from members23718 times more
Questions from members11010 times more

Before quests, most member messages were a one-line "hi" or "GM" that nobody answered. Once quests started, members wrote more than three times as much, replied to each other and asked questions. About the same number of people were writing (17, then 13). What changed was how much they talked.

  • 30 members completed 103 daily quests, on 51 different days. 19 of them did more than one, and the most active member did 24.
  • More than half of the completed quests were about talking to others: asking a question, replying to someone or mentioning another member.
  • The 30 members who did quests wrote 7 times more than the rest, and were active on 3 times as many days.
  • 59 members earned points, the bot posted 99 leaderboards in the group, and 12 members unlocked 21 achievements.

To be fair: the comparison is one week against one week, because that's how long the bot had been in the group before quests started. At least 20 of the 37 replies answered another member; the bot only started recording who each reply was to on 22 July. And the most active members are also the most likely to do quests, so this doesn't prove quests alone made them active. It does show quests gave members an easy reason to talk.

The member count was hiding the real picture

In August and September, 414 people joined the group. By member count, that was their strongest stretch of growth. Here is what CommunityPulse showed happened to those 414.

Joined in August and September414
Wrote at least one message61
Still writing after their first week7

Most of them arrived in waves on single days, and 158 left within a day. The number that matters is how many new members are still active a week later, and that is the one no member count can give you.

The pilot made CommunityPulse better

Web3Payments' group gave us something no test can make up: real crypto chat. We used it to check the bot's AI:

  • Mood reading: on 378 real messages from their group, the bot read the mood correctly 78% of the time. We fixed what it got wrong, and it now gets 94% right.
  • FAQ answers: we tested the bot's answers against their real list of 20 FAQs. It showed that a very short answer can end up posted under the wrong question, so the dashboard now warns teams when an answer is very short.
  • Translations: their real announcements were part of our translation test, in 10 languages. 27 of the 30 translations were fine to post as they were.

Team performance, work shifts and Referrals were tested separately, with their own test cases. Every test and its result is on our Test results page.

If your group looks bigger than it talks

Web3Payments' group isn't unusual. Many crypto groups have a big member count and a small core doing the talking. That's what CommunityPulse is built for:

  • See who's really active, and whether the people you bring in are still there a week later.
  • Give members a reason to talk, with daily quests, points, leaderboards and achievements.
  • Find out which campaign or KOL brings members who stay, with a tracked invite link for each.

Also running in their group

140 AI summaries for the team99 leaderboards postedAnnouncements in 5 more languagesFAQ answers the bot learned from the team
All the numbers

Quests

  • Quests ran on 98 days. 30 members completed 103 of them, on 51 different days.
  • 19 members completed more than one quest, 5 completed five or more, and the most active member completed 24.
  • 11 members came back to do quests on more than one day.
  • 53 of the completed quests were about talking to others: asking a question (22), replying to someone (18) or mentioning another member (13).
  • The busiest day was 27 August, with 11 quests completed.
  • The 30 members who did quests wrote 351 of the 523 member messages, 11.7 messages each on average against 1.7 for everyone else, and were active on 4.1 days against 1.3.

Points, leaderboards and achievements

  • 59 members earned 438 points. Almost half of them (206) came from quests.
  • The bot posted 78 daily, 17 weekly and 4 monthly leaderboards in the group.
  • 12 members unlocked 21 achievements, including Veteran (16 members, 4 of them at silver level for 2 months or more), Streak Keeper, Regular, Quest Grinder and Shoutout.

New members

  • On 7 September, 56 people joined and 30 of them left the same day.
  • Of the 414 who joined in August and September, 158 left within a day, 178 within a week, 61 ever wrote a message and 7 were still writing after their first week.

The team's side

  • 140 AI summaries of the group (122 daily, 18 weekly), so the team could see what happened without reading every message.
  • The team's 2 main pinned announcements were translated into Spanish, Portuguese, Russian, Turkish and Chinese. Members tap their language under the pinned message and read it on its own page.
  • 20 approved FAQ answers ready for members, 6 of them learned by the bot from the team's own replies in the chat.
  • Mood check: of 552 member messages, 18% were positive, 78% neutral and 3% negative.

Try it in your community

Free for 30 days. Add the bot as an admin and the trial starts by itself.

← Back to home