Inside the Text Conversation Rewards System: A Technical Deep Dive

The Text Conversation Rewards system is a sophisticated UbiquityOS Plugin that revolutionizes open source collaboration by implementing an AI-powered reward mechanism for quality contributions. Let’s dive deep into its technical architecture and understand how it works under the hood.

Core Architecture

The system is built on a modular architecture with several key components that work together to evaluate, incentivize, and reward contributions:

Content Evaluation Engine

At the heart of the system is a sophisticated content evaluation module that leverages OpenAI’s GPT-4o model to analyze the quality of contributions. Here’s how it works:

The system processes both issue comments and pull request review comments through different evaluation pipelines.

For issue comments, it generates a context-aware prompt that includes:

The original issue description

All comments in the conversation for context

The specific comments being evaluated

The evaluation process handles GitHub-flavored markdown intelligently:

It distinguishes between quoted text (starting with ‘>’) and original content

Only evaluates the commenter’s original contributions

Considers the relationship between comments and their context

The AI model assigns relevance scores from 0 to 1:


interface Relevances {
  [commentId: string]: number; // 0 = irrelevant, 1 = highly relevant}

Review Incentivization System

The review incentivization module implements a sophisticated algorithm for rewarding code reviews:


interface ReviewScore {
  reviewId: number;  effect: {
    addition: number;    deletion: number;  };  reward: number;  priority: number;}

The system calculates rewards based on: 1. The scope of code reviewed (additions + deletions) 2. Issue priority labels 3. The conclusiveness of the review (APPROVED or CHANGES_REQUESTED states receive additional credit) 4. File-specific exclusions through pattern matching

Permit Generation and Reward Distribution

The permit generation module handles the secure distribution of rewards:

Security Checks:

Validates that the issue is collaborative

Verifies private key permissions against organization and repository IDs

Implements a multi-format encryption system for private keys:


Format 1: PRIVATE_KEY:GITHUB_OWNER_ID
Format 2: PRIVATE_KEY:GITHUB_OWNER_ID:GITHUB_REPOSITORY_ID

Fee Processing:

Automatically calculates and deducts platform fees

Supports token-specific fee exemptions through whitelist

Creates treasury allocations for fee distribution

Reward Distribution:

Generates ERC20 token permits for each contributor

Stores permit data securely in a Supabase database

Creates claimable reward URLs in the format: https://pay.ubq.fi?claim=[encoded_permit]

Technical Implementation Details

Token Management

The system uses decimal.js for precise token calculations:


const feeRateDecimal = new Decimal(100).minus(env.PERMIT_FEE_RATE).div(100);const totalAfterFee = new Decimal(rewardResult.total)
  .mul(feeRateDecimal)
  .toNumber();

Smart Token Handling

For large conversations, the system implements intelligent token management:


_calculateMaxTokens(prompt: string, totalTokenLimit: number = 16384) {
  const tokenizer = encodingForModel("gpt-4o-2024-08-06");  const inputTokens = tokenizer.encode(prompt).length;  return Math.min(inputTokens, totalTokenLimit);}

Database Integration

The system maintains a comprehensive record of all permits and rewards:


interface PermitRecord {
  amount: string;  nonce: string;  deadline: string;  signature: string;  beneficiary_id: number;  location_id: number;}

Real-World Impact

This technical architecture enables several key benefits:

Objective Evaluation: By using AI for content evaluation, the system provides consistent and unbiased assessment of contributions.

Granular Rewards: The system can differentiate between various types of contributions and reward them appropriately based on their impact and quality.

Secure Distribution: The multi-layered security system ensures that rewards are distributed only to legitimate contributors and within authorized repositories.

Transparent Tracking: All evaluations and rewards are permanently recorded and traceable through the blockchain and database systems.

The system represents a significant advancement in open source collaboration tools, providing a technically sophisticated yet user-friendly way to incentivize and reward quality contributions. Its modular architecture allows for future expansions and customizations while maintaining security and reliability at its core.