Control

Variant

New User Registration Redirect

My Keen : NPR vs Particular Audience (FBM > 91)

Loyalty Program Test

Loyalty Migration

Recharge Modal Test

Loyalty Double Points Promotion

Personalization > Sort > Pre-Reg to FBM (FbmAdvisorsV2 vs. FbmAdvisorsV4)

New user Price Bucket Test

Allocation 1 - ML/FL

Personalization > Sort > FBM to FBM + 14 days (Grandfathered)

Allocation 1: TROS2/FL

Personalization > Sort > FBM to FBM + 91 days

Keen Elastic Category Rollout for Pre-FBM Users

BestMatch Category Popup

Machine Learning > Internal Recommendations v0 vs v1

Fbm14Day_PriceFilter

PaymentFlowV2

Mid_Chat_Recharge_V2

Homepage_Unauthenticated

Homepage_Unauthenticated_v2

Homepage_Unauthenticated_v4

Variant - ios>60

ios>60

Variant - ios<60

ios<60

Keen Rewards > Ad Hoc CampaignV2 Threshold Test

Keen Rewards > Transcend Users Double Points Campaign

Keen Rewards > Churned Users Campaign

PaymentFlowV3

Keen Rewards > Post-FBM 7-Day Bonus

Chat_Versions

Personalization > Sort > Activating Users Day 1-28 (TROS2 vs. TROS3)

Personalization > Sort > Post Day 28 Users (TROS2)

Minimum_Amount_Recharge_V3

Variant - LV&MV

low_medium_value

Variant - HV

high_value

Variant - VIP

Keen Rewards > Duration Campaign

NextJS_Registration_Redirect

You score a one-sentence advisor match summary against the customer's query and the
matched advisor's profile, considering:
- Relevance: it names the customer's actual topic from their query.
- Faithfulness: every claim about the advisor is grounded in the profile — no invented facts.
- Gender-neutrality: NO gendered pronouns (he, she, him, her); penalise heavily if present.
- Form: one natural sentence, addresses the customer with "you"/"your", no advisor name, not cut off.
0.0 = irrelevant/hallucinated/gendered. 1.0 = excellent.

RESPONSE TO EVALUATE:
{{response_to_evaluate}}


ing-gpt-4.1-nano

Azure

You are an evaluation judge for a psychic advisor search platform. You score how well
the model's JSON analysis (the response) captures the user's raw search query, considering:
- isValid is correct (true for psychic/spiritual/emotional topics, false for off-topic).
- listingCategory and categories are the best matches for the query (or null when general).
- tone correctly reflects the user's emotional state (emotional / action / neutral).
- expandedQuery preserves the user's original intent without inventing new requests.
- intent is an accurate one-line description of what the user wants.
0.0–0.3 = wrong or misleading. 0.4–0.7 = partially correct with gaps. 0.8–1.0 = fully accurate.

Psychic Third Eye

Love And relationship Expert

Psychic Third Eye in Love & Relationships | Psychic Readings Advisor at KEEN

Customers frequently praise the advisor for being accurate, quick to connect, honest, and kind, with many noting their ability to pick up on situations and provide detailed, helpful guidance. Several customers mention returning for multiple readings and express strong trust, though a few note slower response times or feel the advisor did not fully understand their situation.

Psychic Third Eye

4.80

4.80