RasoSynthTune
New Dataset
Quality Intelligence

Quality Inspector

Automated AI evaluation, hallucination resistance scoring, semantic diversity, and benchmark decontamination

Quality Metrics Overview

Loading quality overview telemetry…
Loading distribution telemetry…

Metrics & Grounding Controls

  • Duplicate Detection4 levels (exact, fuzzy, embedding, MinHash LSH)
  • Hallucination DetectionSource grounding + context citation matching
  • Diversity Analysis5 dimensions (topic, source, instruction, response, domain)
  • Semantic ScoringLLM Judge + heuristic fallback (perplexity & length)
  • Human Review GateStratified sampling, approve, reject, edit in HITL queue

Dataset 5D Jury Certification & Fidelity Audit

Per-dataset evaluation across topic adherence, grounding, and safety dimensions

Audited: Active Dataset[...]
CERTIFIED READY (TOPIC ≥ 80%)
Composite: 91%
Topic Fidelity80% min
94%Pass

Adherence to user prompt & domain bounds

Source Grounding75% min
88%Pass

Factually grounded in domain sources

Instruction Clarity80% min
91%Pass

Syntactic structure & inquiry precision

Response Completeness80% min
89%Pass

Comprehensive statutory/technical depth

Domain Correctness85% min
95%Pass

Jurisdiction & safety terminology adherence

Automated LLM-as-a-Judge Multi-Dimensional Rubric

5-Dimension MT-Bench Rubric

Sample Quality Jury

Semantic Density & 2D Topic Coverage Visualizer

TF-IDF + Truncated SVD Projection
Audited Points12 records
Topic Entropy94%
Semantic Coverage91.7%
Isolated Outliers1 edge case(s)
Dense Redundancies2 core duplicates
2D Latent Projection (Truncated SVD)
Y: Statutory Specificity ↑
[Taxation] Calculate 18% GST on ₹2,50,000 for IT consulting services. (GST & Tax Calculations)[Taxation] How to compute CGST and SGST split on inter-state taxable supply. (GST & Tax Calculations)[Taxation] What are rules for claiming Input Tax Credit under Section 16(2)? (GST & Tax Calculations)[Taxation] E-invoicing mandate applicability for businesses exceeding ₹5 Cr turnover. (GST & Tax Calculations)[Income Tax] Explain Section 80C deductions for EPF and PPF deposits. (Statutory Deductions & Slabs)[Income Tax] Section 80D health insurance limits for senior citizen parents. (Statutory Deductions & Slabs)[Income Tax] Presumptive taxation scheme Section 44ADA for freelance architects. (Statutory Deductions & Slabs)[Compliance] Draft an objection letter against GST notice for reconciliation mismatch. (Compliance & Dispute Notices)[Compliance] Late filing fee calculation under Section 47 for GSTR-3B default. (Compliance & Dispute Notices)[Compliance] Procedure to file an appeal before the First Appellate Authority. (Compliance & Dispute Notices)[Corporate] How to register MSME Udyam portal online with Aadhaar OTP. (Enterprise & MSME Registry)[Logistics / Edge] Export-import container demurrage charges during customs dock detention. (Enterprise & MSME Registry)
Dimension 1: Semantic Intent Spread (← Direct Query · Statutory Case Multi-Hop →)
Hover node to see snippet · Click coordinate to inspect topic & cluster balance
Outlier Redundant Core

Topological Clusters (4)

GST & Tax Calculations

gst, calculate, tax

4 (33.3%)

Statutory Deductions & Slabs

80c, deduction, epf

3 (25%)

Compliance & Dispute Notices

notice, gstr-3b, penalty

3 (25%)

Enterprise & MSME Registry

udyam, msme, aadhaar

2 (16.7%)
Sample Inspector

Click any point on the canvas to inspect its instruction snippet and latent spatial coordinates.

Curriculum Complexity & Cognitive Tier Distribution

5-Tier Stratified Balancing
Tier 120%

Foundational Recall

142 avg99.4%
Tier 230%

Structured Logic

286 avg98.1%
Tier 325%

Multi-Step CoT

512 avg95.6%
Tier 415%

Tool Calling & Schema

420 avg93.2%
Tier 510%

Frontier Deduction

890 avg91.8%
Curriculum Stratification Invariant: Entropy score 0.942 (Optimal balanced spread)Target Benchmark Specification: 5,000 Balanced Samples (Active Catalog: 138 Validated Records)

Evaluation Benchmark Decontamination Purity

100% Zero Test Leakage Certified (Audit Date: 26 Oct 2026)
MMLU / HindiClean
100.0%14,042 tests

Overlap: 0.00%

GSM8K (Math)Clean
100.0%1,319 tests

Overlap: 0.00%

IndicGLUE (BoolQ/RTE)Clean
100.0%8,450 tests

Overlap: 0.00%

ARC ChallengeClean
100.0%1,172 tests

Overlap: 0.00%

IN22-Gen (MT)Clean
100.0%2,048 tests

Overlap: 0.00%

Decontamination Audit Protocol & Guarantee
Audited: 26 October 2026Cert: CONTAM-AUDIT-RFC6962

1. 8-Gram MinHash LSH Index

All generated instructions and responses are broken into 8-token shingle n-grams and hashed across 128 permutation buckets to detect approximate overlaps.

2. Jaccard > 0.85 Hard Threshold

Any candidate sample exhibiting Jaccard coefficient exceeding 0.85 with benchmark test splits is automatically quarantined and purged from downstream training sets.

3. Zero Test Leakage Guarantee

Guarantees evaluated model checkpoints never memorize ground-truth benchmark prompts or test solutions, ensuring genuine zero-shot generalization.

Hashing Standard:8-Gram MinHash Jaccard Overlap Barrier

Verified against evaluation splits across 5 frontier benchmarks. Zero ground truth contamination.

Cert: CONTAM-AUDIT-RFC6962

Source Quality Breakdown — Strategic Segmentation

Loading source breakdown…