**Goal**: Validate that all data references in papers and manuscripts correspond to registered data sources, ensuring no fabricated citations.
/plugin marketplace add syfyufei/adrian-marketplace/plugin install truth-verification@LLM-Research-MarketplaceGoal: Validate that all data references in papers and manuscripts correspond to registered data sources, ensuring no fabricated citations.
When to use: Before finalizing papers, ensure every data claim references actual registered files.
Before running this command:
.truth/manifest.json exists with registered data files/truth-verification:register if needed)/truth-verification:cite-check --paper paper/manuscript.md
/truth-verification:cite-check --directory paper/manuscripts
/truth-verification:cite-check --paper paper/manuscript.md --strict-mode
/truth-verification:cite-check --paper paper/manuscript.md --report-orphaned-data
/truth-verification:cite-check --paper paper/manuscript.md \
--patterns "data/.*\.csv,file:data/[a-zA-Z0-9_-]+\.(csv|json)"
/truth-verification:cite-check --paper paper/manuscript.md \
--report-format detailed --output citation-report.txt
Paper Scanning:
data/raw/dataset.csvfile:data/raw/dataset.csvhttps://example.com/data.csvdata/raw/dataset.csv:line42Reference Validation:
Orphaned Data Detection (optional):
Citation Index Creation:
Report Generation:
Manifest Update (optional):
--update-manifest)✓ Citation Validation Complete
Paper: paper/manuscript.md
Total references: 12
Verified: 12
Unregistered: 0
External: 0
Status: ALL CITATIONS VERIFIED ✓
Verified Citations:
✓ data/raw/dataset.csv (line 23)
✓ data/raw/metrics.csv (line 45)
✓ data/cleaned/results.csv (line 78)
... (9 more verified)
⚠ Citation Validation Complete (with issues)
Paper: paper/manuscript.md
Total references: 12
Verified: 10
Unregistered: 2
External: 0
Unregistered References:
❌ data/raw/missing_dataset.csv (line 89)
Status: FILE NOT IN MANIFEST
Suggestion: Register file with /truth-verification:register
❌ results/analysis_output.csv (line 102)
Status: FILE NOT IN MANIFEST
Suggestion: Register file or correct citation
Orphaned Data (in manifest but not cited):
⚠ data/raw/old_backup.csv - Never cited in papers
Suggestion: Remove if obsolete, or add citation if needed
| Error | Cause | Solution |
|---|---|---|
| "Paper file not found" | File path doesn't exist | Verify paper file location |
| "No citations found" | Paper has no data references | Check citation patterns match your format |
| "Invalid manifest" | .truth/manifest.json corrupted | Restore from backup or reinitialize |
| "Cannot read paper file" | Permission denied or corrupted file | Check file permissions |
After successful execution:
--report-orphaned-data)--update-manifest)Supported formats:
data/raw/dataset.csvdata:raw/dataset.csv or file:data/raw/dataset.csvdata/raw/dataset.csv:42 (reference specific line)[Dataset](data/raw/dataset.csv)\cite{data/raw/dataset.csv}https://example.com/data.csvDefault patterns defined in config/config.json:
"citation_patterns": [
"file:path/to/file",
"data/[a-zA-Z0-9_-]+\\.csv",
"codes/[a-zA-Z0-9_-]+\\.py",
"paper/figures/[a-zA-Z0-9_-]+\\.(png|jpg|pdf)"
]
In strict mode (--strict-mode):
/truth-verification:cite-check --paper manuscript.md --strict-mode
# Returns error if any citations unverified
/truth-verification:cite-check --directory paper/manuscripts --recursive
Validates all papers in directory and subdirectories.
/truth-verification:cite-check --directory paper/manuscripts \
--cross-reference --report-data-usage
Shows which data files appear in which papers.
/truth-verification:cite-check --paper manuscript.md \
--include-audit-trail
Records when each citation was first verified.
/truth-verification:cite-check --paper manuscript.md \
--auto-fix-paths
Attempts to find correctly spelled file paths and suggest corrections.
Complete validation workflow:
# 1. Initialize
/truth-verification:init
# 2. Register all data
/truth-verification:register --recursive --dir data/
# 3. Track script execution
/truth-verification:track --script codes/analysis.py ...
# 4. Verify data integrity
/truth-verification:verify
# 5. Check paper citations
/truth-verification:cite-check --paper paper/manuscript.md --strict-mode
# 6. Generate reproducibility report
/truth-verification:reproduce --generate-report
# 7. Publish with confidence
After validating citations:
/truth-verification:reproduce to validate complete chain/truth-verification:audit before publication.truth/ to version control with manuscript/truth-verification:register - Register data files/truth-verification:track - Record script execution/truth-verification:reproduce - Validate reproducibility (Phase 3)/truth-verification:audit - Generate comprehensive audit reports (Phase 4)/truth-verification:verify - Check data integrity