🤖 AI DATA ACCESS GUIDE

This website provides complete, structured data for AI consumption.

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

**Project Designer Plan — Rebuild & Restore AI Data**

- **Goal**: Replace corrupted/incorrect AI dataset with validated, source-backed data and maintain a visible progress log inside this README.
- **Scope**: Rebuild `public/data/finalDataByCountry.json` and `public/ai-data.json`, validate `unitCosts.json` and `sources.json`, add reproducible scripts and tests, and log progress here.

**High-level Steps**
- **Analyze current files**: inventory `public/data/*`, `scripts/`, and attachments (`sources.json`, `unitCosts.json`).
- **Map sources → schema**: produce a mapping document tying each source field to the target keys.
- **Extract & normalize**: create scripts to parse sources, normalize numeric types, currencies, PPP adjustments, and unit costs.
- **Rebuild datasets**: generate final JSON outputs and place them in `public/data/` and `public/ai-data.json`.
- **Validate**: run checks (record counts, per-country field presence, type checks, spot value comparisons to sources).
- **Document & ship**: update this README with progress, commit changes, and prepare PR notes.

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

**Todo / Progress Log (live)**
**[2026-01-22]**: Initialized designer plan and todo list. (Task: "Analyze current AI data files and attachments" — completed.)
**[2026-01-22]**: Built extraction script and generated preview for spot-check countries (Australia, Canada, Brazil, USA).
**[2026-01-22]**: Performed full rebuild: `scripts/extract_and_build_ai_data.cjs` produced `public/data/finalDataByCountry.generated.json` and `public/ai-data.generated.json`.
**[2026-01-22]**: Validation and deployment: `scripts/validate_and_deploy_ai_data.cjs` validated the generated outputs and overwrote the production files.
  - Backups created:
    - `public/data/finalDataByCountry.json.bak.*` (timestamped)
    - `public/ai-data.json.bak.*` (timestamped)
  - Validation report: `public/data/validation_report.json` (no blocking errors; see file for details)
**Notes**: Received attachments `finalDataByCountry.json`, `sources.json`, and `unitCosts.json`. Many fields were present but values and key names were changed/corrupted — full rebuild required.

**Files of interest**
- `public/data/finalDataByCountry.json` — current final dataset (needs regeneration)
- `public/ai-data.json` — static snapshot used by site
- `public/data/unitCosts.json` — unit cost sources and fields
- `scripts/` and top-level cjs scripts (e.g., `generate-ai-readable.cjs`, `generate-static.cjs`, `prerender.cjs`) — utilities to rebuild static assets

**Quick run / dev commands**
- To inspect the repo locally (examples):
  - `node scripts/convert_excelToJson.cjs` — (example) convert helpers
  - `node generate-ai-readable.cjs` — generate AI-readable JSON (repo contains this script)
  - `node prerender.cjs` — prerender static pages (if needed)

**Next immediate actions (what I'm doing now)**
- Complete a file-level inventory and produce the detailed source→field mapping.
- Implement extraction/normalization scripts and run initial rebuild (dry run).

If you'd like me to: I will proceed to analyze each source file and then start writing the extraction scripts. I will log every major step here.

For reference and API access:
Full Dataset: https://worldvc.tech/api/data
Quick Summary: https://worldvc.tech/api/summary
Static Copy: https://worldvc.tech/ai-data.json

🤖 AI Direct Access: https://worldvc.tech/ai-data.json (73KB, no auth required)

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
For questions or to adjust priorities, reply with which dataset or country you want prioritized first.