tracking: remove/replace explorers superseded by MDIMs

[lucasrodes]

One-liner

Track the removal (or replacement by MDIMs) of legacy explorers now that they've been migrated into ETL.

Context

Split out from #6028 (now closed), which tracked the migration of all explorers into ETL. Migration is essentially complete — the last one, global-health, is tracked in #6513. This issue tracks the remaining removals.

Pending removals

• natural-disasters — Grapher — redirects: natural-disasters explorer views → MDIM views (prep for explorer removal) #6167
  • The explorer can't be removed until we can redirect explorer views to mdim views, but the mapping is linked in the issue. When bulk redirect for explorers is ready, the mapping is here: https://github.com/user-attachments/files/28349817/nd_view_review.json
• energy — Grapher — 🔨 explorers: migrate energy #6054 📊 energy: Update Statistical Review and refactor energy namespace #6393
  • Pablo is checking with Hannah
• incomes-across-distribution-wid — CSV — https://github.com/owid/owid-issues/issues/2179
• incomes-across-distribution-wb — CSV — https://github.com/owid/owid-issues/issues/2179
• inequality — CSV — https://github.com/owid/owid-issues/issues/2179
• inequality-wid — CSV — https://github.com/owid/owid-issues/issues/2179
• inequality-wb — CSV — https://github.com/owid/owid-issues/issues/2179
• poverty-wb — CSV — https://github.com/owid/owid-issues/issues/1994
• poverty-explorer — CSV — https://github.com/owid/owid-issues/issues/1994

Already removed

• inequality-comparison
• incomes-across-distribution-comparison — CSV
• poverty-explorer-2011-vs-2017-ppp
• poverty-comparison
• ukraine-russia-food

Notes:

• Income/Inequality explorers to be removed as we work on income TP redesign.
• Poverty explorer unclear.

Relevant skills

Replacing an explorer with one or more MDIMs (and redirecting its views) roughly follows this pipeline:

1. /create-multidim — build the replacement MDIM(s) if they don't exist yet.
2. /map-explorer-to-mdim — suggest a redirect mapping from the sunsetting explorer's views to the replacement MDIM view(s); pulls views from the grapher DB, writes CSV proposals, and flags when several explorer views collide on the same MDIM view.
3. /review-explorer-mdim-mapping — generate a self-contained side-by-side HTML (in ai/) with approve/flag controls so a human can sign off on each explorer→MDIM view mapping before it's applied. Consumes the output of /map-explorer-to-mdim. (The nd_view_review.json artifact attached for natural-disasters above is this kind of mapping.)

Note: redirects can't actually be applied until bulk explorer→MDIM view redirect support is ready (see natural-disasters above).

Reference

• Tracking spreadsheet: https://docs.google.com/spreadsheets/d/1JV2Am1ivyPGhpZd5aC3XCKa_LA9FU_cS-nsS0o14Nyk/edit?usp=sharing
• Original tracking issue: tracking: port all explorers into ETL #6028

[lucasrodes]

I've listed here all the explorers that are due removal from my understanding.

@pabloarosado Could you confirm that:

• /energy will be removed and replaced by MDIMs.
• /natural-disasters will be removed too. The redirects are already finished and ready for once we can implement them.

So, it looks to me that the blocker here is mostly the redirect tool, right?

@paarriagadap Could you confirm that:

• Income (/incomes-across-distribution-wid, /incomes-across-distribution-wb) and Inequality (/inequality, /inequality-wid, /inequality-wb) explorers will be removed once we close https://github.com/owid/owid-issues/issues/2179.
• Poverty (/poverty-wb, /poverty-explorer) explorers will be removed once we close https://github.com/owid/owid-issues/issues/1994.

If I remember well, the redesign for Income/Inequality was planned for June, and the one for Poverty didn't have really a date in mind. Could you update me on the timings here? No stress, just so I can better track this.

Thanks!
(Also, please let me know, at any point, if you need any hand in any of this!)

[paarriagadap]

@lucasrodes The inequality page will be released next Monday and I expect to deprecate all those income and inequality explorers during the week. I already replaced the references in articles and will use Marcel's tool for a bulk-redirect.

For poverty we want to have a small edit in the current data page to replace the current explorer with two mdims. That should happen in the next 1-2 months. Almost there!

[pabloarosado]

Hey @lucasrodes correct, natural disasters should be mapped into the new MDIMs, and the energy (and fossil fuels) explorers will die soon (together as part of the big energy refactor I'm doing now).

[paarriagadap]

Hi @lucasrodes!

I removed the 5 inequality/income explorers. I also archived the related files in ETL. Now I only have two to go!

I updated the checklist above and the spreadsheet.

I set redirects to the MDims (currently not working).