A prioritized, living to-do list for robotnewstoday.com, ordered by bang-for-buck (impact ÷ effort) and built to ride the AI-citation wave this site is catching. Click any row for the why & how. Click a column header to sort.
Jun 20 hit 2,283 requests / 700 visits — roughly 10× the ~200/day baseline. It is not one viral human moment. It breaks into three streams:
1) AI & search crawlers devouring the machine-readable layer — GPTBot, Googlebot and Bingbot are hammering AGENTS.md, openapi.json and llms.txt. 2) A synthetic scraper farm faking dozens of macOS Chrome user-agents (noise; inflates the count). 3) The valuable part: real humans referred by ChatGPT — 13 clicks today and 49 in 14 days, climbing. Answer engines are now citing this site as a source. That is the Agents-First build paying off.
The play: feed the crawlers more fresh, structured, attributed robotics content so citations grow — and convert the humans those citations send, especially on consumer-robot (vacuum / humanoid) pages where buying intent is highest. Every action below serves one of those two goals.
| No | Rank | Cat | Date | Action |
|---|---|---|---|---|
| 1 | 99 | Monetize | 2026-06-23 | Ship a "Best Robot Vacuums & Home Robots 2026" buyer-guide hub at /guide/best-robot-vacuums/ |
Highest-converting page you don't have yet. "Robot vacuum" already shows up in your top-crawled pages, and you publish consumer-robot news constantly (yeedi, Roomba, Dreame IPO, robot lawnmowers, Unitree consumer mech). A dedicated comparison-table guide catches the ChatGPT/Google shopper at the moment of buying intent. How: 6–8 picks in a sortable table (model · price · suction · self-empty · mop · deep-link), Amazon tag=colinfirthfan-20 plus Impact deep-links where they pay more, and Product+ItemList schema so answer-engines quote the table. Cross-link it from every consumer-robot article. This is the single best dollar-per-hour move on the list. | ||||
| 2 | 96 | AI / Agents | 2026-06-23 | Feed the crawler wave: keep llms-full.txt + a /api/latest.json news feed fresh on every publish |
This is literally why the traffic came. GPTBot, Googlebot and Bingbot are pulling the agent-first files; ChatGPT is citing you back to humans. Starve that and the wave fades. How: on each news-publish run, regenerate llms-full.txt from all 236 articles and emit a machine feed of the latest 50 items (title, ISO date, 1-line summary, canonical URL, original source) at /api/latest.json; ping IndexNow. The more current and structured the feed, the more often answer engines name you as the source. | ||||
| 3 | 92 | Monetize | 2026-06-24 | Backfill the ~18 news articles still missing the promo-pick / AdSense block |
Pure upside, near-zero effort. 218 of 236 articles carry Amazon promo-picks and 223 carry AdSense — but ~18 are taking crawler + ChatGPT traffic with no unit on the page, leaking money. How: diff the live /news/ set for files lacking promo-pick / adsbygoogle, run the promopicks-v2 + AdSense injector over just that gap set, and spot-check the render. Knock this out same-day as #1. | ||||
| 4 | 90 | Trends | 2026-06-26 | Publish 3 named explainers on the exact topics AI is citing you for |
Not "an explainer" — these three, because they're the queries already pulling citations to your top pages: (a) Tesla Optimus Gen3 production ramp — what's real vs hype; (b) the China-vs-US humanoid race (you already rank for "China tops robotics rankings"); (c) Figure's commercial deployments (BMW, retail). How: 1,000–1,500 words each, real numbers, one comparison table, Article+FAQ schema, and a link down to the #1 buyer guide / #8 humanoid tracker so the AI-referred reader lands somewhere monetized. | ||||
| 5 | 86 | Content | 2026-06-29 | Deepen the 5 pages answer-engines already quote most |
Your most-cited evergreen pages (Tesla Optimus Gen3 preview, Figure vs Optimus, China tops robotics rankings, Meta humanoid acquisition, Reachy / uncanny-valley) earn the citations — make them the deepest pages on the topic so the citation sticks and dwell time rises. How: refresh each with 2026 data, add a spec/comparison table, and a "what you can actually buy / pre-order today" footer that routes to affiliate. Depth is what separates you from a thin news template and keeps the AI quoting you over a competitor. | ||||
| 6 | 80 | Monetize | 2026-07-02 | Add an Impact smart-home / robotics sponsor strip to the buyer guide + consumer-robot articles |
Impact deep-links (account 7403955) often out-pay Amazon on home-robotics SKUs — Ecovacs, Dreame, Anker/eufy where available. How: add a compact sponsor strip (the /sponsor/ endorsement model, not per-event ticket links) on the buyer guide and the highest-traffic consumer-robot articles; for each product compare the Amazon vs Impact payout and link the higher one. Check the brands worksheet for which are already approved before applying. | ||||
| 7 | 72 | SEO | 2026-07-06 | Sitewide Article + FAQ + Product + breadcrumb structured data |
Schema is what lets answer-engines cite you cleanly and earns rich results — and you're already being crawled hard, so make every hit quotable. How: ensure every news article emits Article with author/date/publisher, every buyer guide emits Product/ItemList, and FAQ blocks carry FAQPage. Add BreadcrumbList so the path home → section → article is machine-clear. | ||||
| 8 | 66 | Content | 2026-07-09 | Build a living "Humanoid Robot Tracker" comparison page |
Optimus vs Figure vs 1X vs Unitree vs Apptronik vs Boston Dynamics — specs, price, height/payload, status, maker, in one sortable table. Definitive reference pages are citation magnets and rank for every "X vs Y robot" query. How: reuse the alldomains worksheet pattern (sortable rows, click-to-detail), keep it current as news breaks, and monetize with pre-order / book-a-demo affiliate links where they exist. Feed it from the same data that powers /api/latest.json. | ||||
| 9 | 60 | Fresh | 2026-07-12 | Confirm the news cron is 2×/day, attributed, and IndexNow-pinged |
Freshness is the fuel for the crawler wave. How: verify the publish cron runs twice daily, every item is attributed with an outbound source link, each run pings IndexNow, and nothing has silently stalled. A day of no fresh items is a day the AI crawlers find nothing new to cite. | ||||
| 10 | 56 | Video | 2026-07-15 | Refresh /videos/ with current, embeddable robot demos |
Swap stale or non-embeddable clips for current Optimus / Figure 03 / Unitree / Atlas demos. How: verify each with check-embed.mjs (status.embeddable), drop any that block embedding, renumber to keep the list clean. Authoritative demos only — no clickbait. Video raises dwell time on the pages ads sit on. | ||||
| 11 | 52 | SEO | 2026-07-18 | Tighten internal links: every news article → relevant buyer guide / tracker → home |
Right now an AI-referred reader lands on one article and often leaves. Route them. Each consumer-robot article should link to the #1 buyer guide; each humanoid article to the #8 tracker. A tight internal web spreads authority to the money pages and keeps visitors moving instead of bouncing. | ||||
| 12 | 48 | Design | 2026-07-21 | Run the Agents-First scorer and hold 90+ |
The machine-readability that's earning citations is exactly what the AF scorer measures — keep it tuned. How: run the live AF scorer, close any gaps in clarity, internal links and machine-readable endpoints, target 90–100. This site's whole traffic story is proof the principle works; don't let the score slip. | ||||
| 13 | 40 | Hygiene | 2026-07-24 | Filter the synthetic scraper-farm noise so real numbers stand out |
The Jun-20 count was padded by a scraper farm faking ~250+ macOS Chrome user-agents — it wastes bandwidth and hides the genuine signal (real AI crawlers + ChatGPT humans). How: add a light nginx rate-limit / UA filter for the obvious flood patterns so stats reflect real visitors. Low priority, but it makes every future "why did traffic move" question honest to answer. Don't block GPTBot/Googlebot/Bingbot — those are the wave. | ||||
| 14 | 36 | SEO | 2026-07-27 | Collapse the www / non-www duplicate-host noise to one canonical |
Logs show traffic split across robotnewstoday.com, www., http and https variants. Pick one canonical host (the homepage canonical currently points at www.), 301 the rest to it, and make sure the sitemap + canonicals all agree. Consolidates link authority and stops answer-engines citing two URLs for the same page. | ||||
| 15 | 88 | Trends | 2026-07-12 | Keep the "money & markets" robot thread current — market-size, China's deployment lead, the AI-cost reality |
The stories AI and investors search for most. Published the anchor piece at /reports/decade-of-the-robot-2026/ plus four 2026-07-12 news items (Barclays $200B market, China at ~85% of humanoid installs, Uber's AI-cost blowout, Burry's chip short). How: refresh the report's numbers each time Barclays / IFR / TrendForce or a megacap capex figure moves, and keep an outbound source link on every claim so answer-engines quote you as the source. This is the highest-intent, most-citable robotics topic right now. | ||||
| 16 | 64 | Content | 2026-07-15 | Add a market-size + China-vs-US scoreboard to the /humanoid-tracker/ |
The tracker compares robots; add the money layer — humanoid market-size trajectory ($2–3B → ~$200B by 2035), China vs US install share, unit-cost gap (~$50k vs premium), and the KOID / supply-chain read. Definitive reference tables are citation magnets. How: reuse the sortable alldomains worksheet pattern, cite Barclays / IFR / TrendForce inline, and cross-link up to the decade-of-the-robot report so the AI-referred reader lands on a monetized page. | ||||