Digital skills are an increasing requirement in NYC jobs beyond tech, report finds

Center for an Urban Future's report that nearly half of all job postings in New York City now seek digital skills—including roles in home health care, construction, and retail—highlights a rapid expansion of AI‑driven recruitment tools into traditionally non‑tech sectors. For website owners, this shift means a surge in AI‑powered job‑matching bots crawling career pages, résumé portals, and even niche industry forums to scrape listings and feed recommendation engines. These bots often ignore standard robots.txt directives, targeting structured data like schema.org jobPosting markup to populate AI résumé analyzers. Consequently, sites may see increased non‑human traffic spikes, higher server load, and potential exposure of proprietary job data to competitors. **Actionable tips:** 1. **Update your llms.txt** to explicitly label job‑listing pages with `User‑Agent: *` and `Disallow: /careers/*` if you prefer to block generic AI scrapers, while allowing trusted recruitment platforms via `Allow`. 2. **Implement bot‑fingerprinting** on high‑traffic posting pages—monitor request headers, JavaScript execution patterns, and rate limits—to differentiate legitimate job‑board crawlers from aggressive AI aggregators. 3. **Leverage structured data monitoring** by using llmscentral’s real‑time bot‑traffic dashboard to spot unusual spikes in schema.org `JobPosting` queries and adjust your llms.txt rules or CAPTCHAs accordingly.