SEO Architecture: sitemap.xml & robots.txt
lodhi.net implements search engine indexing files configured for optimal crawling by major search engines and authorized AI knowledge aggregators. Internal architecture views and scaffolding tools are explicitly excluded.
robots.txt (Disallowing /scaffold/)
User-agent: * Allow: / Disallow: /scaffold/ Disallow: /private/ Disallow: /api/ # AI Crawler Directives (Authorized Indexing) User-agent: GPTBot Allow: / Disallow: /scaffold/ User-agent: ClaudeBot Allow: / Disallow: /scaffold/ User-agent: PerplexityBot Allow: / Disallow: /scaffold/ Sitemap: https://lodhi.net/sitemap.xml
sitemap.xml (Filtered)
<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>https://lodhi.net/</loc>
<lastmod>2026-03-28</lastmod>
<changefreq>daily</changefreq>
<priority>1.0</priority>
</url>
<url>
<loc>https://lodhi.net/glossary</loc>
<lastmod>2026-03-28</lastmod>
<changefreq>weekly</changefreq>
<priority>0.8</priority>
</url>
<url>
<loc>https://lodhi.net/editorial</loc>
<lastmod>2026-03-28</lastmod>
<changefreq>monthly</changefreq>
<priority>0.6</priority>
</url>
<url>
<loc>https://lodhi.net/sitemap</loc>
<lastmod>2026-03-28</lastmod>
<changefreq>monthly</changefreq>
<priority>0.3</priority>
</url>
<url>
<loc>https://lodhi.net/calculators/insurance</loc>
<lastmod>2026-03-28</lastmod>
<changefreq>weekly</changefreq>
<priority>0.9</priority>
</url>
<url>
<loc>https://lodhi.net/calculators/mortgage</loc>
<lastmod>2026-03-28</lastmod>
<changefreq>weekly</changefreq>
<priority>0.9</priority>
</url>
<url>
<loc>https://lodhi.net/legal/editorial-policy</loc>
<lastmod>2026-03-28</lastmod>
<changefreq>yearly</changefreq>
<priority>0.3</priority>
</url>
<url>
<loc>https://lodhi.net/legal/privacy</loc>
<lastmod>2026-03-28</lastmod>
<changefreq>yearly</changefreq>
<priority>0.3</priority>
</url>
<url>
<loc>https://lodhi.net/legal/terms</loc>
<lastmod>2026-03-28</lastmod>
<changefreq>yearly</changefreq>
<priority>0.3</priority>
</url>
<url>
<loc>https://lodhi.net/articles/mortgage-rate-forecast-2026-fixed-vs-adjustable</loc>
<lastmod>2026-03-28</lastmod>
<changefreq>monthly</changefreq>
<priority>0.9</priority>
</url>
<url>
<loc>https://lodhi.net/articles/comprehensive-auto-insurance-deductibles-guide</loc>
<lastmod>2026-03-22</lastmod>
<changefreq>monthly</changefreq>
<priority>0.9</priority>
</url>
<url>
<loc>https://lodhi.net/articles/term-vs-whole-life-insurance-wealth-transfer</loc>
<lastmod>2026-03-19</lastmod>
<changefreq>monthly</changefreq>
<priority>0.8</priority>
</url>
<url>
<loc>https://lodhi.net/articles/what-is-piti-explained</loc>
<lastmod>2026-10-04</lastmod>
<changefreq>monthly</changefreq>
<priority>0.9</priority>
</url>
</urlset>