http://e26whn2524322mkxb3cbyk27ev2ihhq2biz35hty7gzgsyrwrygq27yd.onion/posts/documentation/linux/745-allowing-your-internal-search-engine-to-index-gitlab-issues-commits-and-wiki-pages.html
",
"urltype": "page"
} As well as a full set of text to index, you'll notice the the meta description is much more verbose, the title is more succinct The page is also laced with things that my bot can consume, like schema.org markup. Unlike in JILS, we're also able to show commit information And, just like with it's predecessor, GILS allows you to take a backup as simply as running wget -R "robots.txt" -r -p -k "[url to GILS]" My search bot (based on the one I described here )...