Libraries tagged by root pages
vipnytt/robotstxtparser
27 Favers
796678 Downloads
796678 Downloads
Robots.txt parsing library, with full support for every directive and specification.
mediawiki/crawlable-all-pages
0 Favers
22 Downloads
22 Downloads
Extension to remove robot restrictions from Special:AllPages in MediaWiki
javanile/http-robot
1 Favers
3206 Downloads
3206 Downloads
Automated web page interactions
psi/fe_pagesplit4ward
1 Favers
27 Downloads
27 Downloads
Split fe_page.html5 into head/content/foot templates
au/au_spotlight
3 Favers
18 Downloads
18 Downloads
Provides custom spotlight content at the foot of the page