URL Frontier 2.0

URLFrontier provides a crawler-neutral API and service implementation for a crawl frontier, which can power various web crawlers independently from their implementation language and

More

ProjectID

URL-Frontier-2

Acronym

URL-Frontier-2

Additional Info

Resources
Background interview
https://www.ngi.eu/blog/2022/02/10/whos-ngi-julien-nioche-with-open-source-web-crawler-url-frontier
Source code
https://github.com/crawler-commons/url-frontier
Issue Tracker
https://github.com/crawler-commons/url-frontier/issues
Stay up to date
Mailinglist
https://groups.google.com/forum/?fromgroups#!forum/crawler-commons

Enduser Relevance

Not available yet

Contact

https://nlnet.nl/contact/

Endorsements

Not available yet

Disclaimer

Not available yet

Country:  United Kingdom

Keyword: ClusteringCrawlingMonitoring

Status: -

Category: Vertical use cases, improving search and discovery and community building

check other similar solutions