What is a web crawler? Explained in simple terms!
A web crawler is a software tool that visits websites and gathers information from the web pages.
Legacy sites can be a major burden to maintain. Use Quant to take a static snapshot of your old website to start saving money, stop maintaining your old servers and software, and remove your risk of security vulnerabilities. Archive your legacy content easily.
There are over a billion active websites on the internet. Many of these are receiving few or no content updates, but still hold valuable content worth keeping publicly available. Some are using legacy CMSes, or built on platforms not actively maintained and represent major security risk.
In these instances, it makes sense to create a one-time static snapshot and shut down your old hosting plan.
Quant is a global static edge, a CDN combined with static web hosting. We provide built-in WYSIWYG and code content editors (for editing your static content, should you ever need to), as well as seamless support for form submissions and search.
We also have tools to help easily shift your website to our platform in a matter of minutes.
Got an old Drupal or WordPress site? Good news - we've got integrations for both. Simply install the module/plugin, hook it up to Quant, and click a button to push up your old site.
With Drupal 7 going to end-of-life, and the significant effort required to migrate to Drupal 9, this represents the simplest pathway forward for sites that do not have major ongoing content management requirements.
You may already have a zip archive, or the ability to generate one from your current platform.
In these instances, you can simply drag and drop the archive via Quant dashboard and it'll import into your project.
You can do the same with individual static assets too, if you just want to update or upload individual files.
For the more technically adventurous, we have a CLI tool to automatically crawl and push content from your old website to Quant.
First, install the quant-cli tool:
npm i -g @quantcdn/quant-cli
Next, initialize Quant in a directory of choice by running quant init
. This will create a quant.json
file with credentials and allow us to run the crawl.
quant init *** Initialize Quant *** prompt: Enter QuantCDN endpoint: (https://api.quantcdn.io) prompt: Enter QuantCDN client id: quant prompt: Enter QuantCDN project: quant-example prompt: Enter QuantCDN token: ******************************** prompt: Directory containing static assets: (build)
Finally, run quant crawl https://yourdomain.com
to crawl and push directly to Quant. Done!
Watch the example below for a full end-to-end crawl. In this example, we crawl and push the Quant Umami demo. You can see the final result here.
A web crawler is a software tool that visits websites and gathers information from the web pages.
In the beginning, the web was static. Join Quant as we journey back to the days of Netscape Navigator and dial up modems and rediscover the pros of serving static websites instead of complex web serving architectures.
A CDN, or Content Delivery Network, helps speed up websites by bringing their web content closer to the locations of the website users.
Complete trial with CDN, WAF, Crawler, static integration and support.
Cancel anytime.