2017-10-18 10:12:44 -07:00
|
|
|
pywb 2.0 beta
|
|
|
|
|
=============
|
2014-03-10 19:01:20 -07:00
|
|
|
|
2015-04-17 12:30:21 -07:00
|
|
|
.. image:: https://travis-ci.org/ikreymer/pywb.svg?branch=master
|
2014-03-12 17:50:47 -07:00
|
|
|
:target: https://travis-ci.org/ikreymer/pywb
|
2015-04-17 12:30:21 -07:00
|
|
|
.. image:: https://coveralls.io/repos/ikreymer/pywb/badge.svg?branch=master
|
|
|
|
|
:target: https://coveralls.io/r/ikreymer/pywb?branch=master
|
2014-11-04 22:11:25 -08:00
|
|
|
|
2017-10-18 10:12:44 -07:00
|
|
|
Web Archiving Tools for All
|
|
|
|
|
---------------------------
|
2014-03-10 19:01:20 -07:00
|
|
|
|
2017-10-18 10:12:44 -07:00
|
|
|
`View the full pywb 2.0 documentation here <https://pywb.readthedocs.org>`_
|
2015-03-17 01:06:06 -07:00
|
|
|
|
2017-10-18 10:12:44 -07:00
|
|
|
**pywb** is a Python (2 and 3) web archiving toolkit for replaying web archives large and small as accurately as possible.
|
|
|
|
|
The toolkit now also includes new features for creating high-fidelity web archives.
|
|
|
|
|
|
|
|
|
|
This toolset forms the foundation of Webrecorder project, but also provides a generic web archiving toolkit
|
|
|
|
|
that is used by other web archives, including the traditional "Wayback Machine" functionality.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
New Features
|
|
|
|
|
^^^^^^^^^^^^
|
|
|
|
|
|
|
|
|
|
The 2.0 beta release includes a major overhaul of pywb and introduces the following new features, including:
|
|
|
|
|
|
|
|
|
|
* Dynamic multi-collection configuration system with no-restart updates.
|
|
|
|
|
|
|
|
|
|
* New recording capability to create new web archives from the live web or other archives.
|
|
|
|
|
|
|
|
|
|
* Componentized architecture with standalone Warcserver, Recorder and Rewriter components.
|
|
|
|
|
|
|
|
|
|
* Support for advanced "memento aggregation" and fallback chains for querying multiple remote and local archival sources.
|
|
|
|
|
|
|
|
|
|
* HTTP/S Proxy Mode with customizable Certificate Authority for proxy mode recording and replay.
|
|
|
|
|
|
|
|
|
|
* Flexible rewriting system with pluggable rewriters for different content-types.
|
|
|
|
|
|
|
|
|
|
* Significantly improved client-side rewriting to handle most modern web sites.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Please see the `full documentation <https://pywb.readthedocs.org>`_ for more detailed info on all these features.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Work in Progress / Coming Soon
|
|
|
|
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
|
|
|
|
|
|
|
|
A few key features are high on list of priorities, but have not yet been implemented, including:
|
|
|
|
|
|
|
|
|
|
* Url Exclusion System
|
|
|
|
|
|
|
|
|
|
* New Default UI (calendar and banner)
|
|
|
|
|
|
|
|
|
|
If you are intersted in contributing, especially to any of these areas, please let us know!
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Installation
|
|
|
|
|
------------
|
|
|
|
|
|
|
|
|
|
To run and install locally you can:
|
2014-05-30 10:29:22 -07:00
|
|
|
|
2017-10-15 22:47:23 -07:00
|
|
|
* Install with ``python setup.py install``
|
2015-03-25 12:06:05 -07:00
|
|
|
|
2017-10-15 22:47:23 -07:00
|
|
|
* Run tests with ``python setup.py test``
|
2014-05-30 10:29:22 -07:00
|
|
|
|
2017-10-15 22:47:23 -07:00
|
|
|
* Run Wayback with ``wayback`` (see docs for info on how to setup collections)
|
2014-05-30 10:29:22 -07:00
|
|
|
|
2017-10-18 10:12:44 -07:00
|
|
|
* Build docs locally with: ``cd docs; make html``. (The docs will be built in `./_build/html/index.html`)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Consult the local or `online docs <https://pywb.readthedocs.org>`_ for latest usage and configuration details.
|
2016-03-10 12:51:14 -08:00
|
|
|
|
2014-10-19 08:32:11 -07:00
|
|
|
|
2017-10-18 10:12:44 -07:00
|
|
|
Contributions & Bug Reports
|
|
|
|
|
---------------------------
|
2014-10-19 08:32:11 -07:00
|
|
|
|
2017-10-18 10:12:44 -07:00
|
|
|
Users are encouraged to fork and contribute to this project to keep improving web archiving tools.
|
2014-10-19 08:32:11 -07:00
|
|
|
|
2017-10-18 10:12:44 -07:00
|
|
|
Please take a look at list of current issues and feel free to open new ones about any aspect of pywb, including the new documentation.
|
2014-10-18 17:00:33 -07:00
|
|
|
|
