Commit Graph - pywb - Source code and issue tracker for Open Eggbert

backup/pywb

Fork 0

mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 00:03:28 +01:00

Commit Graph

Select branches

Hide Pull Requests

0.1

0.11.3

0.11.4

0.11.5

0.2.0

0.3.0

0.33.2

0.4.0

0.4.5

0.4.7

0.5.4

0.6.0

0.6.6

0.7.7

0.8.3

2.7.0

2.7.4-work

add-logo

auto-scalar-proto

bump-dockerfile-python

ci-test

cond_rules

dependabot/npm_and_yarn/pywb/vueui/braces-3.0.3

dependabot/npm_and_yarn/pywb/vueui/semver-5.7.2

dependabot/npm_and_yarn/pywb/vueui/word-wrap-1.2.4

dev/issue-674-module-rewriting

develop-new

develop-with-wombat

disable-query-fuzzy-match

docs

embeds-url-scheme

final-2.4.0-fixes

fix-travis

history-own-window

hls-native-fix

issue-859-json-post-values

issue-924-client-side-playback

issue-sec-12-path-traversal

lists

main

new-ui-work

new-ui-work-i18n

patch-work

record-history

record-history-new

redis-key-log

remote-cdx-prefix

scheme-rel-change-ts

seq-filters

sub-coll

timegate-check-opt

ukwa-merge-even-master

ukwa-pywb-terms-of-use-popup

update-wombat

warcio-1.5.3

werkzeug-version

#1

#102

#127

#133

#133

#139

#149

#149

#150

#150

#151

#151

#152

#153

#154

#155

#155

#156

#157

#159

#162

#166

#172

#183

#19

#19

#194

#2

#203

#209

#21

#212

#215

#215

#218

#22

#220

#221

#224

#225

#226

#227

#228

#229

#230

#231

#232

#233

#234

#235

#236

#237

#240

#241

#242

#243

#244

#245

#246

#247

#248

#25

#250

#251

#252

#253

#254

#255

#256

#257

#258

#258

#259

#26

#260

#261

#262

#263

#264

#265

#266

#268

#269

#27

#272

#272

#274

#276

#277

#278

#279

#28

#280

#281

#282

#285

#286

#287

#287

#288

#29

#3

#30

#30

#303

#303

#304

#306

#308

#313

#315

#317

#318

#32

#320

#320

#321

#323

#323

#325

#327

#328

#329

#330

#331

#332

#334

#335

#336

#337

#338

#339

#340

#341

#345

#346

#347

#348

#349

#349

#350

#351

#352

#353

#354

#355

#356

#357

#357

#358

#358

#359

#360

#361

#362

#363

#364

#365

#366

#367

#368

#369

#372

#373

#374

#375

#376

#377

#378

#379

#380

#381

#382

#383

#384

#384

#385

#386

#387

#389

#392

#394

#395

#396

#397

#398

#400

#401

#402

#403

#404

#409

#409

#415

#418

#420

#421

#423

#426

#427

#428

#430

#431

#436

#437

#438

#440

#441

#442

#443

#444

#445

#446

#447

#448

#450

#451

#453

#454

#456

#457

#460

#463

#468

#469

#470

#472

#473

#475

#477

#478

#479

#480

#481

#482

#483

#484

#486

#487

#488

#489

#490

#491

#493

#494

#495

#496

#497

#498

#499

#5

#5

#500

#503

#504

#507

#509

#511

#512

#513

#514

#515

#516

#517

#518

#519

#520

#523

#524

#529

#53

#530

#531

#534

#536

#540

#543

#544

#557

#559

#561

#563

#564

#565

#566

#568

#572

#574

#575

#583

#586

#586

#587

#587

#588

#590

#592

#596

#597

#599

#6

#600

#603

#604

#606

#609

#610

#611

#612

#613

#617

#620

#621

#623

#624

#625

#626

#629

#630

#631

#633

#634

#635

#636

#637

#640

#642

#647

#649

#650

#651

#653

#654

#655

#657

#659

#661

#662

#664

#666

#668

#669

#670

#675

#679

#682

#683

#687

#688

#689

#690

#691

#692

#697

#7

#701

#705

#706

#708

#710

#711

#712

#716

#721

#722

#723

#725

#726

#730

#732

#733

#737

#738

#739

#741

#742

#746

#747

#748

#749

#751

#752

#753

#754

#755

#758

#759

#760

#761

#763

#767

#770

#772

#774

#775

#776

#777

#780

#781

#783

#785

#786

#787

#791

#793

#794

#796

#797

#800

#801

#805

#806

#808

#809

#810

#810

#811

#812

#812

#813

#814

#815

#816

#819

#820

#823

#839

#841

#841

#845

#855

#855

#856

#856

#864

#866

#868

#871

#873

#874

#877

#877

#882

#888

#889

#891

#892

#893

#895

#896

#899

#900

#901

#902

#904

#905

#911

#911

#912

#914

#914

#916

#916

#917

#917

#920

#926

#926

#927

#928

#928

#98

0.10.1

0.10.10

0.10.5

0.10.8

0.10.9

0.10.9.1

0.11.0

0.11.4

0.2.2

0.3.0

0.32.0

0.4.0

0.5.0

0.6.0

0.6.2

0.6.4

0.6.5

0.7.0

0.7.1

0.7.5

0.8.0

0.9.0

0.9.5

2.4.0-beta

v-2.2.20190227

v-2.2.20190311

v-2.2.20190410

v-2.3.0

v-2.3.1

v-2.4.0

v-2.4.0-beta

v-2.4.0-rc0

v-2.4.0-rc1

v-2.4.0-rc2

v-2.4.0-rc5

v-2.4.0-rc6-test

v-2.4.0-rc7

v-2.4.0rc4

v-2.4.1

v-2.4.2

v-2.4.2-beta

v-2.5.0

v-2.6.0

v-2.6.0b0

v-2.6.0b1

v-2.6.1

v-2.6.2

v-2.6.3

v-2.6.3b0

v-2.6.4

v-2.6.6

v-2.6.7

v-2.6.8

v-2.6.9

v-2.7.0

v-2.7.1

v-2.7.2

v-2.7.3

v-2.7.4

v-2.8.0

v-2.8.1

v-2.8.2

v-2.8.3

b68ef06067 banner: add back inner frame update of banner on load, if html rewrite: banner only mode encodes to utf-8, adjusts length Ilya Kreymer 2014-08-05 10:12:54 -07:00
4f9310fe4d rewrite: add support for js rewriting ';http:\\/' urls add 'parse_comments' rule options for parsing comment contents via regex banner: simplify banner insertion check, only insert for top frame, and check for canon_url matching current href at top before redirecting to top replace em_ -> mp_ as default embedded mod Ilya Kreymer 2014-08-05 01:47:52 -07:00
c251840141 Merge branch 'https-proxy' into develop Ilya Kreymer 2014-08-04 23:15:57 -07:00
243de1f086 tweak CHANGES Ilya Kreymer 2014-08-04 22:51:03 -07:00
fcf7971e86 update dev version 0.5.3, edit changelist Ilya Kreymer 2014-08-04 22:32:17 -07:00
6e6688beb3 rewrite/testing: add additional test for live rewrite post, invalid post htmlrewrite: annotate untestable sections (unimplemented, 2.6 only exceptions) Ilya Kreymer 2014-08-04 21:59:46 -07:00
9e4459ae50 rewrite: remove extra wb_url param from rewrite_content(), the wb_url will come from the urlrewriter, to get the 'mod' Ilya Kreymer 2014-08-04 21:11:46 -07:00
c3004007d7 rewrite: add test for banner-only mode, rewriting w/o a head using local 'sample_no_head' file. query.html: use client side rewriting for calendar dates rewrite: remove unused decode stuff Ilya Kreymer 2014-08-04 20:45:02 -07:00
4a39a4ed55 rewrite: better parametrize live rewrite timestamp cookie, restore LiveResourceException Ilya Kreymer 2014-08-04 18:41:33 -07:00
ef8d910d01 banner: remove client side 'capture_str' formatting, just output wbinfo.timestamp, allow js to format as needed, also helps with #41 update tests to only look at timestamp Ilya Kreymer 2014-08-04 18:19:28 -07:00
103a1c6455 client js: use iframe onload event to detect when iframe changes, allows setting banner even for non-html captures, instead of frame notifying parent will fix issue mentioned in #41 move script from frame_insert.html -> wb_frame.js Ilya Kreymer 2014-08-04 17:54:33 -07:00
8d54153326 refactoring for better extensibility: remove BaseContentView, move top-frame functionality to SearchPageWbUrlHandler remove RewriteLiveView, fold functionality into the handler move default mod setting into RewriteContent Ilya Kreymer 2014-08-04 01:18:46 -07:00
160182ec48 rewrite: add 'bn_' banner only rewrite cleanup rewrite_content/fetch_request api to take a full wb_url add content-length to responses whenever possible (WbResponse) and static files bump version to 0.5.2 Ilya Kreymer 2014-07-29 12:20:22 -07:00
f71b83f587 tweak CHANGES Ilya Kreymer 2014-08-04 22:51:03 -07:00
13881f5cf0 update dev version 0.5.3, edit changelist Ilya Kreymer 2014-08-04 22:32:17 -07:00
a2d86fa495 Merge branch 'develop' into https-proxy Ilya Kreymer 2014-08-04 22:01:16 -07:00
e1e8f679b2 rewrite/testing: add additional test for live rewrite post, invalid post htmlrewrite: annotate untestable sections (unimplemented, 2.6 only exceptions) Ilya Kreymer 2014-08-04 21:59:46 -07:00
2792a92ff6 rewrite: remove extra wb_url param from rewrite_content(), the wb_url will come from the urlrewriter, to get the 'mod' Ilya Kreymer 2014-08-04 21:11:46 -07:00
71e8ada57d rewrite: add test for banner-only mode, rewriting w/o a head using local 'sample_no_head' file. query.html: use client side rewriting for calendar dates rewrite: remove unused decode stuff Ilya Kreymer 2014-08-04 20:45:02 -07:00
924f71a4cc Merge branch 'develop' into https-proxy Ilya Kreymer 2014-08-04 18:44:01 -07:00
72fe274e06 rewrite: better parametrize live rewrite timestamp cookie, restore LiveResourceException Ilya Kreymer 2014-08-04 18:41:33 -07:00
86bc2f17ba banner: remove client side 'capture_str' formatting, just output wbinfo.timestamp, allow js to format as needed, also helps with #41 update tests to only look at timestamp Ilya Kreymer 2014-08-04 18:19:28 -07:00
25fe5d685c client js: use iframe onload event to detect when iframe changes, allows setting banner even for non-html captures, instead of frame notifying parent will fix issue mentioned in #41 move script from frame_insert.html -> wb_frame.js Ilya Kreymer 2014-08-04 17:54:33 -07:00
492aaa4a01 Merge branch 'develop' into https-proxy Ilya Kreymer 2014-08-04 13:00:25 -07:00
95028ab692 refactoring for better extensibility: remove BaseContentView, move top-frame functionality to SearchPageWbUrlHandler remove RewriteLiveView, fold functionality into the handler move default mod setting into RewriteContent Ilya Kreymer 2014-08-04 01:18:46 -07:00
92726309fc proxy: add 'extra_headers' to be added to proxy responses, customizable via proxy_options defaults include no-cache and p3p policy (needed for IE default settings) fix link generation for proxy_select page, better exception handling of ssl errors Ilya Kreymer 2014-08-02 04:27:51 -07:00
4efd2d514c proxy: add proxy_cert download page at root http://pywb.proxy, serving .pem and .p12 (windows only) certs for auto installation Ilya Kreymer 2014-08-01 17:15:49 -07:00
aeb246466b proxy: SSL version is 0-based not 1-based, set_version(2) for version 3! Ilya Kreymer 2014-08-01 12:35:19 -07:00
48b1c78917 proxy: more banner tweaks Ilya Kreymer 2014-07-31 21:27:30 -07:00
37fd75f744 update version to 0.6.0, update CHANGELIST add quotes around "coll" in header Ilya Kreymer 2014-07-31 21:17:07 -07:00
92daad3b2b ui: tweak head insert text for proxy Ilya Kreymer 2014-07-31 18:56:35 -07:00
2ca4757599 fix integration test for proxy_pac Ilya Kreymer 2014-07-31 18:03:18 -07:00
f5c27d7b06 rewrite: fix header rewrite test proxy_pac: use http host header if available for proxy host Ilya Kreymer 2014-07-31 17:33:43 -07:00
407da7528b proxy/rewrite: don't rewrite headers banner_only Ilya Kreymer 2014-07-31 17:02:26 -07:00
cfe11a5ad3 fix typo param ordering Ilya Kreymer 2014-07-31 11:56:43 -07:00
522ea87637 proxy: timestamp selection support! certauth: wildcard support, use *.host wildcard for proxy certs whenever possible ui: add coll info/switch and calendar links to banner Ilya Kreymer 2014-07-31 11:12:50 -07:00
eff5a74ec7 proxy: path fixup, using default magic name of 'pywb.proxy', default selector 'select.pywb.proxy' stored in env['pywb_select'] and accessible to head insert and error handler Ilya Kreymer 2014-07-30 13:06:18 -07:00
527ad0d60e proxy mode: make banner replay and cookie resolver configurable via proxy_options Ilya Kreymer 2014-07-30 10:47:24 -07:00
96d9f4dcad proxy mode: cookie based selector using session to coll ui: add proxy_selector html, add switch link to error and banner Ilya Kreymer 2014-07-30 10:38:13 -07:00
fc6ffc6c11 Merge branch 'develop' into https-proxy for 'bn_' modifier support Ilya Kreymer 2014-07-29 12:26:50 -07:00
607ea1ccf0 proxy resolver: cookie resolver uses session cookies proxy static handler: handled via proxy to support http/https use 'pywb.proxy' prefix for custom env settings Ilya Kreymer 2014-07-29 12:23:41 -07:00
b92eda77f6 rewrite: add 'bn_' banner only rewrite cleanup rewrite_content/fetch_request api to take a full wb_url add content-length to responses whenever possible (WbResponse) and static files bump version to 0.5.2 Ilya Kreymer 2014-07-29 12:20:22 -07:00
9c96026904 proxy-cert-auth: add cli hook for 'proxy-cert-auth' for creating root certs, tweak help Ilya Kreymer 2014-07-28 16:06:01 -07:00
ba61f23e40 proxy_resolvers: move resolvers to seperate file, default to ProxyAuthResolver (CookieResolver still work-in-progress) Ilya Kreymer 2014-07-28 15:22:22 -07:00
6234d795dc proxy improvements: refactor coll selector into BaseCollSelector, supporting either proxy auth or cookie-based selection (in progress) https proxy: support POST requests, properly read http header and wrap remainder in wsgi.input https proxy: properly update wsgi for wrapped request wbrequestresponse: add content-length 0 to redir_response Ilya Kreymer 2014-07-28 11:52:54 -07:00
b6fb0e510e certauth: clean up CertificatAuthority, add cli interface for creating root cert and host certs CertificateAuthority instance creates per-host certs, assume root cert exists static method generate_ca_root() used to create root cert once add proxy_options to enable https support Ilya Kreymer 2014-07-27 19:35:16 -07:00
2a9197137e certauth: some cleanup for pep8, 2.6 compat Ilya Kreymer 2014-07-26 21:06:28 -07:00
ae35d92dde fix typo in certauth Ilya Kreymer 2014-07-26 15:27:02 -07:00
e58a63a9fe setup: add openssl as a req Ilya Kreymer 2014-07-26 14:35:52 -07:00
5beb831ae9 wbrequestresponse: update doctest Ilya Kreymer 2014-07-26 14:27:31 -07:00
1464e89c41 wbresponse: always include Content-Length for text_response Ilya Kreymer 2014-07-26 14:24:28 -07:00
eca3cf5fbf https proxy: add ca generator! support uwsgi, gunicorn and ref better handling of 407, other error responses in response to CONNECT Ilya Kreymer 2014-07-26 13:24:53 -07:00
739f23da9e https proxy support, CONNECT verb handling (uwsgi only) Ilya Kreymer 2014-07-26 09:48:44 -07:00
fb29b6aad9 Merge branch 'develop' Ilya Kreymer 2014-07-24 16:39:24 -07:00
bdf69ff1a9 tweak CHANGES.rst Ilya Kreymer 2014-07-24 16:38:39 -07:00
22c210131a bump version to 0.5.1 Ilya Kreymer 2014-07-23 15:31:04 -07:00
8ea7f5d3a0 framed replay: don't use is_timegate to determine frame usage due to potential ambiguity, memento will need to use the mp_ modifier Ilya Kreymer 2014-07-23 15:30:01 -07:00
e513b3755c cdxindexing: encode unicode filenames using system encoding, add test for unicode filenames Ilya Kreymer 2014-07-23 15:27:01 -07:00
4d31c17d4c archivalrouter: make SCRIPT_NAME key lookup default to '', addresses #39 Ilya Kreymer 2014-07-23 12:56:25 -07:00
c3fecb6e0d Merge branch 'develop' for 0.5.0 release 0.5.0 Ilya Kreymer 2014-07-21 22:56:03 -07:00
0b8a8f0ae2 live rewrite: catch errors from live rewrite and raise a new LiveResourceError with a 400 error code, indicating bad request for live resource. Add test for invalid live rewrite requests Ilya Kreymer 2014-07-21 22:43:34 -07:00
2f50a3eafb a few more tweaks to CHANGES.rst Ilya Kreymer 2014-07-21 21:43:40 -07:00
769ac0784a Merge branch 'develop' of https://github.com/ikreymer/pywb into develop Ilya Kreymer 2014-07-21 21:30:05 -07:00
b8a17b7cab refactor webapp: RewriteLiveHandler and WBHandler share a common base class, SearchPageWbUrlHandler which renders the search page when there is no wburl move some inits from pywb_init to WBHandler itself Ilya Kreymer 2014-07-21 21:25:10 -07:00
84e8365838 Update README.rst with usage examples Ilya Kreymer 2014-07-21 17:10:13 -07:00
7c57345363 proxy: add 'unaltered_replay' option to proxy_options to replay all content unaltered (no rewriting html, no banner, no wombat) use 'proxy_options' instead of 'routing_options', add additional tests for proxy mode Ilya Kreymer 2014-07-21 16:42:14 -07:00
950673908d proxy: fix wombat.js to work in proxy mode! rewrite only https -> http Ilya Kreymer 2014-07-21 14:41:49 -07:00
b8a9f429fb Merge branch 'develop' of https://github.com/ikreymer/pywb into develop Ilya Kreymer 2014-07-21 14:03:53 -07:00
a2973b04e7 wbrequest: add options dictionary to store misc request options Ilya Kreymer 2014-07-21 14:02:31 -07:00
221cf701f2 Fix spacing in CHANGES.rst Ilya Kreymer 2014-07-20 19:07:56 -07:00
fa813bdd19 pep8 cleanup pass Ilya Kreymer 2014-07-20 18:26:16 -07:00
e4297ddabe tests: add integration tests for $liveweb rewrite handler and replay with fallback Ilya Kreymer 2014-07-20 18:25:47 -07:00
49deb501a6 fallback: better way of setting fallbacks, check for 'resolve_refs' method on the handler and pass handler_dict if one exists Ilya Kreymer 2014-07-20 18:24:08 -07:00
ca405ef179 update version to 0.5.0, update CHANGELIST and README Ilya Kreymer 2014-07-20 16:54:41 -07:00
fcbc2c2966 replay ui: improvements to framed replay messages. 'is_live' added to live rewrite to allow for different message for live replay vs archived replay to be used. When using framed replay, default initial message to 'Loading...' default index.html: list non-replay access points in default home page Ilya Kreymer 2014-07-20 16:46:30 -07:00
aa0bc86543 cdxindexer: when indexing entire dir, only look at files with ext .warc.gz, .warc, .arc.gz, .arc files and skip the rest. (Files with other ext may be specified explicitly) Ilya Kreymer 2014-07-20 16:45:44 -07:00
3be2763081 handlers: change 'redir_fallback' to 'fallback' as no redirect happens, fallback called internally Ilya Kreymer 2014-07-20 16:45:14 -07:00
6da27789eb live handler: allow live rewrite handler to be specified as one of the collections in pywb by settings index_paths to '$liveweb'. When used, creates a RewriteHandler instead of WBHandler Can also specify 'proxyhostport' to set the live rewrite to go through a proxy Ilya Kreymer 2014-07-20 16:36:49 -07:00
b785cd6f08 memento: use mp_ modifier to support memento with frame or non-frame replay change memento test to use frame replay Ilya Kreymer 2014-07-20 15:43:39 -07:00
96fcaab521 live-rewrite-server: add ability to specify http/https proxy for live fetching (for example, for use with a recording proxy) Ilya Kreymer 2014-07-19 14:43:28 -07:00
f80c27ec00 cookie: add test for 'document.cookie' rewriting Ilya Kreymer 2014-07-15 12:57:02 -07:00
fa52e0126d cookies: support client side rewriting of document.cooke -> WB_wombat_cookie to rewrite cookie path, if present Ilya Kreymer 2014-07-15 12:52:42 -07:00
e858b8faae rewrite: better fix for multiple ../ in urls, additional tests Ilya Kreymer 2014-07-14 20:50:45 -07:00
7032160cf9 rewrite: fix rel url resolution to better handle parent rel path. Explicitly resolve path when possible, remove only if at root level Ilya Kreymer 2014-07-14 19:13:19 -07:00
1b1a1f8115 proxy: add 'proxy_coll_select' config which will require a proxy-auth to select a collection for proxy mode. Otherwise, defaults to first available collection, though proxy-auth can still be sent to specify different collection Ilya Kreymer 2014-07-14 19:12:30 -07:00
1317b2b10f route selection via proxy auth! refactor poute request parsing to happen in the actual router class instead of in the route in proxy mode, add support for picking a route via proxy-auth improve test for 'top' rewriting Ilya Kreymer 2014-07-10 21:54:23 -07:00
daffc7ff5d header rewrite: pass through 'content-range' header Ilya Kreymer 2014-07-07 17:02:44 -07:00
02326a2b12 bump dev version to 0.4.8 Ilya Kreymer 2014-07-07 17:02:28 -07:00
7694bf0678 update README.rst for master 0.4.7 0.4.7 Ilya Kreymer 2014-07-01 16:22:38 -07:00
46b16c61d5 update changelist, version to 0.4.7 Ilya Kreymer 2014-07-01 16:15:25 -07:00
2a2240a23a fix 'bad.cdx' sorting order Ilya Kreymer 2014-07-01 15:36:13 -07:00
1a42331e69 Merge branch 'develop' into binary-parse Ilya Kreymer 2014-07-01 10:00:05 -07:00
1980b66127 warc indexing: in include_all mode, pass 'warcinfo' records to writer, allowing it to option to handle or ignore Ilya Kreymer 2014-07-01 09:59:16 -07:00
57a38dedce Merge branch 'develop' into binary-parse Ilya Kreymer 2014-06-28 11:53:50 -07:00
377ea33bc8 tests: add test for wombat top Ilya Kreymer 2014-06-28 11:53:23 -07:00
b0f7fdbed8 regexrewrite: fix rewrite for 'top' Ilya Kreymer 2014-06-28 11:50:11 -07:00
f2bfc96002 Merge branch 'develop' into binary-parse Ilya Kreymer 2014-06-28 11:04:43 -07:00
83b69e8447 indexing: don't include records of type 'application/warc-fields' unless all records are being included Ilya Kreymer 2014-06-28 11:03:44 -07:00
70b7e29b36 pass raw bytes to htmlparser, assuming ascii-compatibility (todo: add tests for non-ascii compatible encodings) improved rendering of certain pages, needs more testing Ilya Kreymer 2014-06-27 19:03:06 -07:00
dd9f138bab disable decoding, by default, of content for html parser Ilya Kreymer 2014-06-27 16:53:33 -07:00