Commit Graph - pywb - Source code and issue tracker for Open Eggbert

backup/pywb

Fork 0

mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 00:03:28 +01:00

Commit Graph

Select branches

Hide Pull Requests

0.1

0.11.3

0.11.4

0.11.5

0.2.0

0.3.0

0.33.2

0.4.0

0.4.5

0.4.7

0.5.4

0.6.0

0.6.6

0.7.7

0.8.3

2.7.0

2.7.4-work

add-logo

auto-scalar-proto

bump-dockerfile-python

ci-test

cond_rules

dependabot/npm_and_yarn/pywb/vueui/braces-3.0.3

dependabot/npm_and_yarn/pywb/vueui/semver-5.7.2

dependabot/npm_and_yarn/pywb/vueui/word-wrap-1.2.4

dev/issue-674-module-rewriting

develop-new

develop-with-wombat

disable-query-fuzzy-match

docs

embeds-url-scheme

final-2.4.0-fixes

fix-travis

history-own-window

hls-native-fix

issue-859-json-post-values

issue-924-client-side-playback

issue-sec-12-path-traversal

lists

main

new-ui-work

new-ui-work-i18n

patch-work

record-history

record-history-new

redis-key-log

remote-cdx-prefix

scheme-rel-change-ts

seq-filters

sub-coll

timegate-check-opt

ukwa-merge-even-master

ukwa-pywb-terms-of-use-popup

update-wombat

warcio-1.5.3

werkzeug-version

#1

#102

#127

#133

#133

#139

#149

#149

#150

#150

#151

#151

#152

#153

#154

#155

#155

#156

#157

#159

#162

#166

#172

#183

#19

#19

#194

#2

#203

#209

#21

#212

#215

#215

#218

#22

#220

#221

#224

#225

#226

#227

#228

#229

#230

#231

#232

#233

#234

#235

#236

#237

#240

#241

#242

#243

#244

#245

#246

#247

#248

#25

#250

#251

#252

#253

#254

#255

#256

#257

#258

#258

#259

#26

#260

#261

#262

#263

#264

#265

#266

#268

#269

#27

#272

#272

#274

#276

#277

#278

#279

#28

#280

#281

#282

#285

#286

#287

#287

#288

#29

#3

#30

#30

#303

#303

#304

#306

#308

#313

#315

#317

#318

#32

#320

#320

#321

#323

#323

#325

#327

#328

#329

#330

#331

#332

#334

#335

#336

#337

#338

#339

#340

#341

#345

#346

#347

#348

#349

#349

#350

#351

#352

#353

#354

#355

#356

#357

#357

#358

#358

#359

#360

#361

#362

#363

#364

#365

#366

#367

#368

#369

#372

#373

#374

#375

#376

#377

#378

#379

#380

#381

#382

#383

#384

#384

#385

#386

#387

#389

#392

#394

#395

#396

#397

#398

#400

#401

#402

#403

#404

#409

#409

#415

#418

#420

#421

#423

#426

#427

#428

#430

#431

#436

#437

#438

#440

#441

#442

#443

#444

#445

#446

#447

#448

#450

#451

#453

#454

#456

#457

#460

#463

#468

#469

#470

#472

#473

#475

#477

#478

#479

#480

#481

#482

#483

#484

#486

#487

#488

#489

#490

#491

#493

#494

#495

#496

#497

#498

#499

#5

#5

#500

#503

#504

#507

#509

#511

#512

#513

#514

#515

#516

#517

#518

#519

#520

#523

#524

#529

#53

#530

#531

#534

#536

#540

#543

#544

#557

#559

#561

#563

#564

#565

#566

#568

#572

#574

#575

#583

#586

#586

#587

#587

#588

#590

#592

#596

#597

#599

#6

#600

#603

#604

#606

#609

#610

#611

#612

#613

#617

#620

#621

#623

#624

#625

#626

#629

#630

#631

#633

#634

#635

#636

#637

#640

#642

#647

#649

#650

#651

#653

#654

#655

#657

#659

#661

#662

#664

#666

#668

#669

#670

#675

#679

#682

#683

#687

#688

#689

#690

#691

#692

#697

#7

#701

#705

#706

#708

#710

#711

#712

#716

#721

#722

#723

#725

#726

#730

#732

#733

#737

#738

#739

#741

#742

#746

#747

#748

#749

#751

#752

#753

#754

#755

#758

#759

#760

#761

#763

#767

#770

#772

#774

#775

#776

#777

#780

#781

#783

#785

#786

#787

#791

#793

#794

#796

#797

#800

#801

#805

#806

#808

#809

#810

#810

#811

#812

#812

#813

#814

#815

#816

#819

#820

#823

#839

#841

#841

#845

#855

#855

#856

#856

#864

#866

#868

#871

#873

#874

#877

#877

#882

#888

#889

#891

#892

#893

#895

#896

#899

#900

#901

#902

#904

#905

#911

#911

#912

#914

#914

#916

#916

#917

#917

#920

#926

#926

#927

#928

#928

#98

0.10.1

0.10.10

0.10.5

0.10.8

0.10.9

0.10.9.1

0.11.0

0.11.4

0.2.2

0.3.0

0.32.0

0.4.0

0.5.0

0.6.0

0.6.2

0.6.4

0.6.5

0.7.0

0.7.1

0.7.5

0.8.0

0.9.0

0.9.5

2.4.0-beta

v-2.2.20190227

v-2.2.20190311

v-2.2.20190410

v-2.3.0

v-2.3.1

v-2.4.0

v-2.4.0-beta

v-2.4.0-rc0

v-2.4.0-rc1

v-2.4.0-rc2

v-2.4.0-rc5

v-2.4.0-rc6-test

v-2.4.0-rc7

v-2.4.0rc4

v-2.4.1

v-2.4.2

v-2.4.2-beta

v-2.5.0

v-2.6.0

v-2.6.0b0

v-2.6.0b1

v-2.6.1

v-2.6.2

v-2.6.3

v-2.6.3b0

v-2.6.4

v-2.6.6

v-2.6.7

v-2.6.8

v-2.6.9

v-2.7.0

v-2.7.1

v-2.7.2

v-2.7.3

v-2.7.4

v-2.8.0

v-2.8.1

v-2.8.2

v-2.8.3

fb4bf817f7 rangecache: use 'b' for file open Ilya Kreymer 2015-01-11 18:34:32 -08:00
14657fbe15 certauth: fix max cert duration to avoid int overflow Ilya Kreymer 2015-01-11 15:04:19 -08:00
7ae0ff86d2 test certauth: fix paths Ilya Kreymer 2015-01-11 13:10:14 -08:00
cf0a21509b loaders: add to_file_url() for converting between filename and file://, used in live rewrite and tests Ilya Kreymer 2015-01-11 13:05:48 -08:00
ba853a4eae fixes for windows: convert url to file with pathname2url, use 'b' for reading warcs, don't use %s for timestamp conversion (not portable) (#56) Ilya Kreymer 2015-01-10 20:59:23 -08:00
7f52ecdca9 tests: fix indexing test, remove extra space/print Ilya Kreymer 2015-01-10 15:36:53 -08:00
d5c22e3649 test loaders: fix file:// prefix Ilya Kreymer 2015-01-10 15:27:45 -08:00
1eb0f96f92 windows support work: fix loaders to use pathname2url to convert to file:/// url, use urlopen to open file paths fix some tests to use universal line breaks Ilya Kreymer 2015-01-10 14:06:15 -08:00
06b2ea498e setup: set zipSafe to true to allow bundling egg in installer Ilya Kreymer 2015-01-09 22:57:21 -08:00
205aeca4a1 bump version to 0.7.3 rewrite: add additional tags for client side src rewrite, add missing tags to server-side html rewrite Ilya Kreymer 2015-01-04 17:32:58 -08:00
de403c457e update README for 0.7.2 master Ilya Kreymer 2015-01-03 13:51:47 -08:00
a4447fef0d update CHANGES.rst Ilya Kreymer 2015-01-03 13:33:16 -08:00
d9c5345d3c rewrite: add support for Cookie request header rewrite to support sites which require a cookie to be set. req_cookie_rewrite directive can be set in rules.yaml per url prefix with a list of match/replace regexs Ilya Kreymer 2015-01-03 12:51:09 -08:00
df94e17305 video: yt: switch on timeout only if not started.. Ilya Kreymer 2014-12-28 23:29:13 -08:00
1684c14cda bump version to 0.7.2 video: disable yt DASH for better proxy and replay (experiment) Ilya Kreymer 2014-12-28 16:34:19 -08:00
d6c05042c9 build: fix incorrectly built 0.7.0, update to 0.7.1 0.7.1 Ilya Kreymer 2014-12-27 03:11:48 -08:00
a76bf79b83 html_rewriter: add explicit <video>, <audio> tags to html_rewriter tag list 0.7.0 Ilya Kreymer 2014-12-26 18:15:49 -08:00
fee7862dc8 Update README.rst Ilya Kreymer 2014-12-26 18:15:18 -08:00
323b537047 minor changelist tweak Ilya Kreymer 2014-12-26 18:03:12 -08:00
b6e1f14f4d Update changelist for 0.7.0! Ilya Kreymer 2014-12-26 17:56:22 -08:00
9f47357624 Small update to README Ilya Kreymer 2014-12-26 15:35:52 -08:00
8d6845a552 fuzzy match: add support for specifying regex and args seperately for fuzzy_lookup match Ilya Kreymer 2014-12-26 14:29:51 -08:00
ffb702ce03 rewrite: content detection for specific case: if content type is html and mod type is css or js, peek stream to determine actual type. Addresses #31 in part. Fix typo in wb_frame.js Ilya Kreymer 2014-12-26 13:08:35 -08:00
8f57ce622d Improved top rewriting, addressing #54 Ilya Kreymer 2014-12-26 13:06:33 -08:00
4c08a6a064 video work: improved yt handling: - disable yt using yt api, for forced html/flash, diable on load - use yt error event to detect error - better fallback on recorded video use seperate cache for range and video info tracking fix yt rules query to account for & and ? Ilya Kreymer 2014-12-26 13:02:47 -08:00
ca17410056 video: better extension extraction for explicit video info (use format if ext is unknown) improved support for _pywbvid=html, forces generic html player over yt player, better deletion of ytplayer Ilya Kreymer 2014-12-24 18:13:12 -08:00
ad5a43db76 replay redirect: ensure no timestamp redirect when range request is present, alter test to include inexact timestamp Ilya Kreymer 2014-12-23 21:19:39 -08:00
181c18a1b8 pep8 pass: fix spacing, line length, issues also remove references to obsolete cached_replay, hostnames in pywb_init Ilya Kreymer 2014-12-23 15:14:03 -08:00
51919ed1e7 replay: make range cache available by default in replay_views since its inited on first use. remove separate subclass. 'enable_ranges' can be set to false to disable range cache altogether improve tests Ilya Kreymer 2014-12-23 14:34:59 -08:00
3819e935fb Merge branch 'master' into video Ilya Kreymer 2014-12-23 13:43:20 -08:00
8ccfd811bd travisci: experiment with travis improvements (new container build) Ilya Kreymer 2014-12-23 12:39:33 -08:00
c32634c8dc test: adjust test range Ilya Kreymer 2014-12-23 12:17:51 -08:00
c28304fd90 tests rangecache: added integration tests for range support via range cache, using enable_cache option Ilya Kreymer 2014-12-23 11:09:19 -08:00
a9892f531f proxy testing: refactored test server thread into ServerThreadRunner class which runs a server in a seperate thread.. used by http/s proxies as well, as mock live server proxy add test for live rewrite with proxy, covering simple case as well as video Ilya Kreymer 2014-12-23 11:07:47 -08:00
a8b4041716 live rewrite: proxy setup refactor: ignore_proxy flag, pass proxy during constructor only Ilya Kreymer 2014-12-22 21:58:07 -08:00
b54e4c1c06 tests: add more tests for cookie, html and rewrite_live crsf Ilya Kreymer 2014-12-22 20:34:18 -08:00
0f2c96879c refactor: split out optional cached replay components into cached_replay, toggleable via 'enable_cache' in config -- regular replayview does not need any cache info move add_range() components to statusandheaders from wbrequestresponse add x-pywb-noredirect' header which disables date related redirect video replay works w/o cache if supported by frontend (nginx) Ilya Kreymer 2014-12-19 18:40:45 -08:00
b86517b246 rangecache: remove range extractions functions which are now part of wbrequest/response Ilya Kreymer 2014-12-18 13:23:45 -08:00
4aabba559c vidrw: refactor object/embed adding code into seperate functions for iterating over tags, allows for reuse with setInterval (not yet added) Ilya Kreymer 2014-12-18 13:22:03 -08:00
68e7a70777 refactor: live rewrite handler uses new range functions in wbrequest/response, also add 'remove range' for 0- unbounded requests.. Ilya Kreymer 2014-12-18 13:20:16 -08:00
07e46f4b6c request/response: add range extraction and settings functions to wbrequest/response (with tests) Ilya Kreymer 2014-12-18 13:19:38 -08:00
f3dc256503 wombat: also rewrite src= in video and audio tags Ilya Kreymer 2014-12-18 13:18:22 -08:00
c6c07d27dd Merge pull request #53 from tilgovi/patch-1 0.6.6 Ilya Kreymer 2014-12-16 23:53:56 -08:00
905227eb42 Correct error message in run-gunicorn.sh Randall Leeds 2014-12-16 23:36:37 -08:00
1937319271 Merge branch 'master' into video Ilya Kreymer 2014-12-14 15:36:54 -08:00
0de76189a7 Merge branch 0.6.6 into video Ilya Kreymer 2014-12-14 15:36:14 -08:00
bee70260ac Merge branch 'develop' Ilya Kreymer 2014-12-13 23:19:52 -08:00
09861ada2c wb.js: preserve anchor in location redirect update CHANGELIST Ilya Kreymer 2014-12-13 23:19:04 -08:00
80c5b45178 wb.js: don't include anchor when comparing current url with expected top url Ilya Kreymer 2014-12-13 23:12:42 -08:00
3b14e1ad40 video: add support for experimental 'pywbvid=' selector to force video type add optional YT original player rewrite fix non-local vars in flash player wb.js: remove hash when doing location check Ilya Kreymer 2014-12-12 09:07:58 -08:00
e68c0413d1 video rules: update rules for vimeo Ilya Kreymer 2014-12-11 00:20:43 -08:00
8090bf9a9a video: skip videoinfo responses that have no formats, and fallback to retry handler remove extra log Ilya Kreymer 2014-12-09 10:48:08 -08:00
336289b337 Merge branch 'develop' into video, merge wb.js Add double init check for wombat Ilya Kreymer 2014-12-07 23:54:20 -08:00
6d5592f890 wb js: add guard around wb js to prevent double-inits (such as from fragments!) Ilya Kreymer 2014-12-07 23:33:21 -08:00
87d7635f6f video: update rules to use new location-only rewriter for YT comments support Ilya Kreymer 2014-12-07 21:21:51 -08:00
721ab393f0 Merge branch 'develop' into video Ilya Kreymer 2014-12-07 21:16:00 -08:00
5129c83095 update changelist Ilya Kreymer 2014-12-07 21:15:35 -08:00
0a6838ac2b rewrite: refactor JS rewriters into seperate mixins, allowing for link only, location only, and link + location JS rewriters. location-only rewriter is new js_rewrite_location options: all, location, urls (for now) Ilya Kreymer 2014-12-07 21:09:37 -08:00
ab087afa4e Merge branch 'develop' into video, JS rewriter refactoring Ilya Kreymer 2014-12-07 21:11:20 -08:00
5a11714b41 rewrite: refactor JS rewriters into seperate mixins, allowing for link only, location only, and link + location JS rewriters. location-only rewriter is new js_rewrite_location options: all, location, urls (for now) Ilya Kreymer 2014-12-07 21:09:37 -08:00
d45a23e07b vidrw: client rewrite: use client width/height if available, otherwise use 100% to allow replacement in dynamic containers Ilya Kreymer 2014-12-07 19:59:42 -08:00
00c4e189ef live rewrite video: add explicit generation of video info file, if referrer and non-206 request (eg YT) Ilya Kreymer 2014-12-07 19:56:29 -08:00
80d4fa6e29 rangecache: Add check for X-Ignore-Range-Arg header to force ignoring range= and serving full request. (For use with nginx range cache handling) Ilya Kreymer 2014-12-07 19:55:24 -08:00
881d550abe Merge branch 'master' into video Ilya Kreymer 2014-12-07 17:00:27 -08:00
7e36ad29e7 Merge branch 'develop' 0.6.6 into video Ilya Kreymer 2014-12-06 19:19:12 -08:00
b951b304b6 Fix quotes in CHANGES.rst Ilya Kreymer 2014-12-06 17:28:43 -08:00
0495423e86 rewrite: add per-collection rewrite options, settable in 'rewrite_opts' block in each collection. Added rewrite_base to disable rewriting <base> tag and rewrite_rel_canon to disable rewriting link rel=canon. Ilya Kreymer 2014-12-06 17:16:35 -08:00
6440e2503f bump version to 0.6.6 Ilya Kreymer 2014-12-06 15:22:57 -08:00
238a45bcbe Merge branch 'develop' for 0.6.5 0.6.5 Ilya Kreymer 2014-12-04 23:12:03 -08:00
d31a4df3a6 add changelist for 0.6.5 Ilya Kreymer 2014-12-04 23:10:51 -08:00
ea89702701 static handler: add default 'application/octet-stream' and only set guessed mime if not none Ilya Kreymer 2014-12-04 23:02:30 -08:00
7251c37c08 video: load flashembed dynamically only when there are videos Ilya Kreymer 2014-12-04 10:48:50 -08:00
cc4df75c0b update tags to video branch Ilya Kreymer 2014-12-03 22:00:58 -08:00
8a87966ebd video fixes: disable adding a fixed buffer on unbounded range requests, as that messes up FF html5 player.. (it assumes a full stream) video response: ensure Accept-Ranges: bytes is being added on 206 responses Ilya Kreymer 2014-12-03 21:59:03 -08:00
bbe5068321 Merge branch 'master' into video Ilya Kreymer 2014-12-03 21:53:29 -08:00
7f93e858ee video: skip all DASH format sources, also sort sources from highest preference to lowest (if available) Ilya Kreymer 2014-12-03 12:55:18 -08:00
f59cd6c6b4 video: add special case iframe, fix flash insert missing prefix Ilya Kreymer 2014-12-02 12:39:54 -08:00
f21f4fb1ba Merge branch 'develop' into video Ilya Kreymer 2014-12-01 09:10:08 -08:00
dffa0bcbad video work: vidrw fixes to support object, fallback to flash rangecache: create dir on first use only Ilya Kreymer 2014-12-01 09:09:23 -08:00
c996e70a6e wburl: detect and decode partially encoded schemes in url, such as http%3A//, https%A2F2F// before handling further add additional tests for wburl Ilya Kreymer 2014-11-29 11:13:57 -08:00
2f5be9ed9f video: work on extracting video from <object> tags, fallback to flowplayer if html5 player fails Ilya Kreymer 2014-11-29 11:04:18 -08:00
7a14e167e1 replay: vi_ handling: properly replace any protocol with metadata:// for video info lookup Ilya Kreymer 2014-11-29 11:03:40 -08:00
87d791eba8 html rewrite: rewrite param value only if start with http Ilya Kreymer 2014-11-29 11:03:09 -08:00
3e3a74619f various fixes: wombat: add Date.UTC and Date.parse rewrite: support vi_ https -> metadata video: fallback to vi_ call on current page remove debug logging Ilya Kreymer 2014-11-25 00:21:28 -08:00
4b7186a62e wombat: adjust date for timezone! Ilya Kreymer 2014-11-24 13:46:50 -08:00
c10df57e07 rules: add support for customizing matchType prefix, adding multiple filters Ilya Kreymer 2014-11-24 11:10:49 -08:00
d3ef47342c Merge branch 'develop' into video Ilya Kreymer 2014-11-23 18:58:31 -08:00
d7eb40af20 rewrite: properly rewrite scheme relative JS-escaped urls: '\/\/example.com', '\\/\\/example.com/', treat same as '//example.com' adding http: prefix Ilya Kreymer 2014-11-23 18:56:49 -08:00
f4431c0872 wombat: add extra check for correct scheme for ajax open Ilya Kreymer 2014-11-23 18:44:11 -08:00
fcb90fde86 rules: work on yt rules Ilya Kreymer 2014-11-23 18:39:58 -08:00
36887f565a video: more rewriting work, support: html audio if audio format, fallback to flash (flowplayer) if html video/audio playback has failed update setup.py to support nested include structure Ilya Kreymer 2014-11-22 18:39:30 -08:00
0d191b338f rules: fix rules typo Ilya Kreymer 2014-11-22 18:39:17 -08:00
0eafd06c42 rangecache: use tmp dir for cache and delete on exit Ilya Kreymer 2014-11-22 18:38:57 -08:00
550d78a181 add flowplayer 3.2 for flash fallback Ilya Kreymer 2014-11-22 18:37:52 -08:00
b8b8c30573 cookie_rewriter: add tests for exact cookie rewriter Ilya Kreymer 2014-11-13 09:43:50 -08:00
20070e95b6 cookie_rewriter: add 'exact' cookie rewriter which never changes the path/domain Ilya Kreymer 2014-11-13 09:24:34 -08:00
388f31e08f rewrite: don't rewrite rel=canonical links, need to make rewriting more configurable (#50) Ilya Kreymer 2014-11-11 15:34:14 -08:00
9929737a8e rangecache: don't redirect when using range header, don't cache non-200 responses Ilya Kreymer 2014-11-06 22:14:41 -08:00
1a91f514c5 Merge branch 'develop' into video Ilya Kreymer 2014-11-06 22:13:44 -08:00
49e98e0cdc archiveiterator/cdxindexer: cleaner load path for compressed and uncompressed, ability to distinguish between chunked and non-chunked warcs/arcs Raise error for non-chunked gzip warcs as they can not be indexed for replay, addressing #48 add 'bad' non-chunked gzip file for testing, using custom ext Ilya Kreymer 2014-11-06 01:29:14 -08:00