Commit graph

53 commits

Author SHA1 Message Date
hackrush
e7c57dcabc
add components_to_skip setting 2018-07-24 20:01:38 -04:00
Jack Robison
7fe92d2df0
load all finished blobs into the node datastore 2018-07-02 14:31:09 -04:00
Jack Robison
a41bbd5e27
pylint and tests 2018-03-28 18:50:18 -04:00
Jack Robison
c5bf64cf0a
refactor DHTHashAnnouncer
-remove hash_announcer from Node and DiskBlobManager
-remove announcement related functions from DiskBlobManager
-update SQLiteStorage to store announcement times and provide blob hashes needing to be announced
-use dataExpireTimeout from lbrynet.dht.constants for re-announce timing
-use DeferredSemaphore for concurrent blob announcement
2018-03-28 15:53:51 -04:00
Jack Robison
e6caedac91
remove DHTHashSupplier class, move former functions into DHTHashAnnouncer 2018-03-28 15:53:47 -04:00
Jack Robison
3296c0fb3d
move dht related classes to lbrynet.dht 2018-03-28 15:53:47 -04:00
Jack Robison
81de5fbbf4
verify_will_announce_head_and_sd_blobs 2018-03-08 16:46:39 -05:00
Jack Robison
3f1bcbffeb
fix blob_announce when announcing a single blob 2018-03-07 18:25:30 -05:00
Jack Robison
e671005c3c
update BlobManager to use SQLiteStorage, remove old database functions
-remove blob upload/download history
2018-02-13 10:27:50 -05:00
Alex Grintsvayg
2f8c645edc download script now gets all blobs in stream if you give it an sd hash 2018-02-07 11:21:34 -05:00
Jack Robison
a6f0c5fb4c
pylint fixes
fix exception formatting and a circular import
2017-12-15 20:25:20 -05:00
Ian Chamberlain
20e9ff2902 Delete blob hash from list when blob is deleted 2017-11-05 21:56:54 -05:00
Kay Kurokawa
1f839fe2a6
add blob announcement information to session_status 2017-10-05 13:59:27 -04:00
Jack Robison
af99edc764
add get_host_downloaded_from 2017-09-28 14:04:03 -04:00
Jack Robison
4b8700268f
discover stream info for uploads via reflector v1 2017-09-22 14:46:23 -04:00
Kay Kurokawa
4d5ba94a6e
add tests for checking stream info on reflector server 2017-09-22 14:39:37 -04:00
Jack Robison
421141b958
raise instead of assert 2017-09-20 13:59:26 -04:00
Jack Robison
b9b5e755db
raise rather than assert 2017-09-20 13:59:26 -04:00
Jack Robison
ad061b5ea3
use fixed BlobFile type 2017-09-20 13:59:25 -04:00
Jack Robison
14636a5d38
split up HashBlob.py into lbrynet.blob 2017-09-20 13:59:24 -04:00
Victor Shyba
5d69e74010
use WAL on sqlite3 2017-09-20 13:59:16 -04:00
Kay Kurokawa
c8bf1d8908 should_announce should be True by default 2017-08-28 10:43:57 -04:00
Kay Kurokawa
0494b11001 remove last_announce_time 2017-08-28 10:43:57 -04:00
Kay Kurokawa
0639bb9865 add support for should_announce feature 2017-08-28 10:43:57 -04:00
Kay Kurokawa
c0a2c6c830 remove blob manager reliance on HashBlob classes 2017-08-28 10:43:57 -04:00
Kay Kurokawa
8955838191 migrate blob database to have should_announce and last_announce_time 2017-08-28 10:43:57 -04:00
Jack Robison
09d336bd0c
don't block blob_completed on the blob being announced
this considerably slows down the rate at which reflector server can
receive blobs
2017-08-10 13:53:10 -04:00
Alex Grintsvayg
02d4444780 fixed shutdown messages 2017-08-09 19:10:11 -04:00
Kay Kurokawa
79d25f710d remove base BlobManager class 2017-07-27 13:38:40 -04:00
Kay Kurokawa
f9b728530e Remove TempBlobManager 2017-07-27 11:38:23 -04:00
Kay Kurokawa
14b2bb3019 add test for BlobManager 2017-06-23 10:24:27 -04:00
Kay Kurokawa
f9b4d46599 work on removing manage from BlobManager and simplify blob deletion 2017-06-23 10:24:27 -04:00
Jack Robison
82118e6692 fix blob manager db race condition 2017-06-09 14:09:17 -04:00
jobevers
9e2cda0cdc remove more upload_allowed arguments 2017-02-15 06:48:58 -06:00
Job Evers-Meltzer
a38e5c855e Remove upload_allowed attribute
This is unused and largely pulluting the argument list
of too many functions.
2017-02-15 06:48:50 -06:00
Kay Kurokawa
8e0f71ac74 Make hash reannounce time adjusted based on the queue of hashes yet to be announced, add test for DHTHashAnnouncer 2017-02-13 17:27:10 -05:00
Job Evers-Meltzer
2c9c0da501 get_blob bug fix 2017-01-20 17:41:08 -06:00
Job Evers-Meltzer
3e774fc158 missed another verified time check 2017-01-20 18:47:53 +00:00
Job Evers‐Meltzer
6c571b5227 Blob verification fixes (#428)
* Move the blob verification to the actual Blob object
 * remove the check on verification time
 * remove get_blob_length from BlobManager

Removed because I'm not sure what checking verification time against ctime gets us, except some protection against an accidental modification of the blob.
2017-01-20 10:54:36 -06:00
Job Evers-Meltzer
f37808859f ensure hash_announcer exists before announcing 2017-01-06 08:00:22 -06:00
Job Evers-Meltzer
f181af8547 Cleanup code in BlobManager 2016-12-15 18:58:16 -06:00
Job Evers-Meltzer
781b915717 remove unused check_consistency function 2016-12-15 18:58:16 -06:00
Job Evers-Meltzer
c30ea04959 Remove commented code
This is the result of running eradicate (https://github.com/myint/eradicate)
on the code and double-checking the changes.
2016-12-15 18:58:06 -06:00
Job Evers-Meltzer
f796f701f2 Immediately announce completed blobs
It doesn't seem necessary to wait up to 60 seconds for a new blob to
be announced to the dht. Immediately announce it and schedule the next
announce time as usual.
2016-12-14 19:05:24 -06:00
Job Evers-Meltzer
b64fa51567 fixup long lines 2016-12-07 09:38:34 -05:00
Jack
1720cce3b0 negotiated downloads
-uploads are still underway
2016-09-27 13:52:44 -04:00
Jack
5dd29da84f blob upload/download history and BlobPriceAndAvailabilityTracker 2016-09-23 03:02:17 -04:00
Jack
710e549c03 add get_all_verified_blobs 2016-08-26 00:32:33 -04:00
Jimmy Kiselak
4b407a9dd2 shut down session last, actually save LBRY file metadata 2015-09-15 00:30:49 -04:00
Jimmy Kiselak
0836d9c5ee fix bug pulling blob length out of the database 2015-09-10 21:43:46 -04:00