Commit graph

339 commits

Author SHA1 Message Date
Lex Berezhny
2bea0f697a pylint 2019-03-25 22:54:08 -04:00
Lex Berezhny
1d68bef6f2 client side pretty much done 2019-03-25 22:54:08 -04:00
Jack Robison
c9b2829227
fix/test fixed_peer_delay and added_fixed_peers 2019-03-14 15:08:26 -04:00
Lex Berezhny
98d8b7d463 sync uses new apply APIs in torba 2019-03-12 20:22:41 -04:00
Lex Berezhny
96f1883fc4 check modified_on 2019-03-12 20:22:41 -04:00
Lex Berezhny
a914de155a working sync 2019-03-12 20:22:41 -04:00
Lex Berezhny
2dee0ff0bf wip account manifest command 2019-03-12 20:22:41 -04:00
Jack Robison
5d212a0f82 time to first bytes analytics 2019-03-12 20:22:01 -04:00
Jack Robison
4cbde1b08f
use _batched_select to populate channel names when initializing files 2019-03-12 09:58:19 -04:00
Brannon King
5bdd87c904 removed name-to-claim lookup table
added unit test for Greek and made it work


pylint: revert bad move


revert claim_sequence changes


fixed broken test
2019-03-05 09:32:43 -05:00
Jack Robison
e38a0f7a95
logging 2019-03-01 15:26:45 -05:00
Jack Robison
df8934d472
restore old download analytics and update tests 2019-03-01 14:50:06 -05:00
Jack Robison
10d73fe480
use certifi 2019-02-28 12:40:11 -05:00
Jack Robison
d95903d219
update aiohttp and pylint 2019-02-28 12:04:07 -05:00
Victor Shyba
e047748961
log dropped api request instead of stack trace 2019-02-26 17:42:45 -05:00
Thomas Zarebczan
2a82ff7cc5
Update mime_types.py 2019-02-22 11:11:10 -05:00
Victor Shyba
59325ad8c1 fix delete log 2019-02-20 17:04:08 -03:00
Jack Robison
cb5d428d12
add split_buckets_under_index config setting for seed nodes 2019-02-20 11:25:50 -05:00
Jack Robison
82ce2ccee6
update docs 2019-02-19 17:27:31 -05:00
Lex Berezhny
461c3c8408 downloading header from S3 correctly tracks progress 2019-02-18 17:15:40 -05:00
Jack Robison
3f7e466c97
return failure message for invalid blob hash in blob_delete 2019-02-18 12:18:56 -05:00
Jack Robison
4483380352
fix terminator blob hash (None) being included when running blob_list for an sd hash 2019-02-18 12:12:14 -05:00
Thomas Zarebczan
a003e794ba listen on internal port instead of upnp redirect 2019-02-16 18:55:58 -05:00
Jack Robison
fc450eb164
add TestMimeTypes, pylint 2019-02-15 20:42:55 -05:00
Thomas Zarebczan
652d7cbd24
consider . extension 2019-02-15 20:40:55 -05:00
Thomas Zarebczan
43b372c0fe
fix extension - remove dot
The rest of our extensions don't have a dot. Also, strip off any characters and lowercase it to be safe.
2019-02-15 20:40:55 -05:00
Jack Robison
0d558bd552
fix default file list sorting 2019-02-15 17:26:24 -05:00
Jack Robison
dbb6ba6241
recover streams with missing sd blobs, handle previous sd blob bugs
-test download and recover stream with old key sorting
2019-02-15 15:21:29 -05:00
Jack Robison
a228d20137
move store_stream and store_file to standalone functions 2019-02-15 15:21:07 -05:00
Jack Robison
f1b60e3ef2
fix get_blobs_for_stream 2019-02-15 15:21:07 -05:00
Jack Robison
39737c790f
sync blob files in database with those in directory on startup 2019-02-15 15:21:07 -05:00
Jack Robison
9d89f9b834
use executemany instead of batched_operation 2019-02-14 15:57:24 -05:00
Jack Robison
56c41b2fea
fix integration test
-cancel running reflector uploads from publishes upon shutdown
-refactor blob.delete to be non-async
-delete blobs synchronously
2019-02-14 15:43:26 -05:00
Jack Robison
9c8593d88e
fix file_delete being slow 2019-02-14 12:33:48 -05:00
hackrush
21ca4f60f7 Stop the daemon on calling lbrynet stop 2019-02-13 14:22:23 -05:00
Lex Berezhny
76ecb5d50d renamed resolve argument url to urls 2019-02-13 11:55:12 -05:00
Victor Shyba
e2170ec83d fix download timeout types 2019-02-12 20:58:31 -05:00
Lex Berezhny
68905d82b9 pass conf instead of data_dir to migrate_db, fixes #1898 2019-02-12 18:10:34 -05:00
Lex Berezhny
5e509c9fd6 testing get 2019-02-12 11:54:00 -05:00
Lex Berezhny
8aa50aa14f cleaned up resolve command 2019-02-12 11:54:00 -05:00
Jack Robison
6732b302bb
logging 2019-02-11 15:31:31 -05:00
Alex Grintsvayg
f65e70df2f
better resolve description 2019-02-11 12:34:57 -05:00
Jack Robison
aeb2891baa
faster population of channel names 2019-02-08 19:51:13 -05:00
Jack Robison
da9b4e317a
limit blobs to announce 2019-02-08 16:29:55 -05:00
Jack Robison
e414cc5c48
whitespace 2019-02-08 16:11:56 -05:00
Jack Robison
868110a6f2
populate stream manager with a single batch query 2019-02-08 16:06:35 -05:00
Jack Robison
c1c6d5bc99
fix deleting partial downloads when stopped and previous streams when updating a publish 2019-02-06 11:43:05 -05:00
Jack Robison
0e972ec2ae
refactor BlobFile.close to be non async 2019-02-06 11:00:57 -05:00
Victor Shyba
8b5803c945 format error dict on get 2019-02-06 11:55:12 -03:00
Victor Shyba
c6b910a5f3 use time_getter on storage 2019-02-05 13:14:59 -03:00
Victor Shyba
7b8f42e6d0 remove dead set_should_announce code 2019-02-05 13:01:12 -03:00
Jack Robison
8cda3143f2
fix setting should_announce and blob status 2019-02-04 18:22:44 -05:00
Jack Robison
e5af041627
fix connection status message 2019-02-03 16:20:52 -05:00
Jack Robison
3f98b16800
fix blob announce time, use time.time instead of loop.time 2019-02-03 15:47:15 -05:00
Jack Robison
8f5a8ab8ba
fix peer_ping 2019-02-02 02:02:19 -05:00
Jack Robison
c3b0151943
fix dht status error during startup 2019-02-01 22:12:07 -05:00
Jack Robison
e96b75a0d0
fix file/download paths
move download-from-uri logic into stream manager
2019-02-01 21:40:35 -05:00
Jack Robison
c75665d3f0
update file_list docs, add blobs_remaining to file list args and to file dict result 2019-02-01 21:28:59 -05:00
Jack Robison
744375b2c0
re-assemble file / resume downloads 2019-02-01 21:28:59 -05:00
Victor Shyba
ca4a55ef28 set verified event earlier and remove stop awaits 2019-02-01 16:05:14 -03:00
Jack Robison
2336015f9a
fix publish
fixes https://github.com/lbryio/lbry/issues/1826
- remove `sources` argument from `publish`
- only add/update files we have
- delete existing stream if updating with a new one
2019-02-01 13:35:18 -05:00
Jack Robison
87f5d1bd4a
fix updating claim with existing stream 2019-01-31 20:49:19 -05:00
Jack Robison
e60e5b3919
fix updating content claim for a file
-fix file name and download dir not being hex encoded during publish, add repair script
2019-01-31 15:39:20 -05:00
Jack Robison
3589cc9977
call update_reflected_stream upon reflector finishing 2019-01-31 15:39:20 -05:00
Jack Robison
262b9a624b
update file_reflect 2019-01-31 15:39:20 -05:00
Jack Robison
6aef6a80b7
refactor downloader
split peer accumulation out, use Queues instead of locks
2019-01-31 15:39:20 -05:00
Victor Shyba
21f2b2dcd7 cast timestamp to integer before querying 2019-01-31 01:09:57 -03:00
Jack Robison
7d33b4f1f3
fix unawaited task 2019-01-28 22:01:43 -05:00
Jack Robison
bfaebf0085
fix timeout error 2019-01-28 17:20:14 -05:00
Jack Robison
778d3826ab
clean up settings and use them 2019-01-28 15:51:27 -05:00
Jack Robison
4a11cf007f
remove unused settings and constants 2019-01-27 19:51:44 -05:00
Lex Berezhny
60ed4e503f refactored settings_set to support all settings 2019-01-26 00:04:36 -05:00
Lex Berezhny
aa1405887e use float instead of decimal for now 2019-01-25 23:20:43 -05:00
Lex Berezhny
cced217e43 update doc format for max_key_fee 2019-01-25 23:20:43 -05:00
Lex Berezhny
8a3b8d2df1 max_key_fee in yaml as null 2019-01-25 23:20:43 -05:00
Lex Berezhny
e01c73a7f8 pylint 2019-01-25 21:00:20 -05:00
Lex Berezhny
134338db4b dropped help, commands and resolve_name commands 2019-01-25 21:00:20 -05:00
Jack Robison
a7610e3d34
async reflector 2019-01-25 16:10:17 -05:00
Lex Berezhny
4a35247016 fixes for toggle config, passing servers as list, etc 2019-01-25 10:19:24 -05:00
Lex Berezhny
7a601db23f cli fixup 2019-01-25 10:19:24 -05:00
Lex Berezhny
79e4767f69 unused imports 2019-01-24 00:13:15 -05:00
Lex Berezhny
0ee279bfd7 fix startup/shutdown and file_list --full-status argument 2019-01-24 00:13:15 -05:00
Lex Berezhny
2dcd187d69 fixed component manager tests 2019-01-24 00:13:15 -05:00
Lex Berezhny
2ca438c36e passing integration tests 2019-01-24 00:13:15 -05:00
Jack Robison
a3e64f9cef remove dht requirement from stream manager component 2019-01-24 00:13:15 -05:00
Jack Robison
f9c465a636 f string 2019-01-24 00:13:15 -05:00
Jack Robison
89efe3d1b9 minimal changes to cli.py 2019-01-24 00:13:15 -05:00
Jack Robison
5596eac930 merge conflicts 2019-01-24 00:13:15 -05:00
Jack Robison
5bb94d744e storage 2019-01-24 00:13:15 -05:00
Jack Robison
494917158c update daemon and components 2019-01-24 00:13:15 -05:00
Jack Robison
db75f0baef update SQLiteStorage 2019-01-24 00:13:15 -05:00
Jack Robison
4bf7742c19 async lbrynet.stream 2019-01-24 00:13:15 -05:00
Jack Robison
2fa5233796 async lbrynet.dht 2019-01-24 00:13:15 -05:00
Jack Robison
c713fac2d9 lbrynet.error 2019-01-24 00:13:15 -05:00
Lex Berezhny
7a038bbb98 cli bug fixes 2019-01-23 13:25:10 -05:00
Lex Berezhny
6606deafa5 fixed after testing with desktop app 2019-01-22 18:04:17 -05:00
Lex Berezhny
19b0d59159 config options api_host and api_port changed to just api 2019-01-22 18:04:17 -05:00
Lex Berezhny
48533df523 fix integration tests 2019-01-22 18:04:17 -05:00
Lex Berezhny
d0230b4893 command line fixes 2019-01-22 18:04:17 -05:00
Lex Berezhny
7a28171a72 conf no longer global 2019-01-22 18:04:17 -05:00
Jack Robison
3a86fc6680
refactor exchange rate manager to use asyncio 2019-01-22 11:34:49 -05:00
Jack Robison
2805cbb331 refactor loggly handler to use asyncio 2019-01-22 10:52:50 -05:00
Victor Shyba
b707ee4844 encode and decode detached signatures from claim dict 2019-01-17 23:24:58 -05:00
Lex Berezhny
c9d4ad5450 pylint unused import 2019-01-17 19:04:52 -05:00
Lex Berezhny
31586bf588 error out when user tries --http-auth 2019-01-17 19:04:52 -05:00
Lex Berezhny
974d3c83e3 keep wallet_balance to test deprecation with, until we find better way to do this 2019-01-17 17:35:15 -05:00
Lex Berezhny
8dc8ca382b removed previously deprecated commands 2019-01-17 17:35:15 -05:00
Lex Berezhny
1dbb250413 fix bytes vs str error in migrate5to6 script 2019-01-15 21:44:16 -05:00
Thomas Zarebczan
2c1b54c76c Add note about wallet needing to be unlocked (grin was confused about this) 2019-01-15 15:59:45 -05:00
Thomas Zarebczan
7314494fb9 add m4v
It's a container type very similar to mp4. Someone recently added one in the community top bids section.
2019-01-15 15:55:59 -05:00
hackrush
6c8cbc1b9e added additional fields to uri parser 2019-01-11 15:10:22 -05:00
Lex Berezhny
6ae4e68d1c looping_call shouldnt need to mess with cancellation 2019-01-11 14:33:45 -05:00
Oleg Silkin
d22a2dee33 Removes await from shutdown call 2019-01-11 14:33:45 -05:00
Oleg Silkin
b032e99dd1 Removes the twisted dependency from the analytics file and replaces it
with `asyncio` and `aiohttp`. Also removes the calling loop from the
analytics in favor of a `dict` that stores the names of the methods
and their coroutines that are wrapped inside a looping task. The tasks
are canceled when the analytics manager is asked to shutdown

Signed-off-by: Oleg Silkin <o.silkin98@gmail.com>
2019-01-11 14:33:45 -05:00
Lex Berezhny
950c122850 fix blob announce command argument constraints 2019-01-11 00:54:15 -05:00
Thomas Zarebczan
4c23add193 fix unavailable download directory
If an uploaded file had a directory that was removed, or if the old download directory doesn't exist, use the default.
2019-01-10 23:05:43 -05:00
Lex Berezhny
b0deb63129 blob_reflect fix 2019-01-10 22:38:27 -05:00
Lex Berezhny
ebdb33bd11 blob_availability fix 2019-01-10 22:38:27 -05:00
Lex Berezhny
69ccbda168 fixed error handling when calling commands 2019-01-10 22:38:27 -05:00
Lex Berezhny
a38643cca6 remove d2f from storage function call 2019-01-10 22:38:27 -05:00
Alex Grintsvayg
8a5f3842fc fix media type for files without extension 2019-01-10 10:22:37 -05:00
Lex Berezhny
76fbaac658 do not log aiohttp.access 2019-01-08 23:54:32 -05:00
hackrush
c4fac29ecb actually get the certificate_id 2019-01-08 23:45:20 -05:00
Lex Berezhny
33392b3351 migration fix 2019-01-08 23:15:25 -05:00
Alex Grintsvayg
a930ca0631 if media type is not listed, default to a type that includes the file extension 2019-01-08 16:06:44 -05:00
Lex Berezhny
5ca0ebcbb2 store loop on storage 2019-01-07 21:56:05 -05:00
Lex Berezhny
2c84b7a7dd get_running_loop() -> get_event_loop() 2019-01-07 21:56:05 -05:00
Lex Berezhny
d30e7cd29e use loop.time() instead of reactor.seconds() in SQLite storage 2019-01-07 21:56:05 -05:00
Lex Berezhny
aeb7c6fe76 pylint, removed unused import 2019-01-07 21:56:05 -05:00
Lex Berezhny
134c20da93 stream cost estimate command refactor 2019-01-07 21:56:05 -05:00
Lex Berezhny
9b27e81940 fix logging 2019-01-07 21:56:05 -05:00
Lex Berezhny
7be53ad692 more bug fixes 2019-01-07 21:56:05 -05:00
Lex Berezhny
16e596ec87 lots o bugs fixed discovered while using desktop app 2019-01-07 21:56:05 -05:00
Lex Berezhny
26a3221bac hash announcer fix 2019-01-07 21:56:05 -05:00
Lex Berezhny
4bb8129bb7 fixing tests to work with asyncio daemon 2019-01-07 21:56:05 -05:00
Lex Berezhny
86fb99a37c fully asyncio daemon api 2019-01-07 21:56:05 -05:00
Lex Berezhny
248baf58b4 asyncio daemon 2019-01-07 21:56:05 -05:00
Lex Berezhny
0845d65f4e rebase master 2019-01-07 21:56:05 -05:00
Lex Berezhny
e65e1fb5a2 added utxo_release command 2019-01-04 03:14:37 -05:00
Jack Robison
b8b0d8b1ac
refactor default directory setup, remove lbrynet.androidhelpers
fixes https://github.com/lbryio/lbry/issues/1606
2018-12-12 17:46:10 -05:00
Victor Shyba
ba59e126cd forward errors outside of uris on channel listing 2018-12-11 16:34:37 -05:00
Jack Robison
6180a2917d
add epub and wmv content types 2018-12-07 13:06:36 -05:00
Jack Robison
e3d08ec773
improve contentType detection
fixes https://github.com/lbryio/lbry/issues/1690
2018-12-07 11:31:05 -05:00
Lex Berezhny
93f9622798 fix json_response_encoder to also return correct confirmations 2018-12-06 00:49:07 -05:00
Jack Robison
a6128ac8a2
fix https://github.com/lbryio/lbry/compare/fix-1674 2018-12-04 17:35:40 -05:00
Jack Robison
434c7b57b1
tests 2018-11-26 11:36:28 -05:00
Jack Robison
9dc4608a62
combine StreamProgressManager and FullStreamProgressManager
-add wrote_first_data Deferred to FullStreamProgressManager
2018-11-26 11:36:28 -05:00
Victor Shyba
9f0b1f3e25 fix pylint failures unveiled after astroid pin 2018-11-26 11:32:41 -05:00
Oleg Silkin
b3fde9d78d Removes six From Project (#1660)
* Replaces `six` urllib with python 3's urllib
* Replaces `six`'s int2byte method with native `bytes` class
* Removes edge case testing for python2 vs python3
* Removes useless object inheritance
* Uses native io.BytesIO instead of six.BytesIO
* Removes six from dependencies
2018-11-22 23:24:21 -05:00
Lex Berezhny
0c999083cc added jsonrpc_account_send and dropped torba[server] 2018-11-21 01:14:39 -05:00
Lex Berezhny
dd1d1be994 working claim_send_to_address 2018-11-19 20:34:38 -05:00
Jack Robison
cc8b47d882
improve error when get fails to decode the resolved claim 2018-11-19 17:30:02 -05:00
Jack Robison
33bcc8256c
Merge branch 'fix-1624' 2018-11-16 11:45:05 -05:00
Jack Robison
1b74594f5b
don't create ssl/auth keys if disabled
fixes https://github.com/lbryio/lbry/issues/1624
2018-11-16 11:12:33 -05:00
Jack Robison
b0718d295e
fix empty buckets in routing_table_get 2018-11-16 10:59:12 -05:00
YULIUS KURNIAWAN KRISTIANTO
3840f19869 fix mistake code 2018-11-14 14:20:02 -05:00
Lex Berezhny
ec0483b975 header progress percent starts at 0 instead of None 2018-11-12 21:16:05 -05:00
Jack Robison
2fba1f417f
less verbose logging 2018-11-12 14:47:11 -05:00
Jack Robison
5b419b55c5
fix peer_list 2018-11-12 14:45:41 -05:00
Jack Robison
d704336f20
absolute imports 2018-11-09 16:52:46 -05:00
Jack Robison
88095af1cd
move system_info.py into lbrynet.extras 2018-11-09 16:52:46 -05:00
Jack Robison
e9efd9f68a
improve get_external_ip 2018-11-09 16:52:46 -05:00
Jack Robison
7b32e2ff7c
don't block the dht component on populating the routing table 2018-11-09 16:52:46 -05:00
Jack Robison
572777305e
reduce analytics event frequency 2018-11-09 16:52:46 -05:00
Jack Robison
a6b643bb34
move files 2018-11-09 16:52:42 -05:00
Jack Robison
488b976734
move HashAnnouncer.py to extras 2018-11-09 14:16:33 -05:00
Jack Robison
253912b52e
fix skipping dht, peer_protocol_server, and hash_announcer components
-move PeerFinder and PeerManager initialization to the ComponentManager

-remove dht component requirement from all but the hash_announcer component. This allows running the file manager component without either of the server components.
2018-11-09 14:16:33 -05:00
Jack Robison
0bf8416d9f
fix components_to_skip setting 2018-11-09 14:16:33 -05:00
Jack Robison
2e921437d8
fix external ip setup
fixes https://github.com/lbryio/lbry/issues/1561
2018-11-09 14:16:33 -05:00
Lex Berezhny
57430e9f5f fixed #1616 2018-11-09 12:03:55 -05:00
Lex Berezhny
934682bd0f --blocking support in abandon command 2018-11-07 18:28:02 -05:00
Victor Shyba
daecc582f3 simplify bind statement 2018-11-07 11:29:56 -05:00
Victor Shyba
3cb4012dbf unify loop 2018-11-07 11:29:56 -05:00
Victor Shyba
f7bd44a4f5 fix query for windows (999 vars limit) 2018-11-07 11:29:56 -05:00
Lex Berezhny
e3fd94dbf0 pylint fix 2018-11-07 10:57:11 -05:00
Lex Berezhny
0ae5f1a4c6 added fix for #1533 2018-11-07 10:57:11 -05:00
Lex Berezhny
264e6744e1 updated references after moving conf to lbrynet.extras.daemon.conf 2018-11-04 20:25:24 -05:00
Lex Berezhny
64e2b79c07 moved conf into daemon 2018-11-04 20:25:24 -05:00
Lex Berezhny
9255bb5abe updated references after moving analytics to lbrynet.extras.daemon.analytics 2018-11-04 20:25:24 -05:00
Lex Berezhny
d7525dacc3 moved analytics to lbrynet/extra/daemon 2018-11-04 20:25:24 -05:00
Lex Berezhny
171c080d33 updated references lbrynet.file_manager -> lbrynet.blob 2018-11-04 20:25:24 -05:00
Lex Berezhny
8b265801df updated references lbrynet.lbry_file.client -> lbrynet.file_manager.client 2018-11-04 20:25:24 -05:00
Lex Berezhny
c1a9cd93ee updated references lbrynet.crypstream -> lbrynet.blob 2018-11-04 20:25:24 -05:00
Lex Berezhny
1292eb345d fix dbmigrator pylint issue 2018-11-04 20:25:24 -05:00
Lex Berezhny
f4c6dc90c9 updated references lbrynet.core -> lbrynet.p2p 2018-11-04 20:25:24 -05:00
Lex Berezhny
b6d986cb40 updated references after moving lbrynet/database into lbrynet/extras/daemon 2018-11-04 20:25:24 -05:00
Lex Berezhny
6cc134c7c8 merged lbrynet/database with lbrynet/extras/daemon 2018-11-04 20:25:24 -05:00
Lex Berezhny
eee964cfa0 updated references to daemon after moving it to extras 2018-11-04 20:25:24 -05:00
Lex Berezhny
a03c94bfad moved daemon to extras/daemon 2018-11-04 20:25:24 -05:00