LBRYCommunity/ytsync
1
0
Fork 0
Code Issues 39 Pull requests 8 Packages Projects Releases 197 Wiki Activity
367 commits 17 branches 205 tags 26 MiB
Commit graph

144 commits

Author SHA1 Message Date
Niko Storni 5b9846bcca fix pointer issue 2019-09-27 19:29:42 +02:00
Niko Storni 8d849b8f06 do not retry unavailable videos 2019-09-27 16:12:21 +02:00
Niko Storni c41c368f34 fix transfer bugs 2019-09-27 16:10:57 +02:00
Niko Storni 7ce4c4a2ce fix lbrynet shutdown check in e2e 2019-09-25 05:07:19 +02:00
Niko Storni 0d473cc4f6 add support for transferring videos after transferring everything 2019-09-25 04:38:49 +02:00
Niko Storni 2f701a887a fix double counting 
fix transferred check
 2019-09-25 04:15:16 +02:00
Niko Storni 8d56ef852f fix e2e 
fix database transferred flag
 2019-09-25 03:30:07 +02:00
Niko Storni 849ff11bfd import public keys if available 2019-09-24 20:42:17 +02:00
Niko Storni 07413b499a update SDK support 
fix bug where videos would publish to the wrong address
 2019-09-24 18:51:06 +02:00
Niko Storni 1b08bb0e61 fix bug with non latin titles for claim names 
hard exit when a duplicate name is attempted
 2019-09-10 11:43:20 +02:00
Niko Storni bdd55c9965 fix balance refill issue 
add additional debugging
 2019-09-04 19:24:11 +02:00
Niko Storni 14668c339e refactor sync flags 
add disable-transfer flag
 2019-08-30 21:31:58 +02:00
Niko Storni 7d38aa7b29 add republishing on non-available videos 
enhanced logging
 2019-08-30 19:35:04 +02:00
Niko Storni 3c3ea2138e adjust support management 
adjust e2e script
 2019-08-28 21:08:25 +02:00
Mark Beamer Jr bacb91e82a Add supporty to create supports 
Update lbry.go dep to get lbrycrd commands
 2019-08-28 15:25:53 +02:00
Niko Storni 577411cf50 fix e2e 
add support for supports (heh)
 2019-08-28 15:25:53 +02:00
Niko Storni f7c80c2e5d refactor transfer process 
start working on supports
 2019-08-28 15:25:53 +02:00
Niko Storni 4d16a1d6e8 fix e2e tests 
update wallet server
cleanup go.sum
Fix broken balance logging
Prevent failures once channel is transferred
Wait for all UTXOs to confirm before transferring
Fix various bugs
 2019-08-28 15:25:53 +02:00
Niko Storni 7a7de03c0f adjust account balance 
minor fix
 2019-08-28 15:25:53 +02:00
Niko Storni 1b9ed266e0 move channel status call to proper region 
fix shadowed errors
refactor code to be more readable and consistent
get video transfer state
 2019-08-28 15:25:53 +02:00
Mark Beamer Jr eb2f6273e4 Add transfer of channel after all video's have been transferred 
Add channel status call to notify external db that the channel has been transferred.
 2019-08-28 15:25:53 +02:00
Mark Beamer Jr 45cea808ed Add marking video status when transfer of claim is complete. 
Add error handling when transfer of claim fails.
 2019-08-28 15:25:53 +02:00
Mark Beamer Jr 9a5b6b4e56 Update to leverage lbrycrd v0.17.2.1, lbrynet v0.39.1, walletserver v0.39.1 2019-08-28 15:25:53 +02:00
Mark Beamer Jr d63aba568d Add transfer logic as post sync process step. 
Add authtoken for youtuber in test data setup to call transfer api
Update e2e test to include scenario where we transfer channel.
 2019-08-28 15:25:53 +02:00
Niko Storni 4cc0b71279 process failures sequentially 2019-08-20 11:33:06 +02:00
Niko Storni 81616c1d96 refactor channel selector 
remove unused code
 2019-08-15 19:31:43 +02:00
Niko Storni 5cb7f72ef7 remove useless logging 2019-08-14 05:18:57 +02:00
Mark Beamer Jr cd57e1ab08 Always send channel export 2019-08-14 04:22:59 +02:00
Mark Beamer Jr b90e367e82 Addressed comments 2019-08-14 04:22:59 +02:00
Mark Beamer Jr e477759395 change to master tag of internal-apis docker image 2019-08-14 04:22:59 +02:00
Mark Beamer Jr 6438048f40 Add CleanOnStartup for local testing and e2e testing 
Update methods to be refactored into util package to be used in many locations.
Add end to end test of ytsync for CI
 2019-08-14 04:22:59 +02:00
Mark Beamer Jr 73937a541b Add var/tmp volume for ytsync tmp files communicated between lbrynet and ytsync 
Add reference to wallet dir env var for when the wallet file is uploaded so it is cleared properly when testing locally
 2019-08-14 04:22:59 +02:00
Mark Beamer Jr 517c2c56a3 Add disabling of blob uploading for local testing until reflector docker image can be created( not urgent now ). 
Add ability to generate blocks when in regtest mode and using docker.
Add refactor of environment variable accessing.
 2019-08-14 04:22:59 +02:00
Mark Beamer Jr c84e1e6fb9 Fixed bugs around sending channel cert and enabling local testing with docker. 2019-08-14 04:22:59 +02:00
Mark Beamer Jr 5e56ac0516 Add set channel cert on new channels. 2019-08-14 04:22:59 +02:00
Niko Storni 0308da2e4c add timeout to daemon startup 2019-08-13 23:05:09 +02:00
Niko Storni 0aedf80386 limit throttling to only queued channels 2019-07-22 16:24:13 -04:00
Niko Storni c193dae95a temporary throttling of channels to sync for tom to review them 2019-07-22 16:16:23 -04:00
Niko Storni 8f556a86c8 fix missing fragments for good 
never retry them again
 2019-07-22 02:45:38 +02:00
Niko Storni 60f2585f33 improve throttling 
refactor slack wrapper
cleanup dependencies
 2019-07-15 16:16:02 -04:00
Niko Storni 8c2a8262e6 fix bugs 2019-07-12 23:20:01 +02:00
Niko Storni 6f486717da fix stop pattern 
fix noretry string
fix youtube-dl param
 2019-07-12 22:58:34 +02:00
Niko Storni a3fcd67611 better handle interruptions by user 
refactor IP throttling in its own package
 2019-07-12 21:32:49 +02:00
Niko Storni 2f11d99a97 stop on rare bug/failure 2019-07-12 02:21:27 +02:00
Niko Storni 51cb7f5e34 improve youtube antithrottle 
fix logging
 2019-07-11 19:14:15 +02:00
Niko Storni b34d328cba halt ytsync when youtube throttles us 2019-07-10 22:47:01 +02:00
Niko Storni 013760d48d delete blobs after reflection 
remove 15 seconds wait after sync
 2019-07-10 17:27:46 +02:00
Niko Storni 5dbad2d2e4 add automatic blob reflection 
retry videos that fail due to tx issues
 2019-07-10 15:46:54 +02:00
Niko Storni 545ab07013 fail channels that should fail 2019-07-05 17:35:20 +02:00
Niko Storni c402a1cdef add locking to map reads 2019-06-26 14:40:40 -04:00
Niko Storni a4c6b2da30 actually count UTXOs 2019-06-25 22:28:43 -04:00
Niko Storni 4506bdb638 fix bug in utxo counting 2019-06-25 21:12:15 -04:00
Niko Storni a8551bc9ee fix UTXO waiting logic 2019-06-25 20:45:27 -04:00
Niko Storni b5c9806dd0 improve space management 2019-06-24 20:43:50 -04:00
Niko Storni 8c349cf7ac fix bug in queues 2019-06-24 04:14:27 -04:00
Niko Storni f3f40c41ef fix refill balance 2019-06-22 06:08:11 -04:00
Niko Storni 05b65c4cb5 add noretry failure 2019-06-21 16:41:46 +02:00
Niko Storni 69ad13848b fix utxo count 
fix one bug
add content type to uploaded thumbs
 2019-06-20 21:45:17 +02:00
Niko Storni 6668840b11 fix description not containing youtube link 
add workaround to SDK bug not spending the right UTXOs
fix bug in assignments
 2019-06-13 19:33:58 +02:00
Niko Storni e893f68bc1 fix queue pulling 
fix address reuse
 2019-06-12 22:42:42 +02:00
Niko Storni 8da631eac3 add a limit to UTXOs generation 
fix broadcastFee
fix spelling
 2019-06-12 05:33:13 +02:00
Niko Storni 1729af0ae5 fix UTXOs management while publishing 
fix account_set
improve logging
 2019-06-12 05:25:01 +02:00
Niko Storni dce71d2451 add adjustments to video tracking 
reduce minimum refill amount (min account balance supersedes)
revert account_fund change as --everything isn't supported with outputs
fix bugs
 2019-06-12 04:44:56 +02:00
Niko Storni f4e75cf221 rewrite account funding algorithm 
lock publishing when UTXOs management is in progress
spend everything when funding UTXOs
update lbry.go
 2019-06-12 03:17:59 +02:00
Niko Storni f7f0231c80 add VideoUpgradeFailed staus 2019-06-10 21:59:42 +02:00
Niko Storni 52cd483f47 add single channelwide tag 
fix bug
 2019-06-10 21:37:13 +02:00
Niko Storni 79dd6d1458 add better handling for database mismatches 
improve UTXOs management
fix bugs
 2019-06-10 02:23:07 +02:00
Niko Storni 10ad46f464 various bug fixes 2019-06-06 23:25:31 +02:00
Niko Storni ccebab35da fix bugs 2019-06-06 17:26:10 +02:00
Niko Storni 8dce052fe6 change logic used to upgrade videos 2019-06-06 16:24:20 +02:00
Niko Storni 76e653fb9b add Fee support 
lowercase all tags
refactor code
implement and test regexps for tags
 2019-06-06 02:16:07 +02:00
Niko Storni cfe8ff0879
add flag to remove unpublished videos 
refactor code
add workaround for SDK bug
add code to remove unpublished videos
fix alt downloader to only produce mp4
add missing height and width
add tags sorting
add a few channel wide tags
 2019-06-04 22:21:44 +02:00
Niko Storni 3389a8be93 fix many bugs 
calculate size for claims missing in the database
fix reprocessing for videos no longer on youtube
pass metadata instead of hardcoding it
add video height when updating streams
add tags to channels
add test for tags
 2019-06-01 01:46:16 +02:00
Niko Storni 913c31a9f7 add channelID to video property 
work around missing data for mocked videos
normalize tags
sort tags
 2019-05-31 23:15:22 +02:00
Niko Storni 6767fdcc40 reprocess videos that are no longer on youtube (part 1) 2019-05-31 10:38:31 -04:00
Niko Storni e73085b6bc fix bugs 
update tags
 2019-05-30 01:15:28 +02:00
Niko Storni 74d5e2606d fix cover URL 
fix fallback download
fix thumbnail permissions
 2019-05-28 22:40:31 +02:00
Niko Storni 637785f4ac Add prefilling for upgrades 
add background image to channels
 2019-05-24 19:01:16 +02:00
Niko Storni 843575c4ba
add upgrade process for channels 
add check for videos that don't need reprocessing
 2019-05-09 17:07:01 +02:00
Niko Storni aecfc67f84 bug fixes 
first working version of re-processing
add metadata version to api updates
 2019-05-08 23:12:13 +02:00
Niko Storni 75364805a5 more refactoring 2019-05-07 21:15:43 +02:00
Niko Storni 07f66a089f update dependency and fix bugs 2019-05-07 18:28:25 +02:00
Niko Storni 36abd1e471 remove lambda dependency 
fix error checking
 2019-05-07 10:01:11 -04:00
Niko Storni 502bfa924b change minimum refill amount 
remove more berkeley code
add address reuse code
remove strPtr function in favor of utils
refactor code
 2019-05-06 21:56:56 +02:00
Niko Storni 23b8fb4e54 add support for new SDK 
add support for direct thumbnails upload
remove UCB code
add support for republishing
refactoring
 2019-05-03 05:11:52 +02:00
Niko Storni a648287e1c add unpublished status 2019-04-25 22:08:07 +02:00
Niko Storni af13ec5684 fixes for 0.36 2019-04-25 07:16:45 -04:00
Niko Storni 01590306a1 Add support for SDK 0.35 
Implement thumbnails uploader
Fetch more data from youtube for additional metadata
 2019-04-18 21:22:51 -04:00
Niko Storni c73988416c rename binary output 
handle funds better
 2019-03-29 02:38:00 +01:00
Niko Storni ef950997e5 add additional status 2019-03-07 17:38:59 +01:00
Niko Storni 91fe8ba459 use go mod 
update lbry.go deps
rename LBRY_API env var as the SDK is now using it too
fix startup routine
replace ytdl library
add hardcoded support for khan academy
 2019-02-22 19:33:00 +01:00
Niko Storni 1a3a587514 hotfixes for imported channels 
convert to go mod
bug fixes
 2019-02-15 14:11:38 +01:00
Niko Storni 5e125fa641 upgrade ytsync to latest SDK 2019-01-30 13:42:23 +01:00
Mark Beamer Jr 01bbe95226 upgraded to latest lbry.go reorg part 2 2019-01-16 12:51:15 +01:00